2024-02-17T14:17:22.471 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-17T14:17:22.471 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318 --owner scheduled_yuriw@teuthology --name yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi --description fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} -- /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318/orig.config.yaml 2024-02-17T14:17:22.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:17:22.596 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318 branch: main description: fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} email: yweinste@redhat.com first_in_suite: false job_id: '7563318' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 client use faked inos: true debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 6822c7b54e949006be7a0802650d01723d834d1d ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 6822c7b54e949006be7a0802650d01723d834d1d thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 6822c7b54e949006be7a0802650d01723d834d1d owner: scheduled_yuriw@teuthology priority: 51 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 2794 sha1: 6822c7b54e949006be7a0802650d01723d834d1d sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 6822c7b54e949006be7a0802650d01723d834d1d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOK5IpjFUEuLz0UF0NoR2IV9XdoyRPqKvsWOVlQ5sRLe3wnNrpZgFUQ9eR8NCGqnJEgMCWG+jmKRkjb8zvbFREI= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKUQ43CaH7NvsQ4ZYOyTA2ps4YzW6p5osYh334pRbjJhG4pR9Bmcz00lOsDwmqLFRqBja7OHTWN4xX1V2JfwOUY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-16_20:13:25 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-17T14:17:22.596 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa; will attempt to use it 2024-02-17T14:17:22.597 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks 2024-02-17T14:17:22.597 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-17T14:17:22.598 INFO:teuthology.task.internal:Checking packages... 2024-02-17T14:17:22.626 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6822c7b54e949006be7a0802650d01723d834d1d' 2024-02-17T14:17:22.626 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-17T14:17:22.626 INFO:teuthology.packaging:ref: None 2024-02-17T14:17:22.626 INFO:teuthology.packaging:tag: None 2024-02-17T14:17:22.627 INFO:teuthology.packaging:branch: main 2024-02-17T14:17:22.627 INFO:teuthology.packaging:sha1: 6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T14:17:22.627 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-02-17T14:17:23.007 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1543.g0ed764e6 2024-02-17T14:17:23.009 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-17T14:17:23.015 INFO:teuthology.task.internal:no buildpackages task found 2024-02-17T14:17:23.015 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-17T14:17:23.068 INFO:teuthology.task.internal:Saving configuration 2024-02-17T14:17:23.083 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-17T14:17:23.096 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-17T14:17:23.121 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 14:12:31.323801', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOK5IpjFUEuLz0UF0NoR2IV9XdoyRPqKvsWOVlQ5sRLe3wnNrpZgFUQ9eR8NCGqnJEgMCWG+jmKRkjb8zvbFREI='} 2024-02-17T14:17:23.148 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 14:12:31.325321', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKUQ43CaH7NvsQ4ZYOyTA2ps4YzW6p5osYh334pRbjJhG4pR9Bmcz00lOsDwmqLFRqBja7OHTWN4xX1V2JfwOUY='} 2024-02-17T14:17:23.148 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-17T14:17:23.158 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-02-17T14:17:23.158 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-02-17T14:17:23.158 INFO:teuthology.run_tasks:Running task console_log... 2024-02-17T14:17:23.258 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f65ab8203a0>, signals=[15]) 2024-02-17T14:17:23.258 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-17T14:17:23.268 INFO:teuthology.task.internal:Opening connections... 2024-02-17T14:17:23.268 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-02-17T14:17:23.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:17:23.355 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-02-17T14:17:23.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:17:23.458 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-17T14:17:23.467 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-02-17T14:17:23.485 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-02-17T14:17:23.485 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-02-17T14:17:23.543 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-02-17T14:17:23.543 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-02-17T14:17:23.543 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-02-17T14:17:23.543 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:17:23.544 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-02-17T14:17:23.544 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-02-17T14:17:23.544 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T14:17:23.544 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-02-17T14:17:23.544 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-02-17T14:17:23.544 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T14:17:23.545 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:17:23.545 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:17:23.545 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T14:17:23.545 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:17:23.546 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-02-17T14:17:23.570 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-02-17T14:17:23.588 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-02-17T14:17:23.588 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-02-17T14:17:23.645 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-02-17T14:17:23.645 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-02-17T14:17:23.645 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-02-17T14:17:23.645 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:17:23.645 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-02-17T14:17:23.645 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-02-17T14:17:23.645 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T14:17:23.645 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-02-17T14:17:23.646 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-02-17T14:17:23.646 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T14:17:23.646 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:17:23.646 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:17:23.646 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T14:17:23.646 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:17:23.646 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-02-17T14:17:23.670 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-17T14:17:23.682 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-17T14:17:23.713 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-17T14:17:23.713 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-02-17T14:17:23.715 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-02-17T14:17:23.731 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-17T14:17:23.774 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-17T14:17:23.774 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-02-17T14:17:23.777 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-02-17T14:17:23.811 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-17T14:17:23.878 INFO:teuthology.run_tasks:Running task kernel... 2024-02-17T14:17:23.903 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-17T14:17:23.903 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-17T14:17:23.903 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-17T14:17:23.904 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-17T14:17:23.920 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T14:17:23.920 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-02-17T14:17:23.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T14:17:23.921 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-02-17T14:17:23.977 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-361.el9.x86_64 2024-02-17T14:17:23.977 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.14.0-361.el9.x86_64 2024-02-17T14:17:23.977 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-02-17T14:17:23.978 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-361.el9.x86_64 2024-02-17T14:17:23.978 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.14.0-361.el9.x86_64 2024-02-17T14:17:23.978 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2024-02-17T14:17:26.147 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-02-17T14:17:26.414 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - AppStream 9.1 MB/s | 6.7 MB 00:00 2024-02-17T14:17:27.822 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 3.7 MB/s | 2.0 MB 00:00 2024-02-17T14:17:28.064 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - BaseOS 3.4 MB/s | 2.0 MB 00:00 2024-02-17T14:17:28.830 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.0 MB 00:00 2024-02-17T14:17:29.555 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.0 MB 00:01 2024-02-17T14:17:31.450 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-02-17T14:17:31.489 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-02-17T14:17:36.948 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.1 MB 00:01 2024-02-17T14:17:38.715 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 15 kB 00:00 2024-02-17T14:17:39.056 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 1.5 MB/s | 6.1 MB 00:04 2024-02-17T14:17:39.500 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 31 MB/s | 20 MB 00:00 2024-02-17T14:17:41.723 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 9.7 kB/s | 15 kB 00:01 2024-02-17T14:17:43.466 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2024-02-17T14:17:44.508 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-02-17T14:17:46.790 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-17T14:17:46.791 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-17T14:17:46.893 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-17T14:17:46.902 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-17T14:17:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-02-17T14:17:46.902 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-17T14:17:46.902 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-17T14:17:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-17T14:17:46.902 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-02-17T14:17:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-17T14:17:46.902 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-17T14:17:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-17T14:17:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:17:46.903 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-17T14:17:46.903 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-02-17T14:17:46.903 INFO:teuthology.orchestra.run.smithi134.stdout:Install 4 Packages 2024-02-17T14:17:46.903 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:17:46.903 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 100 M 2024-02-17T14:17:46.903 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 123 M 2024-02-17T14:17:46.903 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-17T14:17:47.568 INFO:teuthology.orchestra.run.smithi134.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 9.1 MB/s | 6.1 MB 00:00 2024-02-17T14:17:48.160 INFO:teuthology.orchestra.run.smithi134.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 17 MB/s | 21 MB 00:01 2024-02-17T14:17:48.541 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-02-17T14:17:48.918 INFO:teuthology.orchestra.run.smithi134.stdout:(3/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 19 MB/s | 39 MB 00:02 2024-02-17T14:17:49.410 INFO:teuthology.orchestra.run.smithi134.stdout:(4/4): kernel-modules-core-5.14.0-421.el9.x86_6 18 MB/s | 33 MB 00:01 2024-02-17T14:17:49.413 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-17T14:17:49.414 INFO:teuthology.orchestra.run.smithi134.stdout:Total 40 MB/s | 100 MB 00:02 2024-02-17T14:17:49.414 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-17T14:17:49.765 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-17T14:17:49.765 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-17T14:17:50.789 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-17T14:17:50.790 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-17T14:17:50.806 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-17T14:17:50.806 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-17T14:17:50.881 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-17T14:17:50.893 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-17T14:17:50.894 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-17T14:17:50.894 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-17T14:17:50.894 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-17T14:17:50.894 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-17T14:17:50.894 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-17T14:17:50.894 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-17T14:17:50.894 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-17T14:17:50.894 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-17T14:17:50.894 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:17:50.894 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-17T14:17:50.894 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-17T14:17:50.894 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-02-17T14:17:50.894 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:17:50.895 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 100 M 2024-02-17T14:17:50.895 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 123 M 2024-02-17T14:17:50.895 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-17T14:17:51.292 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 15 MB/s | 6.1 MB 00:00 2024-02-17T14:17:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 21 MB/s | 21 MB 00:00 2024-02-17T14:17:52.651 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 22 MB/s | 39 MB 00:01 2024-02-17T14:17:53.126 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): kernel-modules-core-5.14.0-421.el9.x86_6 18 MB/s | 33 MB 00:01 2024-02-17T14:17:53.129 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-17T14:17:53.129 INFO:teuthology.orchestra.run.smithi142.stdout:Total 45 MB/s | 100 MB 00:02 2024-02-17T14:17:53.130 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-17T14:17:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-17T14:17:53.504 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-17T14:17:53.504 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-17T14:17:53.886 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-17T14:17:54.019 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T14:17:54.544 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-17T14:17:54.544 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-17T14:17:56.782 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T14:17:56.955 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T14:17:56.983 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-17T14:17:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-17T14:17:57.758 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T14:18:00.512 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T14:18:00.684 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T14:18:01.684 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T14:18:01.900 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-17T14:18:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T14:18:05.796 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-17T14:18:06.657 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T14:18:10.509 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T14:18:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T14:18:35.774 INFO:teuthology.orchestra.run.smithi134.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-17T14:18:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:18:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-17T14:18:36.277 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-17T14:18:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-17T14:18:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T14:18:36.278 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T14:18:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T14:18:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:18:36.704 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-17T14:18:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-17T14:18:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-17T14:18:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-17T14:18:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-17T14:18:36.704 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:18:36.705 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-17T14:18:37.183 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T14:18:37.335 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-17T14:18:37.336 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-17T14:18:37.336 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-17T14:18:37.336 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-17T14:18:37.336 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-17T14:18:37.336 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-17T14:18:37.336 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-02-17T14:18:37.336 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T14:18:37.444 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-17T14:18:37.445 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-17T14:18:37.445 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-02-17T14:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-02-17T14:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-02-17T14:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.06 2024-02-17T14:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 68.el9 2024-02-17T14:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-02-17T14:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-17T14:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout:Group : Unspecified 2024-02-17T14:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 8264254 2024-02-17T14:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-02-17T14:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-17T14:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-17T14:18:37.479 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-17T14:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-17T14:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : builder@centos.org 2024-02-17T14:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-02-17T14:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-17T14:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-02-17T14:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-02-17T14:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-17T14:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-17T14:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-17T14:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-02-17T14:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:18:37.480 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-02-17T14:18:37.481 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-17T14:18:37.481 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 5.14.0-421.el9.x86_64 2024-02-17T14:18:37.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-17T14:18:38.086 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-02-17T14:18:39.476 INFO:teuthology.orchestra.run.smithi134.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-17T14:18:39.497 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-02-17T14:18:39.499 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-02-17T14:18:39.513 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.JWbPFkSrb5 2024-02-17T14:18:39.514 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JWbPFkSrb5 2024-02-17T14:18:39.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.JWbPFkSrb5 2024-02-17T14:18:39.725 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.JWbPFkSrb5 is 6KB 2024-02-17T14:18:39.773 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.JWbPFkSrb5 2024-02-17T14:18:39.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-02-17T14:18:39.852 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-17T14:18:39.852 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-17T14:18:39.852 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-17T14:18:39.852 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-17T14:18:39.854 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-17T14:18:39.919 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T14:18:39.920 INFO:teuthology.orchestra.run.smithi142.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-17T14:18:39.920 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:18:39.989 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-17T14:18:40.002 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-02-17T14:18:40.454 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-17T14:18:40.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-17T14:18:40.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-17T14:18:40.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-17T14:18:40.913 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-17T14:18:40.913 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:18:40.914 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-17T14:18:40.914 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-17T14:18:40.914 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-17T14:18:40.914 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-17T14:18:40.914 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-17T14:18:40.914 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:18:40.914 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-17T14:18:41.438 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T14:18:41.577 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-17T14:18:41.577 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-17T14:18:41.578 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-17T14:18:41.578 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-17T14:18:41.578 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-17T14:18:41.578 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-02-17T14:18:41.578 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2024-02-17T14:18:41.578 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T14:18:41.686 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-17T14:18:41.686 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-17T14:18:41.686 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-02-17T14:18:41.720 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-02-17T14:18:41.720 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-02-17T14:18:41.720 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-02-17T14:18:41.720 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 68.el9 2024-02-17T14:18:41.720 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-02-17T14:18:41.720 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-17T14:18:41.720 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-02-17T14:18:41.720 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8264254 2024-02-17T14:18:41.720 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-02-17T14:18:41.720 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-17T14:18:41.720 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:18:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-02-17T14:18:41.722 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-17T14:18:41.722 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 5.14.0-421.el9.x86_64 2024-02-17T14:18:41.722 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-17T14:18:42.299 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-02-17T14:18:43.713 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-17T14:18:43.743 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-02-17T14:18:43.745 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-02-17T14:18:43.760 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.JBG5gwHGIO 2024-02-17T14:18:43.760 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JBG5gwHGIO 2024-02-17T14:18:43.828 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.JBG5gwHGIO 2024-02-17T14:18:43.964 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.JBG5gwHGIO is 6KB 2024-02-17T14:18:44.012 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.JBG5gwHGIO 2024-02-17T14:18:44.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-02-17T14:18:44.091 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-17T14:18:44.092 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-17T14:18:44.092 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-17T14:18:44.092 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-17T14:18:44.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-17T14:18:44.229 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-02-17T14:19:10.028 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-17T14:19:10.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-17T14:19:10.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:19:14.236 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-17T14:19:14.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-17T14:19:14.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:19:28.447 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-02-17T14:19:32.796 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-02-17T14:19:37.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-17T14:19:37.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:19:40.508 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-02-17T14:19:41.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-17T14:19:41.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:19:44.860 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-02-17T14:19:52.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-17T14:19:52.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:19:56.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-17T14:19:56.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:20:10.944 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-02-17T14:20:15.292 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-02-17T14:20:25.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-17T14:20:25.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:20:26.248 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-02-17T14:20:26.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-17T14:20:26.680 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-421.el9.x86_64"... 2024-02-17T14:20:26.680 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-02-17T14:20:26.693 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-421.el9.x86_64 2024-02-17T14:20:26.694 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-17T14:20:26.694 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-17T14:20:26.694 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-17T14:20:27.694 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-17T14:20:27.695 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-17T14:20:27.795 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-02-17T14:20:27.832 DEBUG:teuthology.parallel:result is None 2024-02-17T14:20:30.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-17T14:20:30.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:20:30.690 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-02-17T14:20:31.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-17T14:20:31.067 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-421.el9.x86_64"... 2024-02-17T14:20:31.067 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-02-17T14:20:31.081 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-421.el9.x86_64 2024-02-17T14:20:31.081 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-17T14:20:31.081 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-17T14:20:31.081 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-17T14:20:32.082 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-17T14:20:32.082 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-17T14:20:32.158 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-02-17T14:20:32.194 DEBUG:teuthology.parallel:result is None 2024-02-17T14:20:32.275 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-17T14:20:32.283 INFO:teuthology.task.internal:Creating test directory... 2024-02-17T14:20:32.283 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-17T14:20:32.286 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-17T14:20:32.301 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-17T14:20:32.333 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-17T14:20:32.367 INFO:teuthology.task.internal:Creating archive directory... 2024-02-17T14:20:32.367 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-17T14:20:32.370 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-17T14:20:32.509 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-17T14:20:32.516 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-17T14:20:32.516 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-17T14:20:32.519 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-17T14:20:32.553 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T14:20:32.554 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T14:20:32.566 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T14:20:32.568 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T14:20:32.570 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-17T14:20:32.579 INFO:teuthology.task.internal:Configuring sudo... 2024-02-17T14:20:32.579 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-17T14:20:32.612 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-17T14:20:32.640 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-17T14:20:32.650 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-17T14:20:32.650 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-17T14:20:32.683 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-17T14:20:32.700 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T14:20:32.779 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T14:20:32.835 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T14:20:32.920 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T14:20:32.961 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:20:32.961 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-17T14:20:33.028 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T14:20:33.067 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T14:20:33.139 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T14:20:33.177 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T14:20:33.227 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:20:33.227 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-17T14:20:33.298 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-02-17T14:20:33.300 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-02-17T14:20:33.359 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T14:20:33.391 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T14:20:33.755 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-17T14:20:33.763 INFO:teuthology.task.internal:Starting timer... 2024-02-17T14:20:33.763 INFO:teuthology.run_tasks:Running task pcp... 2024-02-17T14:20:33.812 INFO:teuthology.run_tasks:Running task selinux... 2024-02-17T14:20:33.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-02-17T14:20:33.893 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-02-17T14:20:33.895 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-02-17T14:20:33.953 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-02-17T14:20:33.955 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-17T14:20:33.955 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-02-17T14:20:33.982 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-02-17T14:20:33.982 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-02-17T14:20:34.003 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-02-17T14:20:34.004 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi134.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-02-17T14:20:34.004 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T14:20:34.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T14:20:34.050 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T14:20:34.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T14:20:34.078 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-17T14:20:34.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-02-17T14:20:34.126 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-02-17T14:20:34.155 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-17T14:20:34.165 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-17T14:20:34.170 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-17T14:20:34.457 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-17T14:20:34.473 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-17T14:20:34.475 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi134.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-17T14:24:48.145 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-02-17T14:24:48.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-17T14:24:48.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:24:48.239 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-02-17T14:24:48.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-02-17T14:24:48.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-17T14:24:48.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:24:48.411 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-02-17T14:24:48.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-17T14:24:48.487 INFO:teuthology.run_tasks:Running task clock... 2024-02-17T14:24:48.498 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-17T14:24:48.498 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-17T14:24:48.499 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T14:24:48.501 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-17T14:24:48.501 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T14:24:48.530 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-17T14:24:48.547 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-17T14:24:48.559 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-17T14:24:48.575 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-02-17T14:24:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-17T14:24:48.589 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-02-17T14:24:48.604 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-02-17T14:24:48.605 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-17T14:24:48.618 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-02-17T14:24:48.622 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-17T14:24:48.634 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-17T14:24:48.650 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-17T14:24:48.681 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-02-17T14:24:48.684 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T14:24:48.684 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-02-17T14:24:48.684 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T14:24:48.685 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T14:24:48.685 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T14:24:48.685 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T14:24:48.707 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-02-17T14:24:48.709 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T14:24:48.710 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-02-17T14:24:48.710 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T14:24:48.710 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T14:24:48.710 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T14:24:48.710 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T14:24:48.711 INFO:teuthology.run_tasks:Running task install... 2024-02-17T14:24:48.719 DEBUG:teuthology.task.install:project ceph 2024-02-17T14:24:48.719 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}} 2024-02-17T14:24:48.719 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'} 2024-02-17T14:24:48.719 INFO:teuthology.task.install:Using flavor: default 2024-02-17T14:24:48.726 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-17T14:24:48.726 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-02-17T14:24:48.727 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'tag': None, 'wait_for_package': False} 2024-02-17T14:24:48.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T14:24:48.729 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'tag': None, 'wait_for_package': False} 2024-02-17T14:24:48.730 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T14:24:48.871 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/ 2024-02-17T14:24:48.871 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1515.g6822c7b5 2024-02-17T14:24:48.881 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/ 2024-02-17T14:24:48.881 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1515.g6822c7b5 2024-02-17T14:24:48.997 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-17T14:24:48.997 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:24:48.997 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-17T14:24:49.025 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-17T14:24:49.025 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6822c7b54e949006be7a0802650d01723d834d1d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-17T14:24:49.069 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-17T14:24:49.069 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:24:49.070 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-17T14:24:49.092 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-17T14:24:49.096 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-17T14:24:49.097 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6822c7b54e949006be7a0802650d01723d834d1d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-17T14:24:49.165 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-17T14:24:49.172 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-17T14:24:49.238 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-02-17T14:24:49.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-02-17T14:24:49.244 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-17T14:24:49.311 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-02-17T14:24:49.312 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-02-17T14:24:49.487 INFO:teuthology.orchestra.run.smithi142.stdout:74 files removed 2024-02-17T14:24:49.517 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-17T14:24:49.547 INFO:teuthology.orchestra.run.smithi134.stdout:74 files removed 2024-02-17T14:24:49.576 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-17T14:24:50.346 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 181 kB/s | 82 kB 00:00 2024-02-17T14:24:50.638 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 102 kB/s | 82 kB 00:00 2024-02-17T14:24:50.838 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 23 kB/s | 10 kB 00:00 2024-02-17T14:24:51.230 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 19 kB/s | 10 kB 00:00 2024-02-17T14:24:51.263 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-02-17T14:24:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 3.2 kB/s | 1.9 kB 00:00 2024-02-17T14:24:52.166 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - AppStream 7.8 MB/s | 6.7 MB 00:00 2024-02-17T14:24:53.575 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 4.0 MB/s | 6.7 MB 00:01 2024-02-17T14:24:53.908 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2024-02-17T14:24:54.857 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-02-17T14:24:55.159 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 4.1 MB/s | 2.0 MB 00:00 2024-02-17T14:24:57.774 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.0 MB 00:02 2024-02-17T14:24:59.750 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-02-17T14:25:01.917 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 3.2 MB/s | 19 MB 00:05 2024-02-17T14:25:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.1 MB 00:00 2024-02-17T14:25:06.368 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 15 kB 00:01 2024-02-17T14:25:07.300 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.1 MB 00:01 2024-02-17T14:25:08.364 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2024-02-17T14:25:09.085 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 15 kB 00:00 2024-02-17T14:25:12.572 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 20 MB 00:03 2024-02-17T14:25:13.394 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-02-17T14:25:15.992 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-17T14:25:15.992 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-17T14:25:16.006 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-17T14:25:16.007 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-17T14:25:16.008 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-17T14:25:16.009 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-17T14:25:16.011 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-17T14:25:16.015 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-17T14:25:16.015 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-17T14:25:16.094 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-17T14:25:16.114 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-02-17T14:25:16.114 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-17T14:25:16.115 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-02-17T14:25:16.115 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-17T14:25:16.115 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-17T14:25:16.115 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 6.6 k 2024-02-17T14:25:16.115 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 5.3 M 2024-02-17T14:25:16.115 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 885 k 2024-02-17T14:25:16.115 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 146 k 2024-02-17T14:25:16.115 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 1.5 M 2024-02-17T14:25:16.115 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 138 k 2024-02-17T14:25:16.115 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 1.8 M 2024-02-17T14:25:16.115 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 7.4 M 2024-02-17T14:25:16.115 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 52 k 2024-02-17T14:25:16.115 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 9.8 M 2024-02-17T14:25:16.116 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 47 M 2024-02-17T14:25:16.116 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 264 k 2024-02-17T14:25:16.116 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 748 k 2024-02-17T14:25:16.116 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 217 k 2024-02-17T14:25:16.116 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 27 k 2024-02-17T14:25:16.116 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 18 k 2024-02-17T14:25:16.116 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-17T14:25:16.116 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-17T14:25:16.116 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-17T14:25:16.116 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 31 k 2024-02-17T14:25:16.116 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 743 k 2024-02-17T14:25:16.116 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 127 k 2024-02-17T14:25:16.116 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 162 k 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 321 k 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 298 k 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 99 k 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 85 k 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 3.1 M 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 171 k 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-17T14:25:16.117 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-17T14:25:16.118 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-17T14:25:16.119 INFO:teuthology.orchestra.run.smithi142.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-17T14:25:16.119 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 3.4 M 2024-02-17T14:25:16.119 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 3.1 M 2024-02-17T14:25:16.119 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-17T14:25:16.119 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-17T14:25:16.119 INFO:teuthology.orchestra.run.smithi142.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-17T14:25:16.119 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-17T14:25:16.119 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-17T14:25:16.119 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-17T14:25:16.119 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-17T14:25:16.120 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-17T14:25:16.120 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-17T14:25:16.120 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-17T14:25:16.120 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-17T14:25:16.121 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-17T14:25:16.121 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-17T14:25:16.121 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 20 M 2024-02-17T14:25:16.121 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 31 k 2024-02-17T14:25:16.121 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 2.1 M 2024-02-17T14:25:16.121 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 247 k 2024-02-17T14:25:16.122 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 4.7 M 2024-02-17T14:25:16.122 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 17 M 2024-02-17T14:25:16.122 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 15 k 2024-02-17T14:25:16.122 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 25 k 2024-02-17T14:25:16.122 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-17T14:25:16.122 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-17T14:25:16.122 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-17T14:25:16.122 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-17T14:25:16.122 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-17T14:25:16.123 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-17T14:25:16.123 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-17T14:25:16.123 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-17T14:25:16.123 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-17T14:25:16.123 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 163 k 2024-02-17T14:25:16.123 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-17T14:25:16.123 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-17T14:25:16.123 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-17T14:25:16.123 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-17T14:25:16.123 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-17T14:25:16.124 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 499 k 2024-02-17T14:25:16.124 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-17T14:25:16.124 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 5.1 M 2024-02-17T14:25:16.124 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-17T14:25:16.124 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-17T14:25:16.124 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-17T14:25:16.124 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-17T14:25:16.124 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-17T14:25:16.124 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-17T14:25:16.124 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-17T14:25:16.124 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 45 k 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 131 k 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-17T14:25:16.125 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-17T14:25:16.126 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-17T14:25:16.127 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-17T14:25:16.128 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-17T14:25:16.129 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-17T14:25:16.130 INFO:teuthology.orchestra.run.smithi142.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-17T14:25:16.130 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-17T14:25:16.130 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-17T14:25:16.130 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-02-17T14:25:16.130 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-17T14:25:16.130 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:25:16.130 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-17T14:25:16.130 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-02-17T14:25:16.130 INFO:teuthology.orchestra.run.smithi142.stdout:Install 150 Packages 2024-02-17T14:25:16.130 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 26 Packages 2024-02-17T14:25:16.130 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:25:16.131 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 223 M 2024-02-17T14:25:16.131 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-17T14:25:16.828 INFO:teuthology.orchestra.run.smithi142.stdout:(1/176): ceph-19.0.0-1515.g6822c7b5.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-02-17T14:25:17.711 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-02-17T14:25:17.987 INFO:teuthology.orchestra.run.smithi142.stdout:(2/176): ceph-fuse-19.0.0-1515.g6822c7b5.el9.x8 764 kB/s | 885 kB 00:01 2024-02-17T14:25:18.137 INFO:teuthology.orchestra.run.smithi142.stdout:(3/176): ceph-immutable-object-cache-19.0.0-151 973 kB/s | 146 kB 00:00 2024-02-17T14:25:20.262 INFO:teuthology.orchestra.run.smithi142.stdout:(4/176): ceph-mds-19.0.0-1515.g6822c7b5.el9.x86 1.0 MB/s | 2.1 MB 00:02 2024-02-17T14:25:20.286 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-17T14:25:20.287 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-17T14:25:20.299 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-17T14:25:20.300 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-17T14:25:20.301 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-17T14:25:20.302 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-17T14:25:20.303 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-17T14:25:20.306 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-17T14:25:20.307 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-17T14:25:20.389 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-02-17T14:25:20.416 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================================ 2024-02-17T14:25:20.416 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-02-17T14:25:20.416 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================================ 2024-02-17T14:25:20.416 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-02-17T14:25:20.416 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-17T14:25:20.416 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 6.6 k 2024-02-17T14:25:20.416 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 5.3 M 2024-02-17T14:25:20.416 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 885 k 2024-02-17T14:25:20.416 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 146 k 2024-02-17T14:25:20.416 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 1.5 M 2024-02-17T14:25:20.417 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 138 k 2024-02-17T14:25:20.417 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 1.8 M 2024-02-17T14:25:20.417 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 7.4 M 2024-02-17T14:25:20.417 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 52 k 2024-02-17T14:25:20.417 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 9.8 M 2024-02-17T14:25:20.417 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 47 M 2024-02-17T14:25:20.417 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 264 k 2024-02-17T14:25:20.417 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 748 k 2024-02-17T14:25:20.417 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 217 k 2024-02-17T14:25:20.417 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 27 k 2024-02-17T14:25:20.417 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 18 k 2024-02-17T14:25:20.417 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-17T14:25:20.417 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 31 k 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 743 k 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 127 k 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 162 k 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 321 k 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 298 k 2024-02-17T14:25:20.418 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 99 k 2024-02-17T14:25:20.419 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 85 k 2024-02-17T14:25:20.419 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 3.1 M 2024-02-17T14:25:20.419 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 171 k 2024-02-17T14:25:20.419 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-17T14:25:20.419 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-02-17T14:25:20.419 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-17T14:25:20.419 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-17T14:25:20.419 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-17T14:25:20.419 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-17T14:25:20.419 INFO:teuthology.orchestra.run.smithi134.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-17T14:25:20.419 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-17T14:25:20.419 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-17T14:25:20.419 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-17T14:25:20.420 INFO:teuthology.orchestra.run.smithi134.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-17T14:25:20.420 INFO:teuthology.orchestra.run.smithi134.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-17T14:25:20.420 INFO:teuthology.orchestra.run.smithi134.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-17T14:25:20.420 INFO:teuthology.orchestra.run.smithi134.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-17T14:25:20.420 INFO:teuthology.orchestra.run.smithi134.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-17T14:25:20.420 INFO:teuthology.orchestra.run.smithi134.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-17T14:25:20.420 INFO:teuthology.orchestra.run.smithi134.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-17T14:25:20.420 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 3.4 M 2024-02-17T14:25:20.420 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 3.1 M 2024-02-17T14:25:20.420 INFO:teuthology.orchestra.run.smithi134.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-17T14:25:20.420 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-17T14:25:20.420 INFO:teuthology.orchestra.run.smithi134.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-17T14:25:20.420 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 20 M 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 31 k 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 2.1 M 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 247 k 2024-02-17T14:25:20.421 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 4.7 M 2024-02-17T14:25:20.422 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 17 M 2024-02-17T14:25:20.422 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1515.g6822c7b5.el9 ceph-noarch 15 k 2024-02-17T14:25:20.422 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 25 k 2024-02-17T14:25:20.422 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-17T14:25:20.422 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-17T14:25:20.422 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-17T14:25:20.422 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-17T14:25:20.422 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-17T14:25:20.422 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-17T14:25:20.422 INFO:teuthology.orchestra.run.smithi134.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-17T14:25:20.422 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-17T14:25:20.422 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-17T14:25:20.422 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 163 k 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 499 k 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 5.1 M 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-17T14:25:20.423 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 45 k 2024-02-17T14:25:20.424 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.0.0-1515.g6822c7b5.el9 ceph 131 k 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-17T14:25:20.425 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-17T14:25:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-17T14:25:20.427 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-17T14:25:20.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-17T14:25:20.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-17T14:25:20.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-17T14:25:20.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-17T14:25:20.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-17T14:25:20.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-17T14:25:20.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-17T14:25:20.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-17T14:25:20.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-17T14:25:20.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-17T14:25:20.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-17T14:25:20.428 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-17T14:25:20.428 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================================ 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout:Install 150 Packages 2024-02-17T14:25:20.429 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 26 Packages 2024-02-17T14:25:20.430 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:25:20.430 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 223 M 2024-02-17T14:25:20.430 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-02-17T14:25:21.012 INFO:teuthology.orchestra.run.smithi134.stdout:(1/176): ceph-19.0.0-1515.g6822c7b5.el9.x86_64. 41 kB/s | 6.6 kB 00:00 2024-02-17T14:25:21.445 INFO:teuthology.orchestra.run.smithi134.stdout:(2/176): ceph-fuse-19.0.0-1515.g6822c7b5.el9.x8 2.0 MB/s | 885 kB 00:00 2024-02-17T14:25:21.512 INFO:teuthology.orchestra.run.smithi134.stdout:(3/176): ceph-immutable-object-cache-19.0.0-151 2.1 MB/s | 146 kB 00:00 2024-02-17T14:25:21.662 INFO:teuthology.orchestra.run.smithi142.stdout:(5/176): ceph-base-19.0.0-1515.g6822c7b5.el9.x8 1.0 MB/s | 5.3 MB 00:05 2024-02-17T14:25:21.696 INFO:teuthology.orchestra.run.smithi142.stdout:(6/176): ceph-mgr-19.0.0-1515.g6822c7b5.el9.x86 1.0 MB/s | 1.5 MB 00:01 2024-02-17T14:25:21.921 INFO:teuthology.orchestra.run.smithi134.stdout:(4/176): ceph-mds-19.0.0-1515.g6822c7b5.el9.x86 5.2 MB/s | 2.1 MB 00:00 2024-02-17T14:25:22.121 INFO:teuthology.orchestra.run.smithi134.stdout:(5/176): ceph-mgr-19.0.0-1515.g6822c7b5.el9.x86 7.4 MB/s | 1.5 MB 00:00 2024-02-17T14:25:22.188 INFO:teuthology.orchestra.run.smithi134.stdout:(6/176): ceph-base-19.0.0-1515.g6822c7b5.el9.x8 4.0 MB/s | 5.3 MB 00:01 2024-02-17T14:25:22.597 INFO:teuthology.orchestra.run.smithi134.stdout:(7/176): ceph-mon-19.0.0-1515.g6822c7b5.el9.x86 9.9 MB/s | 4.7 MB 00:00 2024-02-17T14:25:23.522 INFO:teuthology.orchestra.run.smithi134.stdout:(8/176): ceph-radosgw-19.0.0-1515.g6822c7b5.el9 11 MB/s | 9.8 MB 00:00 2024-02-17T14:25:23.689 INFO:teuthology.orchestra.run.smithi134.stdout:(9/176): ceph-osd-19.0.0-1515.g6822c7b5.el9.x86 11 MB/s | 17 MB 00:01 2024-02-17T14:25:23.706 INFO:teuthology.orchestra.run.smithi134.stdout:(10/176): ceph-selinux-19.0.0-1515.g6822c7b5.el 137 kB/s | 25 kB 00:00 2024-02-17T14:25:23.756 INFO:teuthology.orchestra.run.smithi134.stdout:(11/176): cephfs-mirror-19.0.0-1515.g6822c7b5.e 4.3 MB/s | 217 kB 00:00 2024-02-17T14:25:23.837 INFO:teuthology.orchestra.run.smithi134.stdout:(12/176): cephfs-shell-19.0.0-1515.g6822c7b5.el 337 kB/s | 27 kB 00:00 2024-02-17T14:25:23.898 INFO:teuthology.orchestra.run.smithi134.stdout:(13/176): libcephfs-devel-19.0.0-1515.g6822c7b5 506 kB/s | 31 kB 00:00 2024-02-17T14:25:24.007 INFO:teuthology.orchestra.run.smithi134.stdout:(14/176): libcephfs2-19.0.0-1515.g6822c7b5.el9. 6.7 MB/s | 743 kB 00:00 2024-02-17T14:25:24.091 INFO:teuthology.orchestra.run.smithi134.stdout:(15/176): libcephsqlite-19.0.0-1515.g6822c7b5.e 1.9 MB/s | 163 kB 00:00 2024-02-17T14:25:24.174 INFO:teuthology.orchestra.run.smithi134.stdout:(16/176): librados-devel-19.0.0-1515.g6822c7b5. 1.5 MB/s | 127 kB 00:00 2024-02-17T14:25:24.283 INFO:teuthology.orchestra.run.smithi134.stdout:(17/176): libradosstriper1-19.0.0-1515.g6822c7b 4.5 MB/s | 499 kB 00:00 2024-02-17T14:25:24.992 INFO:teuthology.orchestra.run.smithi134.stdout:(18/176): librgw2-19.0.0-1515.g6822c7b5.el9.x86 7.2 MB/s | 5.1 MB 00:00 2024-02-17T14:25:25.059 INFO:teuthology.orchestra.run.smithi134.stdout:(19/176): python3-ceph-argparse-19.0.0-1515.g68 679 kB/s | 45 kB 00:00 2024-02-17T14:25:25.151 INFO:teuthology.orchestra.run.smithi134.stdout:(20/176): python3-ceph-common-19.0.0-1515.g6822 1.4 MB/s | 131 kB 00:00 2024-02-17T14:25:25.226 INFO:teuthology.orchestra.run.smithi134.stdout:(21/176): python3-cephfs-19.0.0-1515.g6822c7b5. 2.1 MB/s | 162 kB 00:00 2024-02-17T14:25:25.310 INFO:teuthology.orchestra.run.smithi134.stdout:(22/176): python3-rados-19.0.0-1515.g6822c7b5.e 3.8 MB/s | 321 kB 00:00 2024-02-17T14:25:25.393 INFO:teuthology.orchestra.run.smithi134.stdout:(23/176): python3-rbd-19.0.0-1515.g6822c7b5.el9 3.5 MB/s | 298 kB 00:00 2024-02-17T14:25:25.468 INFO:teuthology.orchestra.run.smithi134.stdout:(24/176): python3-rgw-19.0.0-1515.g6822c7b5.el9 1.3 MB/s | 99 kB 00:00 2024-02-17T14:25:25.544 INFO:teuthology.orchestra.run.smithi134.stdout:(25/176): rbd-fuse-19.0.0-1515.g6822c7b5.el9.x8 1.1 MB/s | 85 kB 00:00 2024-02-17T14:25:25.927 INFO:teuthology.orchestra.run.smithi134.stdout:(26/176): rbd-mirror-19.0.0-1515.g6822c7b5.el9. 8.1 MB/s | 3.1 MB 00:00 2024-02-17T14:25:26.003 INFO:teuthology.orchestra.run.smithi134.stdout:(27/176): rbd-nbd-19.0.0-1515.g6822c7b5.el9.x86 2.2 MB/s | 171 kB 00:00 2024-02-17T14:25:26.070 INFO:teuthology.orchestra.run.smithi134.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1515.g 472 kB/s | 31 kB 00:00 2024-02-17T14:25:26.503 INFO:teuthology.orchestra.run.smithi134.stdout:(29/176): ceph-test-19.0.0-1515.g6822c7b5.el9.x 17 MB/s | 47 MB 00:02 2024-02-17T14:25:26.528 INFO:teuthology.orchestra.run.smithi134.stdout:(30/176): ceph-mgr-cephadm-19.0.0-1515.g6822c7b 301 kB/s | 138 kB 00:00 2024-02-17T14:25:26.640 INFO:teuthology.orchestra.run.smithi134.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1515.g6822c 13 MB/s | 1.8 MB 00:00 2024-02-17T14:25:26.704 INFO:teuthology.orchestra.run.smithi134.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1515.g68 3.6 MB/s | 247 kB 00:00 2024-02-17T14:25:26.763 INFO:teuthology.orchestra.run.smithi134.stdout:(33/176): ceph-mgr-rook-19.0.0-1515.g6822c7b5.e 895 kB/s | 52 kB 00:00 2024-02-17T14:25:26.822 INFO:teuthology.orchestra.run.smithi134.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1515.g6 263 kB/s | 15 kB 00:00 2024-02-17T14:25:26.889 INFO:teuthology.orchestra.run.smithi134.stdout:(35/176): ceph-volume-19.0.0-1515.g6822c7b5.el9 3.9 MB/s | 264 kB 00:00 2024-02-17T14:25:26.987 INFO:teuthology.orchestra.run.smithi142.stdout:(7/176): ceph-mon-19.0.0-1515.g6822c7b5.el9.x86 901 kB/s | 4.7 MB 00:05 2024-02-17T14:25:26.989 INFO:teuthology.orchestra.run.smithi134.stdout:(36/176): cephadm-19.0.0-1515.g6822c7b5.el9.noa 7.3 MB/s | 748 kB 00:00 2024-02-17T14:25:27.081 INFO:teuthology.orchestra.run.smithi134.stdout:(37/176): ceph-mgr-diskprediction-local-19.0.0- 13 MB/s | 7.4 MB 00:00 2024-02-17T14:25:27.098 INFO:teuthology.orchestra.run.smithi134.stdout:(38/176): cephfs-top-19.0.0-1515.g6822c7b5.el9. 168 kB/s | 18 kB 00:00 2024-02-17T14:25:27.331 INFO:teuthology.orchestra.run.smithi134.stdout:(39/176): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 662 kB 00:00 2024-02-17T14:25:27.390 INFO:teuthology.orchestra.run.smithi134.stdout:(40/176): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 920 kB 00:00 2024-02-17T14:25:27.415 INFO:teuthology.orchestra.run.smithi134.stdout:(41/176): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 106 kB 00:00 2024-02-17T14:25:27.440 INFO:teuthology.orchestra.run.smithi134.stdout:(42/176): elfutils-libelf-devel-0.190-2.el9.x86 409 kB/s | 20 kB 00:00 2024-02-17T14:25:27.474 INFO:teuthology.orchestra.run.smithi134.stdout:(43/176): flex-2.6.4-9.el9.x86_64.rpm 5.1 MB/s | 307 kB 00:00 2024-02-17T14:25:27.500 INFO:teuthology.orchestra.run.smithi134.stdout:(44/176): flexiblas-3.0.4-8.el9.x86_64.rpm 538 kB/s | 32 kB 00:00 2024-02-17T14:25:27.583 INFO:teuthology.orchestra.run.smithi134.stdout:(45/176): flexiblas-openblas-openmp-3.0.4-8.el9 206 kB/s | 17 kB 00:00 2024-02-17T14:25:27.667 INFO:teuthology.orchestra.run.smithi134.stdout:(46/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-02-17T14:25:27.692 INFO:teuthology.orchestra.run.smithi134.stdout:(47/176): libaio-devel-0.3.111-13.el9.x86_64.rp 94 kB/s | 10 kB 00:00 2024-02-17T14:25:27.725 INFO:teuthology.orchestra.run.smithi134.stdout:(48/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-02-17T14:25:27.751 INFO:teuthology.orchestra.run.smithi134.stdout:(49/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 755 kB/s | 44 kB 00:00 2024-02-17T14:25:27.793 INFO:teuthology.orchestra.run.smithi134.stdout:(50/176): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2024-02-17T14:25:27.827 INFO:teuthology.orchestra.run.smithi134.stdout:(51/176): libtool-2.4.6-45.el9.x86_64.rpm 7.5 MB/s | 578 kB 00:00 2024-02-17T14:25:27.852 INFO:teuthology.orchestra.run.smithi134.stdout:(52/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-02-17T14:25:27.877 INFO:teuthology.orchestra.run.smithi134.stdout:(53/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 926 kB/s | 46 kB 00:00 2024-02-17T14:25:27.938 INFO:teuthology.orchestra.run.smithi134.stdout:(54/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.2 MB/s | 282 kB 00:00 2024-02-17T14:25:27.969 INFO:teuthology.orchestra.run.smithi134.stdout:(55/176): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2024-02-17T14:25:27.995 INFO:teuthology.orchestra.run.smithi134.stdout:(56/176): openblas-0.3.21-2.el9.x86_64.rpm 612 kB/s | 34 kB 00:00 2024-02-17T14:25:28.153 INFO:teuthology.orchestra.run.smithi134.stdout:(57/176): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-02-17T14:25:28.212 INFO:teuthology.orchestra.run.smithi134.stdout:(58/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2024-02-17T14:25:28.254 INFO:teuthology.orchestra.run.smithi134.stdout:(59/176): postgresql-13.11-1.el9.x86_64.rpm 16 MB/s | 1.5 MB 00:00 2024-02-17T14:25:28.288 INFO:teuthology.orchestra.run.smithi134.stdout:(60/176): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-02-17T14:25:28.313 INFO:teuthology.orchestra.run.smithi134.stdout:(61/176): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-02-17T14:25:28.522 INFO:teuthology.orchestra.run.smithi134.stdout:(62/176): postgresql-server-13.11-1.el9.x86_64. 24 MB/s | 5.7 MB 00:00 2024-02-17T14:25:28.555 INFO:teuthology.orchestra.run.smithi134.stdout:(63/176): protobuf-3.14.0-13.el9.x86_64.rpm 4.2 MB/s | 1.0 MB 00:00 2024-02-17T14:25:28.581 INFO:teuthology.orchestra.run.smithi134.stdout:(64/176): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-02-17T14:25:28.806 INFO:teuthology.orchestra.run.smithi134.stdout:(65/176): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2024-02-17T14:25:28.831 INFO:teuthology.orchestra.run.smithi134.stdout:(66/176): python3-jinja2-2.11.3-5.el9.noarch.rp 907 kB/s | 227 kB 00:00 2024-02-17T14:25:28.856 INFO:teuthology.orchestra.run.smithi134.stdout:(67/176): python3-jsonpatch-1.21-16.el9.noarch. 490 kB/s | 24 kB 00:00 2024-02-17T14:25:28.882 INFO:teuthology.orchestra.run.smithi134.stdout:(68/176): python3-jsonpointer-2.0-4.el9.noarch. 359 kB/s | 18 kB 00:00 2024-02-17T14:25:28.907 INFO:teuthology.orchestra.run.smithi134.stdout:(69/176): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-02-17T14:25:28.924 INFO:teuthology.orchestra.run.smithi134.stdout:(70/176): python3-markupsafe-1.1.1-12.el9.x86_6 755 kB/s | 32 kB 00:00 2024-02-17T14:25:29.108 INFO:teuthology.orchestra.run.smithi134.stdout:(71/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2024-02-17T14:25:29.133 INFO:teuthology.orchestra.run.smithi134.stdout:(72/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 217 kB 00:00 2024-02-17T14:25:29.167 INFO:teuthology.orchestra.run.smithi134.stdout:(73/176): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 174 kB 00:00 2024-02-17T14:25:29.192 INFO:teuthology.orchestra.run.smithi134.stdout:(74/176): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 69 kB 00:00 2024-02-17T14:25:29.217 INFO:teuthology.orchestra.run.smithi134.stdout:(75/176): python3-prettytable-0.7.2-27.el9.noar 820 kB/s | 41 kB 00:00 2024-02-17T14:25:29.251 INFO:teuthology.orchestra.run.smithi134.stdout:(76/176): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 238 kB 00:00 2024-02-17T14:25:29.284 INFO:teuthology.orchestra.run.smithi134.stdout:(77/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-02-17T14:25:29.318 INFO:teuthology.orchestra.run.smithi134.stdout:(78/176): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-02-17T14:25:29.351 INFO:teuthology.orchestra.run.smithi134.stdout:(79/176): python3-pytz-2021.1-5.el9.noarch.rpm 706 kB/s | 47 kB 00:00 2024-02-17T14:25:29.394 INFO:teuthology.orchestra.run.smithi134.stdout:(80/176): python3-requests-oauthlib-1.3.0-12.el 568 kB/s | 43 kB 00:00 2024-02-17T14:25:30.002 INFO:teuthology.orchestra.run.smithi134.stdout:(81/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-02-17T14:25:30.027 INFO:teuthology.orchestra.run.smithi134.stdout:(82/176): python3-toml-0.10.2-6.el9.noarch.rpm 61 kB/s | 39 kB 00:00 2024-02-17T14:25:30.078 INFO:teuthology.orchestra.run.smithi134.stdout:(83/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 820 kB/s | 41 kB 00:00 2024-02-17T14:25:30.103 INFO:teuthology.orchestra.run.smithi134.stdout:(84/176): qatlib-23.11.0-1.el9.x86_64.rpm 2.8 MB/s | 215 kB 00:00 2024-02-17T14:25:30.128 INFO:teuthology.orchestra.run.smithi134.stdout:(85/176): qatlib-service-23.11.0-1.el9.x86_64.r 677 kB/s | 34 kB 00:00 2024-02-17T14:25:30.153 INFO:teuthology.orchestra.run.smithi134.stdout:(86/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 869 kB/s | 43 kB 00:00 2024-02-17T14:25:30.196 INFO:teuthology.orchestra.run.smithi134.stdout:(87/176): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 300 kB 00:00 2024-02-17T14:25:30.221 INFO:teuthology.orchestra.run.smithi134.stdout:(88/176): uuid-1.6.2-55.el9.x86_64.rpm 838 kB/s | 56 kB 00:00 2024-02-17T14:25:30.246 INFO:teuthology.orchestra.run.smithi134.stdout:(89/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-02-17T14:25:30.272 INFO:teuthology.orchestra.run.smithi134.stdout:(90/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-02-17T14:25:30.297 INFO:teuthology.orchestra.run.smithi134.stdout:(91/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 878 kB/s | 44 kB 00:00 2024-02-17T14:25:30.322 INFO:teuthology.orchestra.run.smithi134.stdout:(92/176): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-02-17T14:25:30.347 INFO:teuthology.orchestra.run.smithi134.stdout:(93/176): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-02-17T14:25:30.414 INFO:teuthology.orchestra.run.smithi134.stdout:(94/176): libgfortran-11.4.1-3.el9.x86_64.rpm 8.5 MB/s | 802 kB 00:00 2024-02-17T14:25:30.440 INFO:teuthology.orchestra.run.smithi134.stdout:(95/176): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 194 kB 00:00 2024-02-17T14:25:30.482 INFO:teuthology.orchestra.run.smithi134.stdout:(96/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 217 kB 00:00 2024-02-17T14:25:30.507 INFO:teuthology.orchestra.run.smithi134.stdout:(97/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-02-17T14:25:30.566 INFO:teuthology.orchestra.run.smithi134.stdout:(98/176): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-02-17T14:25:30.591 INFO:teuthology.orchestra.run.smithi134.stdout:(99/176): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-02-17T14:25:30.616 INFO:teuthology.orchestra.run.smithi134.stdout:(100/176): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2024-02-17T14:25:30.641 INFO:teuthology.orchestra.run.smithi134.stdout:(101/176): python3-requests-2.25.1-8.el9.noarch 2.2 MB/s | 113 kB 00:00 2024-02-17T14:25:30.667 INFO:teuthology.orchestra.run.smithi134.stdout:(102/176): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-02-17T14:25:30.728 INFO:teuthology.orchestra.run.smithi134.stdout:(103/176): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2024-02-17T14:25:30.834 INFO:teuthology.orchestra.run.smithi134.stdout:(104/176): protobuf-compiler-3.14.0-13.el9.x86_ 7.8 MB/s | 863 kB 00:00 2024-02-17T14:25:31.168 INFO:teuthology.orchestra.run.smithi134.stdout:(105/176): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-02-17T14:25:31.226 INFO:teuthology.orchestra.run.smithi134.stdout:(106/176): python3-devel-3.9.17-2.el9.x86_64.rp 420 kB/s | 245 kB 00:00 2024-02-17T14:25:31.268 INFO:teuthology.orchestra.run.smithi134.stdout:(107/176): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-02-17T14:25:31.369 INFO:teuthology.orchestra.run.smithi134.stdout:(108/176): grpc-data-1.46.7-10.el9.noarch.rpm 137 kB/s | 19 kB 00:00 2024-02-17T14:25:31.602 INFO:teuthology.orchestra.run.smithi134.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 111 kB/s | 26 kB 00:00 2024-02-17T14:25:31.844 INFO:teuthology.orchestra.run.smithi134.stdout:(110/176): liboath-2.6.7-2.el9.x86_64.rpm 201 kB/s | 49 kB 00:00 2024-02-17T14:25:32.061 INFO:teuthology.orchestra.run.smithi134.stdout:(111/176): libunwind-1.6.2-1.el9.x86_64.rpm 311 kB/s | 67 kB 00:00 2024-02-17T14:25:32.311 INFO:teuthology.orchestra.run.smithi134.stdout:(112/176): libarrow-9.0.0-10.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-02-17T14:25:32.478 INFO:teuthology.orchestra.run.smithi134.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 362 kB/s | 151 kB 00:00 2024-02-17T14:25:32.645 INFO:teuthology.orchestra.run.smithi134.stdout:(114/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.5 MB/s | 838 kB 00:00 2024-02-17T14:25:32.712 INFO:teuthology.orchestra.run.smithi134.stdout:(115/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 653 kB/s | 43 kB 00:00 2024-02-17T14:25:32.771 INFO:teuthology.orchestra.run.smithi134.stdout:(116/176): python3-cachetools-4.2.4-1.el9.noarc 552 kB/s | 32 kB 00:00 2024-02-17T14:25:32.838 INFO:teuthology.orchestra.run.smithi134.stdout:(117/176): python3-certifi-2021.10.8-2.el9.noar 225 kB/s | 15 kB 00:00 2024-02-17T14:25:33.021 INFO:teuthology.orchestra.run.smithi134.stdout:(118/176): python3-cheroot-8.6.0-4.el9.noarch.r 938 kB/s | 172 kB 00:00 2024-02-17T14:25:33.072 INFO:teuthology.orchestra.run.smithi134.stdout:(119/176): python3-asyncssh-2.13.2-4.el9.noarch 923 kB/s | 548 kB 00:00 2024-02-17T14:25:33.122 INFO:teuthology.orchestra.run.smithi134.stdout:(120/176): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-02-17T14:25:33.456 INFO:teuthology.orchestra.run.smithi134.stdout:(121/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 790 kB/s | 303 kB 00:00 2024-02-17T14:25:33.481 INFO:teuthology.orchestra.run.smithi134.stdout:(122/176): python3-colorama-0.4.4-12.el9.noarch 98 kB/s | 35 kB 00:00 2024-02-17T14:25:33.623 INFO:teuthology.orchestra.run.smithi134.stdout:(123/176): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-02-17T14:25:33.648 INFO:teuthology.orchestra.run.smithi134.stdout:(124/176): python3-google-auth-2.27.0-1.el9.noa 1.0 MB/s | 203 kB 00:00 2024-02-17T14:25:33.690 INFO:teuthology.orchestra.run.smithi134.stdout:(125/176): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-02-17T14:25:33.774 INFO:teuthology.orchestra.run.smithi134.stdout:(126/176): python3-jaraco-classes-3.2.1-5.el9.n 212 kB/s | 18 kB 00:00 2024-02-17T14:25:33.866 INFO:teuthology.orchestra.run.smithi134.stdout:(127/176): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2024-02-17T14:25:33.933 INFO:teuthology.orchestra.run.smithi134.stdout:(128/176): python3-jaraco-8.2.1-3.el9.noarch.rp 38 kB/s | 11 kB 00:00 2024-02-17T14:25:33.958 INFO:teuthology.orchestra.run.smithi134.stdout:(129/176): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2024-02-17T14:25:34.008 INFO:teuthology.orchestra.run.smithi134.stdout:(130/176): python3-jaraco-text-3.2.0-6.el9.noar 262 kB/s | 20 kB 00:00 2024-02-17T14:25:34.059 INFO:teuthology.orchestra.run.smithi134.stdout:(131/176): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-02-17T14:25:34.084 INFO:teuthology.orchestra.run.smithi134.stdout:(132/176): python3-logutils-0.3.5-21.el9.noarch 614 kB/s | 46 kB 00:00 2024-02-17T14:25:34.117 INFO:teuthology.orchestra.run.smithi134.stdout:(133/176): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-02-17T14:25:34.143 INFO:teuthology.orchestra.run.smithi134.stdout:(134/176): python3-natsort-7.1.1-5.el9.noarch.r 986 kB/s | 58 kB 00:00 2024-02-17T14:25:34.176 INFO:teuthology.orchestra.run.smithi134.stdout:(135/176): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-02-17T14:25:34.204 INFO:teuthology.orchestra.run.smithi134.stdout:(136/176): python3-portend-3.1.0-2.el9.noarch.r 279 kB/s | 16 kB 00:00 2024-02-17T14:25:34.236 INFO:teuthology.orchestra.run.smithi134.stdout:(137/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-02-17T14:25:34.294 INFO:teuthology.orchestra.run.smithi134.stdout:(138/176): python3-repoze-lru-0.7-16.el9.noarch 529 kB/s | 31 kB 00:00 2024-02-17T14:25:34.353 INFO:teuthology.orchestra.run.smithi134.stdout:(139/176): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-02-17T14:25:34.411 INFO:teuthology.orchestra.run.smithi134.stdout:(140/176): python3-pyperclip-1.8.2-2.el9.noarch 135 kB/s | 28 kB 00:00 2024-02-17T14:25:34.437 INFO:teuthology.orchestra.run.smithi134.stdout:(141/176): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-02-17T14:25:34.479 INFO:teuthology.orchestra.run.smithi134.stdout:(142/176): python3-tempora-5.0.0-2.el9.noarch.r 535 kB/s | 36 kB 00:00 2024-02-17T14:25:34.504 INFO:teuthology.orchestra.run.smithi134.stdout:(143/176): python3-typing-extensions-4.4.0-2.el 760 kB/s | 51 kB 00:00 2024-02-17T14:25:34.596 INFO:teuthology.orchestra.run.smithi134.stdout:(144/176): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-02-17T14:25:34.621 INFO:teuthology.orchestra.run.smithi134.stdout:(145/176): python3-websocket-client-1.2.3-2.el9 768 kB/s | 90 kB 00:00 2024-02-17T14:25:34.688 INFO:teuthology.orchestra.run.smithi134.stdout:(146/176): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-02-17T14:25:34.722 INFO:teuthology.orchestra.run.smithi134.stdout:(147/176): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-02-17T14:25:34.847 INFO:teuthology.orchestra.run.smithi134.stdout:(148/176): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-02-17T14:25:34.972 INFO:teuthology.orchestra.run.smithi134.stdout:(149/176): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-02-17T14:25:35.164 INFO:teuthology.orchestra.run.smithi134.stdout:(150/176): librados2-19.0.0-1515.g6822c7b5.el9. 11 MB/s | 3.4 MB 00:00 2024-02-17T14:25:35.231 INFO:teuthology.orchestra.run.smithi134.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 68 kB 00:00 2024-02-17T14:25:35.315 INFO:teuthology.orchestra.run.smithi134.stdout:(152/176): librbd1-19.0.0-1515.g6822c7b5.el9.x8 9.1 MB/s | 3.1 MB 00:00 2024-02-17T14:25:35.382 INFO:teuthology.orchestra.run.smithi134.stdout:(153/176): NetworkManager-1.45.91-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-02-17T14:25:35.449 INFO:teuthology.orchestra.run.smithi134.stdout:(154/176): NetworkManager-libnm-1.45.91-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-02-17T14:25:35.474 INFO:teuthology.orchestra.run.smithi134.stdout:(155/176): NetworkManager-team-1.45.91-1.el9.x8 459 kB/s | 41 kB 00:00 2024-02-17T14:25:35.508 INFO:teuthology.orchestra.run.smithi134.stdout:(156/176): NetworkManager-tui-1.45.91-1.el9.x86 4.1 MB/s | 246 kB 00:00 2024-02-17T14:25:35.533 INFO:teuthology.orchestra.run.smithi134.stdout:(157/176): acl-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 69 kB 00:00 2024-02-17T14:25:35.558 INFO:teuthology.orchestra.run.smithi134.stdout:(158/176): elfutils-debuginfod-client-0.190-2.e 705 kB/s | 35 kB 00:00 2024-02-17T14:25:35.584 INFO:teuthology.orchestra.run.smithi134.stdout:(159/176): elfutils-libelf-0.190-2.el9.x86_64.r 3.7 MB/s | 191 kB 00:00 2024-02-17T14:25:35.609 INFO:teuthology.orchestra.run.smithi134.stdout:(160/176): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-02-17T14:25:35.659 INFO:teuthology.orchestra.run.smithi134.stdout:(161/176): iproute-6.7.0-2.el9.x86_64.rpm 10 MB/s | 802 kB 00:00 2024-02-17T14:25:35.684 INFO:teuthology.orchestra.run.smithi134.stdout:(162/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 5.7 MB/s | 433 kB 00:00 2024-02-17T14:25:35.710 INFO:teuthology.orchestra.run.smithi134.stdout:(163/176): libacl-2.3.1-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-02-17T14:25:35.745 INFO:teuthology.orchestra.run.smithi134.stdout:(164/176): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-02-17T14:25:35.753 INFO:teuthology.orchestra.run.smithi142.stdout:(8/176): ceph-radosgw-19.0.0-1515.g6822c7b5.el9 1.1 MB/s | 9.8 MB 00:08 2024-02-17T14:25:35.769 INFO:teuthology.orchestra.run.smithi134.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 154 kB 00:00 2024-02-17T14:25:35.802 INFO:teuthology.orchestra.run.smithi134.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 135 kB 00:00 2024-02-17T14:25:35.828 INFO:teuthology.orchestra.run.smithi134.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.0 MB/s | 63 kB 00:00 2024-02-17T14:25:35.845 INFO:teuthology.orchestra.run.smithi142.stdout:(9/176): ceph-selinux-19.0.0-1515.g6822c7b5.el9 275 kB/s | 25 kB 00:00 2024-02-17T14:25:35.861 INFO:teuthology.orchestra.run.smithi134.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 471 kB/s | 28 kB 00:00 2024-02-17T14:25:35.920 INFO:teuthology.orchestra.run.smithi134.stdout:(169/176): openssl-3.0.7-25.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2024-02-17T14:25:36.020 INFO:teuthology.orchestra.run.smithi134.stdout:(170/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 14 MB/s | 2.1 MB 00:00 2024-02-17T14:25:36.079 INFO:teuthology.orchestra.run.smithi134.stdout:(171/176): util-linux-2.37.4-18.el9.x86_64.rpm 14 MB/s | 2.2 MB 00:00 2024-02-17T14:25:36.133 INFO:teuthology.orchestra.run.smithi134.stdout:(172/176): util-linux-core-2.37.4-18.el9.x86_64 3.9 MB/s | 438 kB 00:00 2024-02-17T14:25:36.163 INFO:teuthology.orchestra.run.smithi134.stdout:(173/176): util-linux-user-2.37.4-18.el9.x86_64 362 kB/s | 30 kB 00:00 2024-02-17T14:25:36.197 INFO:teuthology.orchestra.run.smithi134.stdout:(174/176): xfsdump-3.1.12-4.el9.x86_64.rpm 5.0 MB/s | 321 kB 00:00 2024-02-17T14:25:36.256 INFO:teuthology.orchestra.run.smithi134.stdout:(175/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-02-17T14:25:36.853 INFO:teuthology.orchestra.run.smithi142.stdout:(10/176): ceph-osd-19.0.0-1515.g6822c7b5.el9.x8 1.1 MB/s | 17 MB 00:15 2024-02-17T14:25:37.045 INFO:teuthology.orchestra.run.smithi142.stdout:(11/176): cephfs-mirror-19.0.0-1515.g6822c7b5.e 1.1 MB/s | 217 kB 00:00 2024-02-17T14:25:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:(12/176): cephfs-shell-19.0.0-1515.g6822c7b5.el 302 kB/s | 27 kB 00:00 2024-02-17T14:25:37.237 INFO:teuthology.orchestra.run.smithi142.stdout:(13/176): libcephfs-devel-19.0.0-1515.g6822c7b5 305 kB/s | 31 kB 00:00 2024-02-17T14:25:37.788 INFO:teuthology.orchestra.run.smithi142.stdout:(14/176): libcephfs2-19.0.0-1515.g6822c7b5.el9. 1.3 MB/s | 743 kB 00:00 2024-02-17T14:25:37.921 INFO:teuthology.orchestra.run.smithi142.stdout:(15/176): libcephsqlite-19.0.0-1515.g6822c7b5.e 1.2 MB/s | 163 kB 00:00 2024-02-17T14:25:38.047 INFO:teuthology.orchestra.run.smithi142.stdout:(16/176): librados-devel-19.0.0-1515.g6822c7b5. 1.0 MB/s | 127 kB 00:00 2024-02-17T14:25:38.239 INFO:teuthology.orchestra.run.smithi142.stdout:(17/176): ceph-common-19.0.0-1515.g6822c7b5.el9 940 kB/s | 20 MB 00:21 2024-02-17T14:25:38.547 INFO:teuthology.orchestra.run.smithi142.stdout:(18/176): libradosstriper1-19.0.0-1515.g6822c7b 997 kB/s | 499 kB 00:00 2024-02-17T14:25:38.622 INFO:teuthology.orchestra.run.smithi142.stdout:(19/176): python3-ceph-argparse-19.0.0-1515.g68 604 kB/s | 45 kB 00:00 2024-02-17T14:25:38.756 INFO:teuthology.orchestra.run.smithi142.stdout:(20/176): python3-ceph-common-19.0.0-1515.g6822 986 kB/s | 131 kB 00:00 2024-02-17T14:25:38.898 INFO:teuthology.orchestra.run.smithi142.stdout:(21/176): python3-cephfs-19.0.0-1515.g6822c7b5. 1.1 MB/s | 162 kB 00:00 2024-02-17T14:25:39.156 INFO:teuthology.orchestra.run.smithi142.stdout:(22/176): python3-rados-19.0.0-1515.g6822c7b5.e 1.2 MB/s | 321 kB 00:00 2024-02-17T14:25:39.373 INFO:teuthology.orchestra.run.smithi142.stdout:(23/176): python3-rbd-19.0.0-1515.g6822c7b5.el9 1.3 MB/s | 298 kB 00:00 2024-02-17T14:25:39.457 INFO:teuthology.orchestra.run.smithi142.stdout:(24/176): python3-rgw-19.0.0-1515.g6822c7b5.el9 1.2 MB/s | 99 kB 00:00 2024-02-17T14:25:39.541 INFO:teuthology.orchestra.run.smithi142.stdout:(25/176): rbd-fuse-19.0.0-1515.g6822c7b5.el9.x8 1.0 MB/s | 85 kB 00:00 2024-02-17T14:25:41.782 INFO:teuthology.orchestra.run.smithi142.stdout:(26/176): librgw2-19.0.0-1515.g6822c7b5.el9.x86 1.4 MB/s | 5.1 MB 00:03 2024-02-17T14:25:41.832 INFO:teuthology.orchestra.run.smithi142.stdout:(27/176): rbd-mirror-19.0.0-1515.g6822c7b5.el9. 1.3 MB/s | 3.1 MB 00:02 2024-02-17T14:25:41.847 INFO:teuthology.orchestra.run.smithi134.stdout:(176/176): ceph-common-19.0.0-1515.g6822c7b5.el 971 kB/s | 20 MB 00:20 2024-02-17T14:25:41.852 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-02-17T14:25:41.852 INFO:teuthology.orchestra.run.smithi134.stdout:Total 10 MB/s | 223 MB 00:21 2024-02-17T14:25:41.902 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-02-17T14:25:41.916 INFO:teuthology.orchestra.run.smithi142.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1515.g 378 kB/s | 31 kB 00:00 2024-02-17T14:25:41.966 INFO:teuthology.orchestra.run.smithi142.stdout:(29/176): rbd-nbd-19.0.0-1515.g6822c7b5.el9.x86 930 kB/s | 171 kB 00:00 2024-02-17T14:25:42.042 INFO:teuthology.orchestra.run.smithi142.stdout:(30/176): ceph-mgr-cephadm-19.0.0-1515.g6822c7b 1.1 MB/s | 138 kB 00:00 2024-02-17T14:25:42.206 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-02-17T14:25:42.207 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-02-17T14:25:43.742 INFO:teuthology.orchestra.run.smithi142.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1515.g6822c 1.0 MB/s | 1.8 MB 00:01 2024-02-17T14:25:44.020 INFO:teuthology.orchestra.run.smithi142.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1515.g68 901 kB/s | 247 kB 00:00 2024-02-17T14:25:44.092 INFO:teuthology.orchestra.run.smithi142.stdout:(33/176): ceph-mgr-rook-19.0.0-1515.g6822c7b5.e 697 kB/s | 52 kB 00:00 2024-02-17T14:25:44.163 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-02-17T14:25:44.164 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-02-17T14:25:44.167 INFO:teuthology.orchestra.run.smithi142.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1515.g6 204 kB/s | 15 kB 00:00 2024-02-17T14:25:44.476 INFO:teuthology.orchestra.run.smithi142.stdout:(35/176): ceph-volume-19.0.0-1515.g6822c7b5.el9 856 kB/s | 264 kB 00:00 2024-02-17T14:25:45.226 INFO:teuthology.orchestra.run.smithi142.stdout:(36/176): cephadm-19.0.0-1515.g6822c7b5.el9.noa 998 kB/s | 748 kB 00:00 2024-02-17T14:25:45.327 INFO:teuthology.orchestra.run.smithi142.stdout:(37/176): cephfs-top-19.0.0-1515.g6822c7b5.el9. 182 kB/s | 18 kB 00:00 2024-02-17T14:25:45.827 INFO:teuthology.orchestra.run.smithi142.stdout:(38/176): automake-1.16.2-8.el9.noarch.rpm 1.3 MB/s | 662 kB 00:00 2024-02-17T14:25:46.086 INFO:teuthology.orchestra.run.smithi142.stdout:(39/176): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 920 kB 00:00 2024-02-17T14:25:46.344 INFO:teuthology.orchestra.run.smithi142.stdout:(40/176): boost-program-options-1.75.0-8.el9.x8 410 kB/s | 106 kB 00:00 2024-02-17T14:25:46.428 INFO:teuthology.orchestra.run.smithi142.stdout:(41/176): elfutils-libelf-devel-0.190-2.el9.x86 245 kB/s | 20 kB 00:00 2024-02-17T14:25:46.495 INFO:teuthology.orchestra.run.smithi142.stdout:(42/176): flex-2.6.4-9.el9.x86_64.rpm 4.5 MB/s | 307 kB 00:00 2024-02-17T14:25:46.553 INFO:teuthology.orchestra.run.smithi142.stdout:(43/176): flexiblas-3.0.4-8.el9.x86_64.rpm 542 kB/s | 32 kB 00:00 2024-02-17T14:25:46.995 INFO:teuthology.orchestra.run.smithi142.stdout:(44/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.8 MB/s | 3.0 MB 00:00 2024-02-17T14:25:47.062 INFO:teuthology.orchestra.run.smithi142.stdout:(45/176): flexiblas-openblas-openmp-3.0.4-8.el9 258 kB/s | 17 kB 00:00 2024-02-17T14:25:47.137 INFO:teuthology.orchestra.run.smithi142.stdout:(46/176): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 10 kB 00:00 2024-02-17T14:25:47.221 INFO:teuthology.orchestra.run.smithi142.stdout:(47/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 159 kB 00:00 2024-02-17T14:25:47.288 INFO:teuthology.orchestra.run.smithi142.stdout:(48/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 662 kB/s | 44 kB 00:00 2024-02-17T14:25:47.388 INFO:teuthology.orchestra.run.smithi142.stdout:(49/176): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 661 kB 00:00 2024-02-17T14:25:47.472 INFO:teuthology.orchestra.run.smithi142.stdout:(50/176): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 578 kB 00:00 2024-02-17T14:25:47.522 INFO:teuthology.orchestra.run.smithi142.stdout:(51/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 488 kB/s | 24 kB 00:00 2024-02-17T14:25:47.564 INFO:teuthology.orchestra.run.smithi142.stdout:(52/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-02-17T14:25:47.631 INFO:teuthology.orchestra.run.smithi142.stdout:(53/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.1 MB/s | 282 kB 00:00 2024-02-17T14:25:47.681 INFO:teuthology.orchestra.run.smithi142.stdout:(54/176): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-02-17T14:25:47.715 INFO:teuthology.orchestra.run.smithi142.stdout:(55/176): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-02-17T14:25:47.957 INFO:teuthology.orchestra.run.smithi142.stdout:(56/176): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-02-17T14:25:48.124 INFO:teuthology.orchestra.run.smithi142.stdout:(57/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 18 MB/s | 3.0 MB 00:00 2024-02-17T14:25:48.224 INFO:teuthology.orchestra.run.smithi142.stdout:(58/176): postgresql-13.11-1.el9.x86_64.rpm 15 MB/s | 1.5 MB 00:00 2024-02-17T14:25:48.300 INFO:teuthology.orchestra.run.smithi142.stdout:(59/176): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-02-17T14:25:48.358 INFO:teuthology.orchestra.run.smithi142.stdout:(60/176): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2024-02-17T14:25:48.592 INFO:teuthology.orchestra.run.smithi142.stdout:(61/176): postgresql-server-13.11-1.el9.x86_64. 24 MB/s | 5.7 MB 00:00 2024-02-17T14:25:48.684 INFO:teuthology.orchestra.run.smithi142.stdout:(62/176): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-02-17T14:25:48.743 INFO:teuthology.orchestra.run.smithi142.stdout:(63/176): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-02-17T14:25:48.993 INFO:teuthology.orchestra.run.smithi142.stdout:(64/176): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2024-02-17T14:25:49.035 INFO:teuthology.orchestra.run.smithi142.stdout:(65/176): python3-jinja2-2.11.3-5.el9.noarch.rp 5.3 MB/s | 227 kB 00:00 2024-02-17T14:25:49.077 INFO:teuthology.orchestra.run.smithi142.stdout:(66/176): python3-jsonpatch-1.21-16.el9.noarch. 584 kB/s | 24 kB 00:00 2024-02-17T14:25:49.111 INFO:teuthology.orchestra.run.smithi142.stdout:(67/176): python3-jsonpointer-2.0-4.el9.noarch. 545 kB/s | 18 kB 00:00 2024-02-17T14:25:49.177 INFO:teuthology.orchestra.run.smithi142.stdout:(68/176): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2024-02-17T14:25:49.280 INFO:teuthology.orchestra.run.smithi142.stdout:(69/176): python3-markupsafe-1.1.1-12.el9.x86_6 308 kB/s | 32 kB 00:00 2024-02-17T14:25:49.437 INFO:teuthology.orchestra.run.smithi142.stdout:(70/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 4.8 MB 00:00 2024-02-17T14:25:49.487 INFO:teuthology.orchestra.run.smithi142.stdout:(71/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 217 kB 00:00 2024-02-17T14:25:49.529 INFO:teuthology.orchestra.run.smithi142.stdout:(72/176): python3-oauthlib-3.1.1-5.el9.noarch.r 4.1 MB/s | 174 kB 00:00 2024-02-17T14:25:49.571 INFO:teuthology.orchestra.run.smithi142.stdout:(73/176): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 69 kB 00:00 2024-02-17T14:25:49.605 INFO:teuthology.orchestra.run.smithi142.stdout:(74/176): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-02-17T14:25:49.646 INFO:teuthology.orchestra.run.smithi142.stdout:(75/176): python3-protobuf-3.14.0-13.el9.noarch 5.6 MB/s | 238 kB 00:00 2024-02-17T14:25:49.680 INFO:teuthology.orchestra.run.smithi142.stdout:(76/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2024-02-17T14:25:49.722 INFO:teuthology.orchestra.run.smithi142.stdout:(77/176): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2024-02-17T14:25:49.756 INFO:teuthology.orchestra.run.smithi142.stdout:(78/176): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-02-17T14:25:49.789 INFO:teuthology.orchestra.run.smithi142.stdout:(79/176): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2024-02-17T14:25:50.298 INFO:teuthology.orchestra.run.smithi142.stdout:(80/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-02-17T14:25:50.340 INFO:teuthology.orchestra.run.smithi142.stdout:(81/176): python3-toml-0.10.2-6.el9.noarch.rpm 929 kB/s | 39 kB 00:00 2024-02-17T14:25:50.390 INFO:teuthology.orchestra.run.smithi142.stdout:(82/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 821 kB/s | 41 kB 00:00 2024-02-17T14:25:50.440 INFO:teuthology.orchestra.run.smithi142.stdout:(83/176): qatlib-23.11.0-1.el9.x86_64.rpm 4.2 MB/s | 215 kB 00:00 2024-02-17T14:25:50.491 INFO:teuthology.orchestra.run.smithi142.stdout:(84/176): qatlib-service-23.11.0-1.el9.x86_64.r 675 kB/s | 34 kB 00:00 2024-02-17T14:25:50.541 INFO:teuthology.orchestra.run.smithi142.stdout:(85/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 867 kB/s | 43 kB 00:00 2024-02-17T14:25:50.591 INFO:teuthology.orchestra.run.smithi142.stdout:(86/176): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2024-02-17T14:25:50.633 INFO:teuthology.orchestra.run.smithi142.stdout:(87/176): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2024-02-17T14:25:50.675 INFO:teuthology.orchestra.run.smithi142.stdout:(88/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2024-02-17T14:25:50.717 INFO:teuthology.orchestra.run.smithi142.stdout:(89/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-02-17T14:25:50.761 INFO:teuthology.orchestra.run.smithi142.stdout:(90/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-02-17T14:25:50.812 INFO:teuthology.orchestra.run.smithi142.stdout:(91/176): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-02-17T14:25:50.879 INFO:teuthology.orchestra.run.smithi142.stdout:(92/176): jq-1.6-16.el9.x86_64.rpm 2.7 MB/s | 186 kB 00:00 2024-02-17T14:25:50.962 INFO:teuthology.orchestra.run.smithi142.stdout:(93/176): libgfortran-11.4.1-3.el9.x86_64.rpm 9.4 MB/s | 802 kB 00:00 2024-02-17T14:25:51.046 INFO:teuthology.orchestra.run.smithi142.stdout:(94/176): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 194 kB 00:00 2024-02-17T14:25:51.096 INFO:teuthology.orchestra.run.smithi142.stdout:(95/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-02-17T14:25:51.158 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-02-17T14:25:51.163 INFO:teuthology.orchestra.run.smithi142.stdout:(96/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-02-17T14:25:51.255 INFO:teuthology.orchestra.run.smithi142.stdout:(97/176): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2024-02-17T14:25:51.256 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-17T14:25:51.314 INFO:teuthology.orchestra.run.smithi142.stdout:(98/176): python3-ply-3.11-14.el9.noarch.rpm 1.7 MB/s | 103 kB 00:00 2024-02-17T14:25:51.372 INFO:teuthology.orchestra.run.smithi142.stdout:(99/176): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 124 kB 00:00 2024-02-17T14:25:51.416 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-17T14:25:51.464 INFO:teuthology.orchestra.run.smithi142.stdout:(100/176): ceph-mgr-diskprediction-local-19.0.0 802 kB/s | 7.4 MB 00:09 2024-02-17T14:25:51.490 INFO:teuthology.orchestra.run.smithi142.stdout:(101/176): python3-requests-2.25.1-8.el9.noarch 968 kB/s | 113 kB 00:00 2024-02-17T14:25:51.523 INFO:teuthology.orchestra.run.smithi142.stdout:(102/176): python3-urllib3-1.26.5-5.el9.noarch. 3.1 MB/s | 187 kB 00:00 2024-02-17T14:25:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-17T14:25:51.566 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-17T14:25:51.573 INFO:teuthology.orchestra.run.smithi142.stdout:(103/176): lua-devel-5.4.4-4.el9.x86_64.rpm 447 kB/s | 22 kB 00:00 2024-02-17T14:25:51.612 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-17T14:25:51.650 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-17T14:25:51.674 INFO:teuthology.orchestra.run.smithi142.stdout:(104/176): protobuf-compiler-3.14.0-13.el9.x86_ 8.4 MB/s | 863 kB 00:00 2024-02-17T14:25:51.713 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-17T14:25:51.755 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-17T14:25:51.780 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-17T14:25:51.831 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-17T14:25:52.158 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-17T14:25:52.208 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 11/202 2024-02-17T14:25:52.241 INFO:teuthology.orchestra.run.smithi142.stdout:(105/176): abseil-cpp-20211102.0-3.el9.x86_64.r 967 kB/s | 548 kB 00:00 2024-02-17T14:25:52.333 INFO:teuthology.orchestra.run.smithi142.stdout:(106/176): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-02-17T14:25:52.344 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 11/202 2024-02-17T14:25:52.376 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 12/202 2024-02-17T14:25:52.408 INFO:teuthology.orchestra.run.smithi142.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 259 kB/s | 19 kB 00:00 2024-02-17T14:25:52.467 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 12/202 2024-02-17T14:25:52.544 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.0.0-1515.g6822c7b5.el9.x86_64 13/202 2024-02-17T14:25:52.575 INFO:teuthology.orchestra.run.smithi142.stdout:(108/176): python3-devel-3.9.17-2.el9.x86_64.rp 226 kB/s | 245 kB 00:01 2024-02-17T14:25:52.697 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-17T14:25:52.752 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-17T14:25:52.780 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 16/202 2024-02-17T14:25:52.859 INFO:teuthology.orchestra.run.smithi142.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 92 kB/s | 26 kB 00:00 2024-02-17T14:25:52.891 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 16/202 2024-02-17T14:25:52.915 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86 17/202 2024-02-17T14:25:52.980 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86 17/202 2024-02-17T14:25:52.984 INFO:teuthology.orchestra.run.smithi142.stdout:(110/176): liboath-2.6.7-2.el9.x86_64.rpm 389 kB/s | 49 kB 00:00 2024-02-17T14:25:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-17T14:25:53.051 INFO:teuthology.orchestra.run.smithi142.stdout:(111/176): libarrow-9.0.0-10.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2024-02-17T14:25:53.058 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-17T14:25:53.073 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-17T14:25:53.076 INFO:teuthology.orchestra.run.smithi142.stdout:(112/176): libunwind-1.6.2-1.el9.x86_64.rpm 734 kB/s | 67 kB 00:00 2024-02-17T14:25:53.126 INFO:teuthology.orchestra.run.smithi142.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-02-17T14:25:53.218 INFO:teuthology.orchestra.run.smithi142.stdout:(114/176): python3-asyncssh-2.13.2-4.el9.noarch 5.9 MB/s | 548 kB 00:00 2024-02-17T14:25:53.268 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-17T14:25:53.293 INFO:teuthology.orchestra.run.smithi142.stdout:(115/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.8 MB/s | 838 kB 00:00 2024-02-17T14:25:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-17T14:25:53.310 INFO:teuthology.orchestra.run.smithi142.stdout:(116/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 472 kB/s | 43 kB 00:00 2024-02-17T14:25:53.329 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-17T14:25:53.353 INFO:teuthology.orchestra.run.smithi142.stdout:(117/176): python3-cachetools-4.2.4-1.el9.noarc 547 kB/s | 32 kB 00:00 2024-02-17T14:25:53.370 INFO:teuthology.orchestra.run.smithi142.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 255 kB/s | 15 kB 00:00 2024-02-17T14:25:53.420 INFO:teuthology.orchestra.run.smithi142.stdout:(119/176): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-02-17T14:25:53.454 INFO:teuthology.orchestra.run.smithi142.stdout:(120/176): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-02-17T14:25:53.500 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-17T14:25:53.504 INFO:teuthology.orchestra.run.smithi142.stdout:(121/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-02-17T14:25:53.529 INFO:teuthology.orchestra.run.smithi142.stdout:(122/176): python3-colorama-0.4.4-12.el9.noarch 469 kB/s | 35 kB 00:00 2024-02-17T14:25:53.596 INFO:teuthology.orchestra.run.smithi142.stdout:(123/176): python3-google-auth-2.27.0-1.el9.noa 2.2 MB/s | 203 kB 00:00 2024-02-17T14:25:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-17T14:25:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-17T14:25:53.688 INFO:teuthology.orchestra.run.smithi142.stdout:(124/176): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-02-17T14:25:53.759 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-17T14:25:53.780 INFO:teuthology.orchestra.run.smithi142.stdout:(125/176): python3-jaraco-8.2.1-3.el9.noarch.rp 117 kB/s | 11 kB 00:00 2024-02-17T14:25:53.814 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-17T14:25:53.855 INFO:teuthology.orchestra.run.smithi142.stdout:(126/176): python3-grpcio-1.46.7-10.el9.x86_64. 6.3 MB/s | 2.0 MB 00:00 2024-02-17T14:25:53.880 INFO:teuthology.orchestra.run.smithi142.stdout:(127/176): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-02-17T14:25:53.931 INFO:teuthology.orchestra.run.smithi142.stdout:(128/176): python3-jaraco-collections-3.0.0-8.e 308 kB/s | 23 kB 00:00 2024-02-17T14:25:53.983 INFO:teuthology.orchestra.run.smithi142.stdout:(129/176): python3-jaraco-functools-3.5.0-2.el9 190 kB/s | 19 kB 00:00 2024-02-17T14:25:54.015 INFO:teuthology.orchestra.run.smithi142.stdout:(130/176): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-02-17T14:25:54.036 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-17T14:25:54.115 INFO:teuthology.orchestra.run.smithi142.stdout:(131/176): python3-logutils-0.3.5-21.el9.noarch 464 kB/s | 46 kB 00:00 2024-02-17T14:25:54.144 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-17T14:25:54.207 INFO:teuthology.orchestra.run.smithi142.stdout:(132/176): python3-more-itertools-8.12.0-2.el9. 860 kB/s | 79 kB 00:00 2024-02-17T14:25:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-17T14:25:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-17T14:25:54.282 INFO:teuthology.orchestra.run.smithi142.stdout:(133/176): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-02-17T14:25:54.308 INFO:teuthology.orchestra.run.smithi142.stdout:(134/176): python3-natsort-7.1.1-5.el9.noarch.r 575 kB/s | 58 kB 00:00 2024-02-17T14:25:54.335 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-17T14:25:54.382 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-17T14:25:54.408 INFO:teuthology.orchestra.run.smithi142.stdout:(135/176): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-02-17T14:25:54.423 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-17T14:25:54.433 INFO:teuthology.orchestra.run.smithi142.stdout:(136/176): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-02-17T14:25:54.458 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-17T14:25:54.492 INFO:teuthology.orchestra.run.smithi142.stdout:(137/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-02-17T14:25:54.498 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-17T14:25:54.534 INFO:teuthology.orchestra.run.smithi142.stdout:(138/176): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-02-17T14:25:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-17T14:25:54.584 INFO:teuthology.orchestra.run.smithi142.stdout:(139/176): python3-repoze-lru-0.7-16.el9.noarch 335 kB/s | 31 kB 00:00 2024-02-17T14:25:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-17T14:25:54.626 INFO:teuthology.orchestra.run.smithi142.stdout:(140/176): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-02-17T14:25:54.640 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-17T14:25:54.660 INFO:teuthology.orchestra.run.smithi142.stdout:(141/176): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-02-17T14:25:54.672 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-17T14:25:54.700 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-17T14:25:54.701 INFO:teuthology.orchestra.run.smithi142.stdout:(142/176): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2024-02-17T14:25:54.743 INFO:teuthology.orchestra.run.smithi142.stdout:(143/176): python3-typing-extensions-4.4.0-2.el 611 kB/s | 51 kB 00:00 2024-02-17T14:25:54.768 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-17T14:25:54.785 INFO:teuthology.orchestra.run.smithi142.stdout:(144/176): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-02-17T14:25:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.0.0-1515.g6822c7b5.el9. 39/202 2024-02-17T14:25:54.844 INFO:teuthology.orchestra.run.smithi142.stdout:(145/176): python3-websocket-client-1.2.3-2.el9 895 kB/s | 90 kB 00:00 2024-02-17T14:25:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.0.0-1515.g6822c7b5.el 40/202 2024-02-17T14:25:54.877 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.0.0-1515.g6822c7b5.el9.x86_6 41/202 2024-02-17T14:25:54.920 INFO:teuthology.orchestra.run.smithi142.stdout:(146/176): python3-zc-lockfile-2.0-10.el9.noarc 266 kB/s | 20 kB 00:00 2024-02-17T14:25:54.945 INFO:teuthology.orchestra.run.smithi142.stdout:(147/176): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-02-17T14:25:54.946 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-17T14:25:54.992 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-17T14:25:54.995 INFO:teuthology.orchestra.run.smithi142.stdout:(148/176): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-02-17T14:25:55.064 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-17T14:25:55.197 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-17T14:25:55.245 INFO:teuthology.orchestra.run.smithi142.stdout:(149/176): thrift-0.15.0-2.el9.x86_64.rpm 5.3 MB/s | 1.6 MB 00:00 2024-02-17T14:25:55.251 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-17T14:25:55.757 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-17T14:25:55.829 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-17T14:25:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-17T14:25:55.967 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-17T14:25:55.995 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-17T14:25:56.039 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-17T14:25:56.085 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.0.0-1515.g6822c7b5.el9.x86_6 52/202 2024-02-17T14:25:56.118 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-17T14:25:56.209 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-17T14:25:56.285 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-17T14:25:56.572 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-17T14:25:56.774 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-17T14:25:56.844 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-17T14:25:56.888 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-17T14:25:56.996 INFO:teuthology.orchestra.run.smithi142.stdout:(150/176): librados2-19.0.0-1515.g6822c7b5.el9. 1.7 MB/s | 3.4 MB 00:01 2024-02-17T14:25:57.030 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-17T14:25:57.062 INFO:teuthology.orchestra.run.smithi142.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 68 kB 00:00 2024-02-17T14:25:57.074 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-17T14:25:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-17T14:25:57.201 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-17T14:25:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-17T14:25:57.263 INFO:teuthology.orchestra.run.smithi142.stdout:(152/176): NetworkManager-1.45.91-1.el9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-02-17T14:25:57.269 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-17T14:25:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-17T14:25:57.330 INFO:teuthology.orchestra.run.smithi142.stdout:(153/176): librbd1-19.0.0-1515.g6822c7b5.el9.x8 1.5 MB/s | 3.1 MB 00:02 2024-02-17T14:25:57.352 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-17T14:25:57.395 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-17T14:25:57.438 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-17T14:25:57.497 INFO:teuthology.orchestra.run.smithi142.stdout:(154/176): NetworkManager-libnm-1.45.91-1.el9.x 7.7 MB/s | 1.8 MB 00:00 2024-02-17T14:25:57.514 INFO:teuthology.orchestra.run.smithi142.stdout:(155/176): NetworkManager-team-1.45.91-1.el9.x8 226 kB/s | 41 kB 00:00 2024-02-17T14:25:57.555 INFO:teuthology.orchestra.run.smithi142.stdout:(156/176): NetworkManager-tui-1.45.91-1.el9.x86 4.1 MB/s | 246 kB 00:00 2024-02-17T14:25:57.567 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-17T14:25:57.581 INFO:teuthology.orchestra.run.smithi142.stdout:(157/176): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2024-02-17T14:25:57.606 INFO:teuthology.orchestra.run.smithi142.stdout:(158/176): elfutils-debuginfod-client-0.190-2.e 706 kB/s | 35 kB 00:00 2024-02-17T14:25:57.609 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-17T14:25:57.631 INFO:teuthology.orchestra.run.smithi142.stdout:(159/176): elfutils-libelf-0.190-2.el9.x86_64.r 3.7 MB/s | 191 kB 00:00 2024-02-17T14:25:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-17T14:25:57.656 INFO:teuthology.orchestra.run.smithi142.stdout:(160/176): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-02-17T14:25:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-17T14:25:57.715 INFO:teuthology.orchestra.run.smithi142.stdout:(161/176): iproute-6.7.0-2.el9.x86_64.rpm 9.4 MB/s | 802 kB 00:00 2024-02-17T14:25:57.741 INFO:teuthology.orchestra.run.smithi142.stdout:(162/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 5.1 MB/s | 433 kB 00:00 2024-02-17T14:25:57.766 INFO:teuthology.orchestra.run.smithi142.stdout:(163/176): libacl-2.3.1-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-02-17T14:25:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-17T14:25:57.791 INFO:teuthology.orchestra.run.smithi142.stdout:(164/176): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-02-17T14:25:57.816 INFO:teuthology.orchestra.run.smithi142.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 154 kB 00:00 2024-02-17T14:25:57.823 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-17T14:25:57.842 INFO:teuthology.orchestra.run.smithi142.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-02-17T14:25:57.863 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-17T14:25:57.867 INFO:teuthology.orchestra.run.smithi142.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 63 kB 00:00 2024-02-17T14:25:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-17T14:25:57.892 INFO:teuthology.orchestra.run.smithi142.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 551 kB/s | 28 kB 00:00 2024-02-17T14:25:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-17T14:25:57.984 INFO:teuthology.orchestra.run.smithi142.stdout:(169/176): openssl-3.0.7-25.el9.x86_64.rpm 9.9 MB/s | 1.2 MB 00:00 2024-02-17T14:25:57.990 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-17T14:25:58.101 INFO:teuthology.orchestra.run.smithi142.stdout:(170/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 10 MB/s | 2.1 MB 00:00 2024-02-17T14:25:58.111 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-17T14:25:58.185 INFO:teuthology.orchestra.run.smithi142.stdout:(171/176): util-linux-2.37.4-18.el9.x86_64.rpm 11 MB/s | 2.2 MB 00:00 2024-02-17T14:25:58.210 INFO:teuthology.orchestra.run.smithi142.stdout:(172/176): util-linux-core-2.37.4-18.el9.x86_64 4.0 MB/s | 438 kB 00:00 2024-02-17T14:25:58.211 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-17T14:25:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:(173/176): util-linux-user-2.37.4-18.el9.x86_64 735 kB/s | 30 kB 00:00 2024-02-17T14:25:58.253 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-17T14:25:58.269 INFO:teuthology.orchestra.run.smithi142.stdout:(174/176): xfsdump-3.1.12-4.el9.x86_64.rpm 5.3 MB/s | 321 kB 00:00 2024-02-17T14:25:58.302 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-17T14:25:58.311 INFO:teuthology.orchestra.run.smithi142.stdout:(175/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-02-17T14:25:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-17T14:25:58.540 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-17T14:25:58.583 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-17T14:25:58.707 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-17T14:25:58.748 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-02-17T14:25:58.781 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-17T14:25:58.812 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-17T14:25:58.847 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-17T14:25:58.878 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-17T14:25:58.906 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-17T14:25:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-17T14:25:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-17T14:25:59.020 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-17T14:25:59.058 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-17T14:25:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-17T14:25:59.168 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-17T14:25:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-17T14:25:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-17T14:25:59.278 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-17T14:25:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-17T14:25:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-17T14:25:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-17T14:25:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-17T14:25:59.569 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-17T14:25:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-17T14:25:59.732 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-17T14:26:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-17T14:26:00.504 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-17T14:26:00.538 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-17T14:26:00.586 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-17T14:26:00.681 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-17T14:26:00.720 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-17T14:26:00.897 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-17T14:26:00.926 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-17T14:26:00.995 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-17T14:26:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-17T14:26:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-17T14:26:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-17T14:26:03.020 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-17T14:26:03.047 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-17T14:26:03.356 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-17T14:26:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 125/202 2024-02-17T14:26:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 125/202 2024-02-17T14:26:03.498 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 126/202 2024-02-17T14:26:03.543 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-17T14:26:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-17T14:26:04.063 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 129/202 2024-02-17T14:26:04.134 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 129/202 2024-02-17T14:26:04.165 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 130/202 2024-02-17T14:26:04.211 INFO:teuthology.orchestra.run.smithi142.stdout:(176/176): ceph-test-19.0.0-1515.g6822c7b5.el9. 1.7 MB/s | 47 MB 00:28 2024-02-17T14:26:04.217 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-17T14:26:04.217 INFO:teuthology.orchestra.run.smithi142.stdout:Total 4.6 MB/s | 223 MB 00:48 2024-02-17T14:26:04.264 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-17T14:26:04.564 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-17T14:26:04.564 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-17T14:26:06.357 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 131/202 2024-02-17T14:26:06.394 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 131/202 2024-02-17T14:26:06.582 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-17T14:26:06.583 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-17T14:26:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 131/202 2024-02-17T14:26:06.989 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 132/202 2024-02-17T14:26:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 132/202 2024-02-17T14:26:07.090 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-17T14:26:07.090 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-17T14:26:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:26:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 133/202 2024-02-17T14:26:13.604 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-17T14:26:13.710 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-17T14:26:13.744 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-17T14:26:13.782 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-17T14:26:13.809 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-17T14:26:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-17T14:26:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-17T14:26:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-17T14:26:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-17T14:26:14.020 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-17T14:26:14.075 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-17T14:26:14.399 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-17T14:26:14.471 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 11/202 2024-02-17T14:26:14.593 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 11/202 2024-02-17T14:26:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 12/202 2024-02-17T14:26:14.738 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 12/202 2024-02-17T14:26:14.776 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.0.0-1515.g6822c7b5.el9.x86_64 13/202 2024-02-17T14:26:14.937 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-17T14:26:14.997 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-17T14:26:15.026 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 16/202 2024-02-17T14:26:15.129 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 16/202 2024-02-17T14:26:15.161 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86 17/202 2024-02-17T14:26:15.209 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86 17/202 2024-02-17T14:26:15.256 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-17T14:26:15.279 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-17T14:26:15.294 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-17T14:26:15.488 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-17T14:26:15.528 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-17T14:26:15.567 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-17T14:26:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-17T14:26:15.861 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-17T14:26:15.920 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-17T14:26:16.012 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-17T14:26:16.072 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-17T14:26:16.281 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-17T14:26:16.385 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-17T14:26:16.480 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-17T14:26:16.511 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-17T14:26:16.578 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-17T14:26:16.632 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-17T14:26:16.672 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-17T14:26:16.707 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-17T14:26:16.747 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-17T14:26:16.810 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-17T14:26:16.846 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-17T14:26:16.889 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-17T14:26:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-17T14:26:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-17T14:26:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-17T14:26:17.055 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.0.0-1515.g6822c7b5.el9. 39/202 2024-02-17T14:26:17.098 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.0.0-1515.g6822c7b5.el 40/202 2024-02-17T14:26:17.135 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.0.0-1515.g6822c7b5.el9.x86_6 41/202 2024-02-17T14:26:17.204 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-17T14:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-17T14:26:17.323 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-17T14:26:17.455 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-17T14:26:17.510 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-17T14:26:18.032 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-17T14:26:18.113 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-17T14:26:18.212 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-17T14:26:18.259 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-17T14:26:18.267 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-17T14:26:18.305 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-17T14:26:18.343 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.0.0-1515.g6822c7b5.el9.x86_6 52/202 2024-02-17T14:26:18.384 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-17T14:26:18.425 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 133/202 2024-02-17T14:26:18.425 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-02-17T14:26:18.425 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-02-17T14:26:18.425 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-02-17T14:26:18.425 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-02-17T14:26:18.425 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-02-17T14:26:18.425 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-02-17T14:26:18.425 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-02-17T14:26:18.425 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:26:18.494 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-17T14:26:18.568 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-17T14:26:18.593 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 134/202 2024-02-17T14:26:18.612 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 134/202 2024-02-17T14:26:18.612 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:18.612 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-17T14:26:18.612 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:26:18.868 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-17T14:26:18.992 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-17T14:26:19.069 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-17T14:26:19.113 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-17T14:26:19.256 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-17T14:26:19.316 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-17T14:26:19.371 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-17T14:26:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-17T14:26:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-17T14:26:19.520 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-17T14:26:19.567 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-17T14:26:19.604 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-17T14:26:19.646 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-17T14:26:19.688 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-17T14:26:19.822 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-17T14:26:19.868 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-17T14:26:19.907 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-17T14:26:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-17T14:26:20.088 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 135/202 2024-02-17T14:26:20.113 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 135/202 2024-02-17T14:26:20.113 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:20.113 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-17T14:26:20.113 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-17T14:26:20.113 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-17T14:26:20.113 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:26:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-17T14:26:20.322 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 136/202 2024-02-17T14:26:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 136/202 2024-02-17T14:26:20.344 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:20.344 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-17T14:26:20.344 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-17T14:26:20.344 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-17T14:26:20.344 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:26:20.357 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-17T14:26:20.397 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-17T14:26:20.423 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-17T14:26:20.456 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-17T14:26:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-17T14:26:20.656 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-17T14:26:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-17T14:26:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 137/202 2024-02-17T14:26:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 137/202 2024-02-17T14:26:20.812 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:20.812 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-17T14:26:20.812 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-17T14:26:20.812 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-17T14:26:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:26:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-17T14:26:20.870 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-17T14:26:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-17T14:26:20.925 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-17T14:26:21.109 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-17T14:26:21.159 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-17T14:26:21.297 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-17T14:26:21.343 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-02-17T14:26:21.366 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 139/202 2024-02-17T14:26:21.375 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-17T14:26:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 139/202 2024-02-17T14:26:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1515.g6822c7b5.e 140/202 2024-02-17T14:26:21.477 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-17T14:26:21.478 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-17T14:26:21.478 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-17T14:26:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1515.g6822c7b5. 141/202 2024-02-17T14:26:21.501 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-17T14:26:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noa 142/202 2024-02-17T14:26:21.535 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-17T14:26:21.575 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-17T14:26:21.615 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-17T14:26:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-17T14:26:21.729 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-17T14:26:21.746 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noa 142/202 2024-02-17T14:26:21.763 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-17T14:26:21.772 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.n 143/202 2024-02-17T14:26:21.815 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-17T14:26:21.880 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-17T14:26:21.914 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-17T14:26:22.003 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-17T14:26:22.084 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-17T14:26:22.137 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-17T14:26:22.168 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-17T14:26:22.223 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-17T14:26:22.321 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-17T14:26:22.369 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-17T14:26:22.733 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.n 143/202 2024-02-17T14:26:22.763 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1515.g682 144/202 2024-02-17T14:26:22.863 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1515.g682 144/202 2024-02-17T14:26:23.026 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1515.g6822c7b5.el 145/202 2024-02-17T14:26:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 146/202 2024-02-17T14:26:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 146/202 2024-02-17T14:26:23.080 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:23.080 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-17T14:26:23.080 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-17T14:26:23.080 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-17T14:26:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:26:23.094 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-17T14:26:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 147/202 2024-02-17T14:26:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 147/202 2024-02-17T14:26:23.141 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-17T14:26:23.175 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-17T14:26:23.185 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.0.0-1515.g6822c7b5.el9.x86_64 148/202 2024-02-17T14:26:23.223 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-17T14:26:23.310 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-17T14:26:23.385 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-17T14:26:23.562 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-17T14:26:23.590 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-17T14:26:23.668 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-17T14:26:24.074 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-17T14:26:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 150/202 2024-02-17T14:26:24.123 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 150/202 2024-02-17T14:26:24.123 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:24.123 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-17T14:26:24.123 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-17T14:26:24.123 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-17T14:26:24.123 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:26:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1515.g6822c 151/202 2024-02-17T14:26:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1515.g6822c 151/202 2024-02-17T14:26:24.198 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:24.198 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-17T14:26:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:26:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 152/202 2024-02-17T14:26:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 152/202 2024-02-17T14:26:24.267 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:24.267 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-17T14:26:24.267 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-17T14:26:24.267 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-17T14:26:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:26:24.304 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-17T14:26:24.421 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-17T14:26:24.577 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 153/202 2024-02-17T14:26:24.600 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 153/202 2024-02-17T14:26:24.600 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:24.600 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-17T14:26:24.600 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-17T14:26:24.600 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-17T14:26:24.600 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:26:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-17T14:26:25.861 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-17T14:26:25.887 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-17T14:26:26.196 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-17T14:26:26.234 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 125/202 2024-02-17T14:26:26.307 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 125/202 2024-02-17T14:26:26.347 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 126/202 2024-02-17T14:26:26.383 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-17T14:26:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-17T14:26:26.870 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 129/202 2024-02-17T14:26:26.941 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 129/202 2024-02-17T14:26:26.972 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 130/202 2024-02-17T14:26:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.0.0-1515.g6822c7b5.el9.x86_64 154/202 2024-02-17T14:26:29.106 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 155/202 2024-02-17T14:26:29.136 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 156/202 2024-02-17T14:26:29.163 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-17T14:26:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 131/202 2024-02-17T14:26:29.211 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 131/202 2024-02-17T14:26:29.345 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-shell-2:19.0.0-1515.g6822c7b5.el9.x86_64 158/202 2024-02-17T14:26:29.480 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-17T14:26:29.528 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 160/202 2024-02-17T14:26:29.586 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-17T14:26:29.645 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-17T14:26:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-17T14:26:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-17T14:26:29.768 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 131/202 2024-02-17T14:26:29.808 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 132/202 2024-02-17T14:26:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-17T14:26:29.837 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.0.0-1515.g6822c7b5.el9.x86_ 166/202 2024-02-17T14:26:29.870 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-17T14:26:29.878 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 132/202 2024-02-17T14:26:29.878 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-17T14:26:29.879 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-17T14:26:29.879 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:26:29.915 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 133/202 2024-02-17T14:26:29.937 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-17T14:26:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-17T14:26:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-17T14:26:30.615 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-17T14:26:30.648 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-17T14:26:30.668 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-17T14:26:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-top-2:19.0.0-1515.g6822c7b5.el9.noarch 172/202 2024-02-17T14:26:31.542 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-17T14:26:31.583 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-17T14:26:31.677 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-17T14:26:31.712 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-17T14:26:31.737 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-17T14:26:31.763 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-17T14:26:31.797 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-17T14:26:31.797 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-17T14:26:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-17T14:26:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-17T14:26:31.932 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-17T14:26:31.932 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-17T14:26:32.016 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-17T14:26:32.052 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-17T14:26:32.085 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-17T14:26:32.109 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-17T14:26:32.137 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-17T14:26:32.169 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-17T14:26:32.204 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-17T14:26:32.250 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-17T14:26:32.282 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-17T14:26:32.307 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-17T14:26:32.332 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-17T14:26:32.358 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-17T14:26:32.383 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-17T14:26:32.390 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-17T14:26:32.390 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-17T14:26:32.578 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-17T14:26:32.578 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-17T14:26:32.669 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-17T14:26:32.693 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-17T14:26:32.719 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-17T14:26:32.743 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-17T14:26:32.777 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-17T14:26:32.843 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-17T14:26:37.779 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-17T14:26:37.779 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.0.0-1515.g6822c7b5.el9.x86_64 1/202 2024-02-17T14:26:37.779 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 2/202 2024-02-17T14:26:37.779 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 3/202 2024-02-17T14:26:37.779 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 4/202 2024-02-17T14:26:37.779 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1515.g6822c 5/202 2024-02-17T14:26:37.779 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 6/202 2024-02-17T14:26:37.779 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 7/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 8/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 9/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 10/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 11/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.0.0-1515.g6822c7b5.el9.x86_64 12/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 13/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-shell-2:19.0.0-1515.g6822c7b5.el9.x86_64 14/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.0.0-1515.g6822c7b5.el9.x86_ 15/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 16/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 17/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.0.0-1515.g6822c7b5.el9.x86_6 18/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86 19/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 20/202 2024-02-17T14:26:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1515.g6822c7b5.el 21/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.0.0-1515.g6822c7b5.el9. 22/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.0.0-1515.g6822c7b5.el9.x86_6 23/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.0.0-1515.g6822c7b5.el9.x86_64 24/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 25/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 26/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 27/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 28/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 29/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1515.g6822c7b5. 30/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noa 31/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.n 32/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1515.g682 33/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1515.g6822c7b5.el 34/202 2024-02-17T14:26:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 35/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1515.g6822c7b5.e 36/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 37/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 38/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-top-2:19.0.0-1515.g6822c7b5.el9.noarch 39/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-17T14:26:37.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-17T14:26:37.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-17T14:26:37.784 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-17T14:26:37.785 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-17T14:26:37.786 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-17T14:26:37.787 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-17T14:26:37.788 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 151/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 153/202 2024-02-17T14:26:37.789 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-17T14:26:37.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-17T14:26:37.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-17T14:26:37.792 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-17T14:26:37.793 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-17T14:26:37.793 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-17T14:26:37.793 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-17T14:26:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-17T14:26:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:26:40.720 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-02-17T14:26:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-17T14:26:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-17T14:26:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-17T14:26:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-17T14:26:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: acl-2.3.1-4.el9.x86_64 2024-02-17T14:26:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-17T14:26:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-17T14:26:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-17T14:26:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-17T14:26:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-17T14:26:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-17T14:26:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-17T14:26:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-02-17T14:26:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-17T14:26:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.2-8.el9.noarch 2024-02-17T14:26:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.7.4-5.el9.x86_64 2024-02-17T14:26:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-17T14:26:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:26:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:26:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:26:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:26:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:26:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:26:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:26:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:26:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:26:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:26:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-17T14:26:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.4-9.el9.x86_64 2024-02-17T14:26:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-17T14:26:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-17T14:26:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-17T14:26:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-17T14:26:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-17T14:26:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-17T14:26:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: jq-1.6-16.el9.x86_64 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-17T14:26:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-17T14:26:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-13.11-1.el9.x86_64 2024-02-17T14:26:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-17T14:26:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-17T14:26:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-17T14:26:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-17T14:26:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-17T14:26:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-17T14:26:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-17T14:26:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-17T14:26:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-17T14:26:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-17T14:26:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-17T14:26:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-17T14:26:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-17T14:26:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-17T14:26:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-17T14:26:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-17T14:26:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-17T14:26:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-17T14:26:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-17T14:26:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-17T14:26:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-17T14:26:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-17T14:26:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-17T14:26:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-17T14:26:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-3.el9.x86_64 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-17T14:26:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-17T14:26:40.734 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-17T14:26:40.734 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:26:40.734 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-02-17T14:26:41.375 DEBUG:teuthology.parallel:result is None 2024-02-17T14:26:41.625 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 133/202 2024-02-17T14:26:41.625 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-02-17T14:26:41.625 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-02-17T14:26:41.625 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-02-17T14:26:41.625 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-02-17T14:26:41.625 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-02-17T14:26:41.625 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-02-17T14:26:41.625 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-02-17T14:26:41.626 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:26:41.793 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 134/202 2024-02-17T14:26:41.808 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 134/202 2024-02-17T14:26:41.808 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:41.808 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-17T14:26:41.809 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:26:43.271 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 135/202 2024-02-17T14:26:43.297 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 135/202 2024-02-17T14:26:43.297 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:43.297 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-17T14:26:43.297 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-17T14:26:43.297 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-17T14:26:43.297 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:26:43.514 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 136/202 2024-02-17T14:26:43.536 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 136/202 2024-02-17T14:26:43.536 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:43.536 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-17T14:26:43.536 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-17T14:26:43.536 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-17T14:26:43.536 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:26:43.973 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 137/202 2024-02-17T14:26:43.995 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 137/202 2024-02-17T14:26:43.995 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:43.995 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-17T14:26:43.995 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-17T14:26:43.995 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-17T14:26:43.995 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:26:44.091 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-17T14:26:44.542 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 139/202 2024-02-17T14:26:44.573 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 139/202 2024-02-17T14:26:44.630 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1515.g6822c7b5.e 140/202 2024-02-17T14:26:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1515.g6822c7b5. 141/202 2024-02-17T14:26:44.721 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noa 142/202 2024-02-17T14:26:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noa 142/202 2024-02-17T14:26:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.n 143/202 2024-02-17T14:26:45.944 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.n 143/202 2024-02-17T14:26:45.973 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1515.g682 144/202 2024-02-17T14:26:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1515.g682 144/202 2024-02-17T14:26:46.234 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1515.g6822c7b5.el 145/202 2024-02-17T14:26:46.266 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 146/202 2024-02-17T14:26:46.288 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 146/202 2024-02-17T14:26:46.288 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:46.288 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-17T14:26:46.288 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-17T14:26:46.288 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-17T14:26:46.289 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:26:46.341 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 147/202 2024-02-17T14:26:46.352 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 147/202 2024-02-17T14:26:46.407 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.0.0-1515.g6822c7b5.el9.x86_64 148/202 2024-02-17T14:26:47.264 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-17T14:26:47.294 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 150/202 2024-02-17T14:26:47.315 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 150/202 2024-02-17T14:26:47.316 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:47.316 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-17T14:26:47.316 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-17T14:26:47.316 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-17T14:26:47.316 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:26:47.361 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1515.g6822c 151/202 2024-02-17T14:26:47.382 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1515.g6822c 151/202 2024-02-17T14:26:47.383 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:47.383 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-17T14:26:47.383 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:26:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 152/202 2024-02-17T14:26:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 152/202 2024-02-17T14:26:47.450 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:47.450 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-17T14:26:47.451 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-17T14:26:47.451 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-17T14:26:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:26:47.754 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 153/202 2024-02-17T14:26:47.776 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 153/202 2024-02-17T14:26:47.776 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-17T14:26:47.776 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-17T14:26:47.777 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-17T14:26:47.777 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-17T14:26:47.777 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:26:52.208 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.0.0-1515.g6822c7b5.el9.x86_64 154/202 2024-02-17T14:26:52.249 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 155/202 2024-02-17T14:26:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 156/202 2024-02-17T14:26:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-17T14:26:52.493 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-shell-2:19.0.0-1515.g6822c7b5.el9.x86_64 158/202 2024-02-17T14:26:52.607 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-17T14:26:52.654 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 160/202 2024-02-17T14:26:52.690 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-17T14:26:52.763 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-17T14:26:52.841 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-17T14:26:52.873 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-17T14:26:52.908 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-17T14:26:52.930 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.0.0-1515.g6822c7b5.el9.x86_ 166/202 2024-02-17T14:26:52.960 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-17T14:26:53.037 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-17T14:26:53.094 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-17T14:26:53.133 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-17T14:26:53.698 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-17T14:26:53.735 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-17T14:26:53.755 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-17T14:26:54.567 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-top-2:19.0.0-1515.g6822c7b5.el9.noarch 172/202 2024-02-17T14:26:54.643 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-17T14:26:54.684 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-17T14:26:54.774 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-17T14:26:54.805 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-17T14:26:54.829 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-17T14:26:54.855 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-17T14:26:54.881 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-17T14:26:54.881 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-17T14:26:54.966 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-17T14:26:54.993 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-17T14:26:55.024 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-17T14:26:55.024 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-17T14:26:55.092 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-17T14:26:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-17T14:26:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-17T14:26:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-17T14:26:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-17T14:26:55.236 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-17T14:26:55.271 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-17T14:26:55.317 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-17T14:26:55.366 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-17T14:26:55.391 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-17T14:26:55.425 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-17T14:26:55.450 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-17T14:26:55.475 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-17T14:26:55.482 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-17T14:26:55.482 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-17T14:26:55.662 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-17T14:26:55.662 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-17T14:26:55.761 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-17T14:26:55.786 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-17T14:26:55.811 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-17T14:26:55.837 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-17T14:26:55.869 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-17T14:26:55.945 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-17T14:27:00.838 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-17T14:27:00.838 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.0.0-1515.g6822c7b5.el9.x86_64 1/202 2024-02-17T14:27:00.838 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 2/202 2024-02-17T14:27:00.838 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 3/202 2024-02-17T14:27:00.838 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 4/202 2024-02-17T14:27:00.838 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1515.g6822c 5/202 2024-02-17T14:27:00.838 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 6/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 7/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 8/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 9/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 10/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 11/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.0.0-1515.g6822c7b5.el9.x86_64 12/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 13/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-shell-2:19.0.0-1515.g6822c7b5.el9.x86_64 14/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.0.0-1515.g6822c7b5.el9.x86_ 15/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 16/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 17/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.0.0-1515.g6822c7b5.el9.x86_6 18/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86 19/202 2024-02-17T14:27:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 20/202 2024-02-17T14:27:00.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1515.g6822c7b5.el 21/202 2024-02-17T14:27:00.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.0.0-1515.g6822c7b5.el9. 22/202 2024-02-17T14:27:00.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.0.0-1515.g6822c7b5.el9.x86_6 23/202 2024-02-17T14:27:00.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.0.0-1515.g6822c7b5.el9.x86_64 24/202 2024-02-17T14:27:00.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 25/202 2024-02-17T14:27:00.855 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 26/202 2024-02-17T14:27:00.855 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 27/202 2024-02-17T14:27:00.855 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 28/202 2024-02-17T14:27:00.856 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 29/202 2024-02-17T14:27:00.856 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1515.g6822c7b5. 30/202 2024-02-17T14:27:00.856 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noa 31/202 2024-02-17T14:27:00.856 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.n 32/202 2024-02-17T14:27:00.856 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1515.g682 33/202 2024-02-17T14:27:00.856 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1515.g6822c7b5.el 34/202 2024-02-17T14:27:00.856 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 35/202 2024-02-17T14:27:00.856 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1515.g6822c7b5.e 36/202 2024-02-17T14:27:00.856 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 37/202 2024-02-17T14:27:00.856 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 38/202 2024-02-17T14:27:00.856 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-top-2:19.0.0-1515.g6822c7b5.el9.noarch 39/202 2024-02-17T14:27:00.856 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-17T14:27:00.856 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-17T14:27:00.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-17T14:27:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-17T14:27:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-17T14:27:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-17T14:27:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-17T14:27:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-17T14:27:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-17T14:27:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-17T14:27:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-17T14:27:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-17T14:27:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-17T14:27:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-17T14:27:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-17T14:27:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-17T14:27:00.859 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-17T14:27:00.860 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-17T14:27:00.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-17T14:27:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-17T14:27:00.863 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 151/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 153/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-17T14:27:00.864 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-17T14:27:00.865 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-17T14:27:00.866 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-17T14:27:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-17T14:27:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-17T14:27:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-17T14:27:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-17T14:27:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-17T14:27:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-17T14:27:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-17T14:27:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-17T14:27:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-17T14:27:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-17T14:27:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-17T14:27:00.867 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-17T14:27:03.677 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-17T14:27:03.678 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:03.678 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-02-17T14:27:03.678 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-17T14:27:03.678 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-17T14:27:03.678 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-17T14:27:03.679 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-17T14:27:03.679 INFO:teuthology.orchestra.run.smithi142.stdout: acl-2.3.1-4.el9.x86_64 2024-02-17T14:27:03.679 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-17T14:27:03.679 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-17T14:27:03.679 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-17T14:27:03.680 INFO:teuthology.orchestra.run.smithi142.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-17T14:27:03.680 INFO:teuthology.orchestra.run.smithi142.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-17T14:27:03.680 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-17T14:27:03.680 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-17T14:27:03.680 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-17T14:27:03.681 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-17T14:27:03.681 INFO:teuthology.orchestra.run.smithi142.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-17T14:27:03.681 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.681 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.681 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-17T14:27:03.681 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-17T14:27:03.682 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-17T14:27:03.682 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-17T14:27:03.682 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-17T14:27:03.682 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-17T14:27:03.682 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-17T14:27:03.682 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-17T14:27:03.683 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-17T14:27:03.683 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-17T14:27:03.683 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-17T14:27:03.683 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.2-8.el9.noarch 2024-02-17T14:27:03.683 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.7.4-5.el9.x86_64 2024-02-17T14:27:03.684 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-17T14:27:03.684 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.684 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.684 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.684 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:27:03.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:27:03.685 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:27:03.686 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:27:03.686 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:27:03.686 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:27:03.686 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.686 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.687 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:27:03.687 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.687 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.687 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.687 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:27:03.687 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:27:03.688 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.688 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.691 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top-2:19.0.0-1515.g6822c7b5.el9.noarch 2024-02-17T14:27:03.691 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-17T14:27:03.692 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.4-9.el9.x86_64 2024-02-17T14:27:03.692 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-17T14:27:03.692 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-17T14:27:03.692 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-17T14:27:03.692 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-17T14:27:03.693 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-17T14:27:03.693 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-17T14:27:03.693 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.6-16.el9.x86_64 2024-02-17T14:27:03.693 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-17T14:27:03.694 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-17T14:27:03.694 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-17T14:27:03.694 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.694 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.694 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.694 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-17T14:27:03.695 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-17T14:27:03.695 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-17T14:27:03.695 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-17T14:27:03.695 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-17T14:27:03.695 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.696 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.696 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-17T14:27:03.696 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.696 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-17T14:27:03.696 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-17T14:27:03.696 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-17T14:27:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-17T14:27:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-17T14:27:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2024-02-17T14:27:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-17T14:27:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-17T14:27:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-17T14:27:03.698 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-17T14:27:03.698 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-17T14:27:03.698 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-17T14:27:03.698 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-17T14:27:03.698 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-13.11-1.el9.x86_64 2024-02-17T14:27:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-17T14:27:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-17T14:27:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-17T14:27:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-17T14:27:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-17T14:27:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-17T14:27:03.700 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-17T14:27:03.700 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-17T14:27:03.700 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-17T14:27:03.700 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-17T14:27:03.700 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.701 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.701 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.701 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-17T14:27:03.701 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-17T14:27:03.701 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-17T14:27:03.701 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-17T14:27:03.702 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-17T14:27:03.702 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-17T14:27:03.702 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-17T14:27:03.702 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-17T14:27:03.702 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-17T14:27:03.702 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-17T14:27:03.703 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-17T14:27:03.703 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-17T14:27:03.703 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-17T14:27:03.704 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-17T14:27:03.704 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-17T14:27:03.704 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-17T14:27:03.704 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-17T14:27:03.704 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-17T14:27:03.705 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-17T14:27:03.705 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-17T14:27:03.705 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-17T14:27:03.705 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-17T14:27:03.705 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-17T14:27:03.705 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-17T14:27:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-17T14:27:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-17T14:27:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-17T14:27:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-17T14:27:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-17T14:27:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-17T14:27:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-02-17T14:27:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-17T14:27:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-17T14:27:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-17T14:27:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-17T14:27:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-17T14:27:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-17T14:27:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-17T14:27:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-17T14:27:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-17T14:27:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-17T14:27:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-17T14:27:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-17T14:27:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-17T14:27:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-17T14:27:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-17T14:27:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-17T14:27:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-17T14:27:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-17T14:27:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-17T14:27:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-17T14:27:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-17T14:27:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-17T14:27:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-17T14:27:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-17T14:27:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-17T14:27:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-17T14:27:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-17T14:27:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.0.0-1515.g6822c7b5.el9.x86_64 2024-02-17T14:27:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-3.el9.x86_64 2024-02-17T14:27:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-17T14:27:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-17T14:27:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-17T14:27:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-17T14:27:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-17T14:27:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-17T14:27:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:03.714 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-17T14:27:04.311 DEBUG:teuthology.parallel:result is None 2024-02-17T14:27:04.312 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T14:27:04.467 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-17T14:27:04.492 INFO:teuthology.orchestra.run.smithi134.stdout:19.0.0-1515.g6822c7b5.el9 2024-02-17T14:27:04.493 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1515.g6822c7b5.el9 2024-02-17T14:27:04.493 INFO:teuthology.task.install:The correct ceph version 19.0.0-1515.g6822c7b5 is installed. 2024-02-17T14:27:04.495 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T14:27:04.632 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-17T14:27:04.653 INFO:teuthology.orchestra.run.smithi142.stdout:19.0.0-1515.g6822c7b5.el9 2024-02-17T14:27:04.653 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1515.g6822c7b5.el9 2024-02-17T14:27:04.654 INFO:teuthology.task.install:The correct ceph version 19.0.0-1515.g6822c7b5 is installed. 2024-02-17T14:27:04.655 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-17T14:27:04.656 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:04.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-17T14:27:04.691 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:04.691 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-17T14:27:04.723 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-17T14:27:04.724 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:04.724 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-02-17T14:27:04.762 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-17T14:27:04.831 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:04.831 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-02-17T14:27:04.859 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-17T14:27:04.927 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-17T14:27:04.928 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:04.928 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-17T14:27:04.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-17T14:27:05.026 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:05.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-17T14:27:05.053 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-17T14:27:05.120 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-17T14:27:05.120 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:05.121 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-02-17T14:27:05.148 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-17T14:27:05.215 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:05.215 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-02-17T14:27:05.242 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-17T14:27:05.309 INFO:teuthology.run_tasks:Running task ceph... 2024-02-17T14:27:05.402 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-17T14:27:05.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-02-17T14:27:05.405 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-02-17T14:27:05.431 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-17T14:27:05.432 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-17T14:27:05.473 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-17T14:27:05.499 INFO:tasks.ceph:Creating extra log directories... 2024-02-17T14:27:05.499 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-17T14:27:05.540 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-17T14:27:05.573 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-02-17T14:27:05.573 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-02-17T14:27:05.573 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-02-17T14:27:05.573 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:05.573 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-17T14:27:05.619 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-17T14:27:05.738 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-17T14:27:05.765 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:05.766 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-17T14:27:05.780 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-17T14:27:05.898 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-17T14:27:05.929 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-17T14:27:05.929 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client use faked inos': True, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-17T14:27:05.930 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318', 'branch': 'main', 'description': 'fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7563318', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'client use faked inos': True, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 51, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 2794, 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOK5IpjFUEuLz0UF0NoR2IV9XdoyRPqKvsWOVlQ5sRLe3wnNrpZgFUQ9eR8NCGqnJEgMCWG+jmKRkjb8zvbFREI=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKUQ43CaH7NvsQ4ZYOyTA2ps4YzW6p5osYh334pRbjJhG4pR9Bmcz00lOsDwmqLFRqBja7OHTWN4xX1V2JfwOUY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'client use faked inos': True, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-16_20:13:25', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-17T14:27:05.930 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-17T14:27:05.932 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-17T14:27:05.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-02-17T14:27:05.987 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-02-17T14:27:06.046 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:06.046 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-02-17T14:27:06.067 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-17T14:27:06.067 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-02-17T14:27:06.121 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-17T14:27:06.122 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T14:27:06.122 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-02-17T14:27:06.122 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T14:27:06.122 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T14:27:06.122 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-02-17 14:26:33.178385443 +0000 2024-02-17T14:27:06.122 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-02-17 14:24:24.792521580 +0000 2024-02-17T14:27:06.122 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-02-17 14:24:24.792521580 +0000 2024-02-17T14:27:06.122 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-02-17 14:24:24.792521580 +0000 2024-02-17T14:27:06.122 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-17T14:27:06.186 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-02-17T14:27:06.187 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-02-17T14:27:06.187 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000202505 s, 2.5 MB/s 2024-02-17T14:27:06.188 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-17T14:27:06.244 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-02-17T14:27:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-17T14:27:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T14:27:06.300 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-02-17T14:27:06.300 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T14:27:06.300 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T14:27:06.300 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-02-17 14:26:33.178385443 +0000 2024-02-17T14:27:06.301 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-02-17 14:24:25.150513630 +0000 2024-02-17T14:27:06.301 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-02-17 14:24:25.150513630 +0000 2024-02-17T14:27:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-02-17 14:24:25.150513630 +0000 2024-02-17T14:27:06.301 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-17T14:27:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-02-17T14:27:06.366 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-02-17T14:27:06.366 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000204286 s, 2.5 MB/s 2024-02-17T14:27:06.367 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-17T14:27:06.423 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-02-17T14:27:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-17T14:27:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T14:27:06.478 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-02-17T14:27:06.478 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T14:27:06.478 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T14:27:06.478 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-02-17 14:26:33.179385421 +0000 2024-02-17T14:27:06.478 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-02-17 14:24:25.493506011 +0000 2024-02-17T14:27:06.478 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-02-17 14:24:25.493506011 +0000 2024-02-17T14:27:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-02-17 14:24:25.493506011 +0000 2024-02-17T14:27:06.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-17T14:27:06.544 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-02-17T14:27:06.544 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-02-17T14:27:06.544 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000184429 s, 2.8 MB/s 2024-02-17T14:27:06.545 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-17T14:27:06.601 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-02-17T14:27:06.656 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-17T14:27:06.656 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T14:27:06.656 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-02-17T14:27:06.656 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T14:27:06.656 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T14:27:06.656 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-02-17 14:26:33.179385421 +0000 2024-02-17T14:27:06.656 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-02-17 14:24:25.838498347 +0000 2024-02-17T14:27:06.656 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-02-17 14:24:25.838498347 +0000 2024-02-17T14:27:06.656 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-02-17 14:24:25.838498347 +0000 2024-02-17T14:27:06.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-17T14:27:06.724 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-02-17T14:27:06.724 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-02-17T14:27:06.724 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000207408 s, 2.5 MB/s 2024-02-17T14:27:06.724 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-17T14:27:06.780 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T14:27:06.780 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:06.780 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-02-17T14:27:06.799 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-17T14:27:06.799 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-02-17T14:27:06.857 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-17T14:27:06.857 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T14:27:06.857 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-02-17T14:27:06.857 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T14:27:06.857 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T14:27:06.857 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-17 14:26:56.297250789 +0000 2024-02-17T14:27:06.857 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-17 14:24:24.812552772 +0000 2024-02-17T14:27:06.857 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-17 14:24:24.812552772 +0000 2024-02-17T14:27:06.857 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-17 14:24:24.812552772 +0000 2024-02-17T14:27:06.858 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-17T14:27:06.926 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-17T14:27:06.926 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-17T14:27:06.926 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000227432 s, 2.3 MB/s 2024-02-17T14:27:06.927 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-17T14:27:06.985 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-02-17T14:27:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-17T14:27:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T14:27:07.043 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-02-17T14:27:07.043 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T14:27:07.043 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T14:27:07.043 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-17 14:26:56.297250789 +0000 2024-02-17T14:27:07.043 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-17 14:24:25.160546012 +0000 2024-02-17T14:27:07.043 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-17 14:24:25.160546012 +0000 2024-02-17T14:27:07.043 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-17 14:24:25.160546012 +0000 2024-02-17T14:27:07.043 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-17T14:27:07.111 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-17T14:27:07.111 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-17T14:27:07.111 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000278576 s, 1.8 MB/s 2024-02-17T14:27:07.112 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-17T14:27:07.170 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-02-17T14:27:07.227 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-17T14:27:07.227 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T14:27:07.227 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-02-17T14:27:07.227 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T14:27:07.227 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T14:27:07.227 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-17 14:26:56.297250789 +0000 2024-02-17T14:27:07.227 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-17 14:24:25.503539349 +0000 2024-02-17T14:27:07.228 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-17 14:24:25.503539349 +0000 2024-02-17T14:27:07.228 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-17 14:24:25.503539349 +0000 2024-02-17T14:27:07.228 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-17T14:27:07.295 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-17T14:27:07.295 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-17T14:27:07.295 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000202175 s, 2.5 MB/s 2024-02-17T14:27:07.296 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-17T14:27:07.353 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-02-17T14:27:07.409 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-17T14:27:07.409 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T14:27:07.409 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-02-17T14:27:07.409 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T14:27:07.409 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T14:27:07.409 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-17 14:26:56.298250769 +0000 2024-02-17T14:27:07.409 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-17 14:24:25.823533133 +0000 2024-02-17T14:27:07.409 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-17 14:24:25.823533133 +0000 2024-02-17T14:27:07.409 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-17 14:24:25.823533133 +0000 2024-02-17T14:27:07.410 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-17T14:27:07.476 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-17T14:27:07.476 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-17T14:27:07.476 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000292713 s, 1.7 MB/s 2024-02-17T14:27:07.477 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-17T14:27:07.533 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T14:27:07.534 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-17T14:27:07.534 INFO:tasks.ceph:Generating config... 2024-02-17T14:27:07.535 INFO:tasks.ceph:[client] client mount timeout = 600 2024-02-17T14:27:07.535 INFO:tasks.ceph:[client] client use faked inos = True 2024-02-17T14:27:07.535 INFO:tasks.ceph:[client] debug client = 20 2024-02-17T14:27:07.535 INFO:tasks.ceph:[client] debug ms = 1 2024-02-17T14:27:07.535 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-02-17T14:27:07.535 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-02-17T14:27:07.535 INFO:tasks.ceph:[mds] debug mds = 20 2024-02-17T14:27:07.535 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-02-17T14:27:07.535 INFO:tasks.ceph:[mds] debug ms = 1 2024-02-17T14:27:07.535 INFO:tasks.ceph:[mds] mds debug frag = True 2024-02-17T14:27:07.536 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-02-17T14:27:07.536 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-02-17T14:27:07.536 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-02-17T14:27:07.536 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-02-17T14:27:07.536 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-02-17T14:27:07.536 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-02-17T14:27:07.536 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-17T14:27:07.536 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-17T14:27:07.536 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-17T14:27:07.536 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-17T14:27:07.536 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-17T14:27:07.536 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-02-17T14:27:07.536 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-17T14:27:07.536 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-02-17T14:27:07.536 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-17T14:27:07.537 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-02-17T14:27:07.537 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-02-17T14:27:07.537 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-17T14:27:07.537 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-17T14:27:07.537 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-02-17T14:27:07.537 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-17T14:27:07.537 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-17T14:27:07.537 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-17T14:27:07.537 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-17T14:27:07.537 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-17T14:27:07.537 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-02-17T14:27:07.537 INFO:tasks.ceph:Setting up mon.a... 2024-02-17T14:27:07.538 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-17T14:27:07.594 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.keyring 2024-02-17T14:27:07.597 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-17T14:27:07.641 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-17T14:27:07.668 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.134'), ('mon.b', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]')] 2024-02-17T14:27:07.668 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.134,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client use faked inos': True, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-02-17T14:27:07.669 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:07.669 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-17T14:27:07.723 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.134 --add b 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:07.808 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:07.808 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: generated fsid b1013434-3edf-47fa-8dd2-e861b79d4deb 2024-02-17T14:27:07.808 INFO:teuthology.orchestra.run.smithi134.stdout:setting min_mon_release = quincy 2024-02-17T14:27:07.808 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 0 2024-02-17T14:27:07.808 INFO:teuthology.orchestra.run.smithi134.stdout:fsid b1013434-3edf-47fa-8dd2-e861b79d4deb 2024-02-17T14:27:07.808 INFO:teuthology.orchestra.run.smithi134.stdout:last_changed 2024-02-17T14:27:07.810400+0000 2024-02-17T14:27:07.809 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-02-17T14:27:07.810400+0000 2024-02-17T14:27:07.809 INFO:teuthology.orchestra.run.smithi134.stdout:min_mon_release 17 (quincy) 2024-02-17T14:27:07.809 INFO:teuthology.orchestra.run.smithi134.stdout:election_strategy: 1 2024-02-17T14:27:07.809 INFO:teuthology.orchestra.run.smithi134.stdout:0: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.a 2024-02-17T14:27:07.809 INFO:teuthology.orchestra.run.smithi134.stdout:1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.b 2024-02-17T14:27:07.809 INFO:teuthology.orchestra.run.smithi134.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-17T14:27:07.809 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-17T14:27:07.810 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-17T14:27:07.824 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b1013434-3edf-47fa-8dd2-e861b79d4deb... 2024-02-17T14:27:07.825 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-17T14:27:07.867 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-17T14:27:07.914 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-02-17T14:27:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-02-17T14:27:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-17T14:27:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-02-17T14:27:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.134,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-02-17T14:27:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = b1013434-3edf-47fa-8dd2-e861b79d4deb 2024-02-17T14:27:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.918 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-02-17T14:27:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-02-17T14:27:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-02-17T14:27:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-02-17T14:27:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-02-17T14:27:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-02-17T14:27:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-02-17T14:27:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-02-17T14:27:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-02-17T14:27:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-02-17T14:27:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug trim objects = true 2024-02-17T14:27:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-02-17T14:27:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-02-17T14:27:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-02-17T14:27:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-02-17T14:27:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore compression mode = aggressive 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 20 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 20 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 10 2024-02-17T14:27:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.921 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-02-17T14:27:07.922 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-02-17T14:27:07.922 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-02-17T14:27:07.922 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-02-17T14:27:07.922 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-02-17T14:27:07.922 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-02-17T14:27:07.922 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-02-17T14:27:07.922 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-02-17T14:27:07.923 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout: client use faked inos = True 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-02-17T14:27:07.924 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds balancer = 20 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = True 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2024-02-17T14:27:07.925 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = True 2024-02-17T14:27:07.926 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-02-17T14:27:07.926 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-02-17T14:27:07.926 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-02-17T14:27:07.926 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-02-17T14:27:07.926 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-02-17T14:27:07.926 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-17T14:27:07.926 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-02-17T14:27:07.926 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.926 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-02-17T14:27:07.926 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-02-17T14:27:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-02-17T14:27:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-02-17T14:27:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-02-17T14:27:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-02-17T14:27:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-02-17T14:27:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-02-17T14:27:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-02-17T14:27:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-17T14:27:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-17T14:27:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-02-17T14:27:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-17T14:27:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-02-17T14:27:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-02-17T14:27:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-02-17T14:27:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-02-17T14:27:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-02-17T14:27:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.134,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = b1013434-3edf-47fa-8dd2-e861b79d4deb 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-02-17T14:27:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-02-17T14:27:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore compression mode = aggressive 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-02-17T14:27:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.933 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-02-17T14:27:07.933 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-17T14:27:07.933 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-02-17T14:27:07.933 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-02-17T14:27:07.933 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-02-17T14:27:07.933 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-02-17T14:27:07.933 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-02-17T14:27:07.933 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-02-17T14:27:07.933 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-02-17T14:27:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-02-17T14:27:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout: client use faked inos = True 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2024-02-17T14:27:07.936 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2024-02-17T14:27:07.937 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds balancer = 20 2024-02-17T14:27:07.937 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-17T14:27:07.937 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2024-02-17T14:27:07.937 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2024-02-17T14:27:07.937 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2024-02-17T14:27:07.937 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2024-02-17T14:27:07.937 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-02-17T14:27:07.937 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-02-17T14:27:07.937 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-02-17T14:27:07.939 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-17T14:27:07.939 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-17T14:27:08.033 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-17T14:27:08.034 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:08.034 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-17T14:27:08.048 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:08.048 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-17T14:27:08.103 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-02-17T14:27:08.103 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:08.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-17T14:27:08.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-17T14:27:08.183 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:08.183 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:08.237 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-02-17T14:27:08.237 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:08.237 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-17T14:27:08.237 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-17T14:27:08.277 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:08.278 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:08.332 INFO:tasks.ceph:Setting up mon nodes... 2024-02-17T14:27:08.333 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-17T14:27:08.333 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-17T14:27:08.388 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-17T14:27:08.392 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-17T14:27:08.455 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-17T14:27:08.457 INFO:tasks.ceph:Setting up mds nodes... 2024-02-17T14:27:08.457 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-02-17T14:27:08.514 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-02-17T14:27:08.515 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-02-17T14:27:08.541 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-02-17T14:27:08.596 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-02-17T14:27:08.599 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-02-17T14:27:08.625 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-17T14:27:08.626 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-17T14:27:08.669 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-17T14:27:08.683 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-17T14:27:08.684 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-17T14:27:08.684 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-17T14:27:08.750 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T14:27:08.750 INFO:tasks.ceph:role: osd.0 2024-02-17T14:27:08.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-02-17T14:27:08.750 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-17T14:27:08.824 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T14:27:08.824 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T14:27:08.824 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T14:27:08.824 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T14:27:08.825 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T14:27:08.825 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-02-17T14:27:08.825 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T14:27:08.825 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T14:27:08.825 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T14:27:08.825 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T14:27:09.340 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-02-17T14:27:09.342 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-02-17T14:27:09.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-17T14:27:09.473 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-17T14:27:09.507 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-17T14:27:09.574 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T14:27:09.574 INFO:tasks.ceph:role: osd.1 2024-02-17T14:27:09.574 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-02-17T14:27:09.574 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-17T14:27:09.649 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T14:27:09.649 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T14:27:09.649 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T14:27:09.649 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T14:27:09.649 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T14:27:09.649 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-02-17T14:27:09.649 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T14:27:09.649 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T14:27:09.649 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T14:27:09.649 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T14:27:10.097 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-02-17T14:27:10.099 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-02-17T14:27:10.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-02-17T14:27:10.190 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-17T14:27:10.221 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-17T14:27:10.288 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T14:27:10.289 INFO:tasks.ceph:role: osd.2 2024-02-17T14:27:10.289 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2024-02-17T14:27:10.289 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-17T14:27:10.363 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T14:27:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T14:27:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T14:27:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T14:27:10.363 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T14:27:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-02-17T14:27:10.363 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T14:27:10.363 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T14:27:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T14:27:10.363 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T14:27:10.853 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-02-17T14:27:10.854 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-02-17T14:27:10.854 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-02-17T14:27:10.984 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-17T14:27:11.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-17T14:27:11.086 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T14:27:11.086 INFO:tasks.ceph:role: osd.3 2024-02-17T14:27:11.086 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2024-02-17T14:27:11.086 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-17T14:27:11.160 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T14:27:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T14:27:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T14:27:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T14:27:11.161 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T14:27:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-02-17T14:27:11.161 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T14:27:11.161 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T14:27:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T14:27:11.161 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T14:27:11.666 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-02-17T14:27:11.668 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-02-17T14:27:11.669 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-02-17T14:27:11.817 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-17T14:27:11.852 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:11.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:11.946+0000 7fc78ac1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-17T14:27:11.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:11.947+0000 7fc78ac1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-17T14:27:11.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:11.947+0000 7fc78ac1c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-17T14:27:11.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:11.947+0000 7fc78ac1c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-17T14:27:11.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:11.947+0000 7fc78ac1c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-17T14:27:11.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:11.947+0000 7fc78ac1c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-17T14:27:14.800 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-17T14:27:14.830 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:14.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:14.921+0000 7f488f424640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-17T14:27:14.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:14.921+0000 7f488f424640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-17T14:27:14.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:14.921+0000 7f488f424640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-17T14:27:14.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:14.921+0000 7f488f424640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-17T14:27:14.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:14.921+0000 7f488f424640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-17T14:27:14.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:14.922+0000 7f488f424640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-17T14:27:17.772 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-17T14:27:17.804 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:17.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:17.897+0000 7fef85e17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-17T14:27:17.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:17.897+0000 7fef85e17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-17T14:27:17.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:17.897+0000 7fef85e17640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-17T14:27:17.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:17.897+0000 7fef85e17640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-17T14:27:17.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:17.897+0000 7fef85e17640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-17T14:27:17.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:17.898+0000 7fef85e17640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-17T14:27:20.749 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-17T14:27:20.779 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:20.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:20.868+0000 7fbc9280d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-17T14:27:20.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:20.868+0000 7fbc9280d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-17T14:27:20.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:20.868+0000 7fbc9280d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-17T14:27:20.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:20.868+0000 7fbc9280d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-17T14:27:20.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:20.868+0000 7fbc9280d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-17T14:27:20.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:20.868+0000 7fbc9280d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-17T14:27:23.717 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-17T14:27:23.748 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-17T14:27:23.781 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T14:27:23.781 INFO:tasks.ceph:role: osd.4 2024-02-17T14:27:23.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-17T14:27:23.782 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-17T14:27:23.858 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T14:27:23.865 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T14:27:23.865 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T14:27:23.865 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T14:27:23.866 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T14:27:23.866 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-17T14:27:23.866 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T14:27:23.866 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T14:27:23.866 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T14:27:23.866 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T14:27:24.375 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-17T14:27:24.378 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-17T14:27:24.378 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-02-17T14:27:24.539 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-17T14:27:24.576 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-17T14:27:24.647 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T14:27:24.647 INFO:tasks.ceph:role: osd.5 2024-02-17T14:27:24.648 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-17T14:27:24.648 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-17T14:27:24.723 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T14:27:24.723 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T14:27:24.723 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T14:27:24.723 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T14:27:24.723 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T14:27:24.723 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-17T14:27:24.724 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T14:27:24.724 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T14:27:24.724 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T14:27:24.724 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T14:27:25.173 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-17T14:27:25.176 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-17T14:27:25.176 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-17T14:27:25.277 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-17T14:27:25.308 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-17T14:27:25.374 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T14:27:25.374 INFO:tasks.ceph:role: osd.6 2024-02-17T14:27:25.374 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-17T14:27:25.375 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-17T14:27:25.449 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T14:27:25.449 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T14:27:25.449 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T14:27:25.449 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T14:27:25.449 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T14:27:25.449 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-17T14:27:25.450 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T14:27:25.450 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T14:27:25.450 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T14:27:25.450 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T14:27:25.938 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-17T14:27:25.940 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-17T14:27:25.940 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-17T14:27:26.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-17T14:27:26.127 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-17T14:27:26.195 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T14:27:26.195 INFO:tasks.ceph:role: osd.7 2024-02-17T14:27:26.195 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-17T14:27:26.195 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-17T14:27:26.268 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T14:27:26.268 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T14:27:26.269 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T14:27:26.269 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-17T14:27:26.269 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T14:27:26.269 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-17T14:27:26.269 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T14:27:26.269 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-17T14:27:26.269 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T14:27:26.269 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T14:27:26.782 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-17T14:27:26.784 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-17T14:27:26.784 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-02-17T14:27:26.923 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-17T14:27:26.957 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:27.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:27.057+0000 7f416b424640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-17T14:27:27.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:27.059+0000 7f416b424640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-17T14:27:27.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:27.059+0000 7f416b424640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-17T14:27:27.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:27.059+0000 7f416b424640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-17T14:27:27.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:27.059+0000 7f416b424640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-17T14:27:27.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:27.059+0000 7f416b424640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-17T14:27:29.912 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-17T14:27:29.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:30.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:30.034+0000 7f47cce23640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-17T14:27:30.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:30.034+0000 7f47cce23640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-17T14:27:30.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:30.034+0000 7f47cce23640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-17T14:27:30.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:30.035+0000 7f47cce23640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-17T14:27:30.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:30.035+0000 7f47cce23640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-17T14:27:30.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:30.035+0000 7f47cce23640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-17T14:27:32.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-17T14:27:32.918 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:33.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:33.013+0000 7f27a0e1d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-17T14:27:33.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:33.013+0000 7f27a0e1d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-17T14:27:33.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:33.013+0000 7f27a0e1d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-17T14:27:33.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:33.013+0000 7f27a0e1d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-17T14:27:33.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:33.013+0000 7f27a0e1d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-17T14:27:33.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:33.014+0000 7f27a0e1d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-17T14:27:35.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-17T14:27:35.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:35.931 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:27:35.934 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:27:35.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:35.984+0000 7faecb81c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-17T14:27:35.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:35.984+0000 7faecb81c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-17T14:27:35.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:35.984+0000 7faecb81c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-17T14:27:35.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:35.984+0000 7faecb81c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-17T14:27:35.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:35.984+0000 7faecb81c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-17T14:27:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:35.985+0000 7faecb81c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-17T14:27:38.833 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-17T14:27:38.864 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-17T14:27:38.864 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:38.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-17T14:27:38.897 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:38.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-02-17T14:27:38.967 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:38.967 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-17T14:27:39.037 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:39.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-17T14:27:39.106 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:39.106 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-17T14:27:39.176 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:39.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-17T14:27:39.244 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:39.245 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-17T14:27:39.277 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:39.277 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-02-17T14:27:39.347 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:39.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-17T14:27:39.416 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:39.417 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-17T14:27:39.486 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:39.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-17T14:27:39.555 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:39.555 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-17T14:27:39.623 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:39.623 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-17T14:27:39.642 INFO:tasks.ceph:Adding keys to all mons... 2024-02-17T14:27:39.642 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-17T14:27:39.684 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-17T14:27:39.711 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2024-02-17T14:27:39.711 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQA8wtBld8BKFxAAViim4i6IwrMLWhrVgEiMag== 2024-02-17T14:27:39.711 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-02-17T14:27:39.711 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQA8wtBl/86qHhAAbX3VIMR8IO2GBMaegymvJQ== 2024-02-17T14:27:39.711 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2024-02-17T14:27:39.711 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQA/wtBlWEJ7OBAArnf3AQsa8h2X3zLmLaZPAg== 2024-02-17T14:27:39.711 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2024-02-17T14:27:39.711 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBCwtBlfyn2NhAASk9xxICI7SwQ2vJiDs/xYg== 2024-02-17T14:27:39.711 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2024-02-17T14:27:39.711 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBFwtBlMKaNNRAAm/OV1cA9e/MSK80twu6cdg== 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBIwtBl96HLMxAAnHVO+upB8cwRU+pUNEUTVQ== 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQA8wtBl2L5BGxAA/oqLDY5CvNykfnqH8CnzIw== 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQA8wtBld5uyIxAAkliMpyv4E2IFju08E0/XXg== 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBPwtBlaMl+AxAAfYDZTNTqgcS4S09LV1CA6w== 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBSwtBlb+YeAhAA21ol8St773KbUuvbpU4FUw== 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBVwtBlnK3YABAABG4+ZDmc10P+aMeEbmTSPA== 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2024-02-17T14:27:39.712 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBXwtBlZB67OhAAJoQMqJXLFsN2F7ROuYQU/g== 2024-02-17T14:27:39.713 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2024-02-17T14:27:39.713 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQA8wtBlbosCKBAAhzDsZ2gD1q5I3fUwRMoCJA== 2024-02-17T14:27:39.714 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2024-02-17T14:27:39.714 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQA8wtBld8BKFxAAViim4i6IwrMLWhrVgEiMag== 2024-02-17T14:27:39.714 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-02-17T14:27:39.714 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQA8wtBl/86qHhAAbX3VIMR8IO2GBMaegymvJQ== 2024-02-17T14:27:39.714 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2024-02-17T14:27:39.714 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQA/wtBlWEJ7OBAArnf3AQsa8h2X3zLmLaZPAg== 2024-02-17T14:27:39.714 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBCwtBlfyn2NhAASk9xxICI7SwQ2vJiDs/xYg== 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBFwtBlMKaNNRAAm/OV1cA9e/MSK80twu6cdg== 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBIwtBl96HLMxAAnHVO+upB8cwRU+pUNEUTVQ== 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQA8wtBl2L5BGxAA/oqLDY5CvNykfnqH8CnzIw== 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQA8wtBld5uyIxAAkliMpyv4E2IFju08E0/XXg== 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBPwtBlaMl+AxAAfYDZTNTqgcS4S09LV1CA6w== 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBSwtBlb+YeAhAA21ol8St773KbUuvbpU4FUw== 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2024-02-17T14:27:39.715 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBVwtBlnK3YABAABG4+ZDmc10P+aMeEbmTSPA== 2024-02-17T14:27:39.716 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2024-02-17T14:27:39.716 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBXwtBlZB67OhAAJoQMqJXLFsN2F7ROuYQU/g== 2024-02-17T14:27:39.716 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-02-17T14:27:39.716 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQA8wtBlbosCKBAAhzDsZ2gD1q5I3fUwRMoCJA== 2024-02-17T14:27:39.716 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T14:27:39.757 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T14:27:39.813 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T14:27:39.816 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T14:27:39.871 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:39.873 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:39.926 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:39.928 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:39.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:39.982 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:40.033 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:40.036 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:40.089 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T14:27:40.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T14:27:40.142 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T14:27:40.145 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T14:27:40.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:40.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:40.253 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:40.256 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:40.307 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:40.310 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:40.362 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:40.364 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T14:27:40.415 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T14:27:40.418 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T14:27:40.472 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-17T14:27:40.472 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-17T14:27:40.499 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-17T14:27:40.595 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-17T14:27:40.622 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-17T14:27:40.649 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-17T14:27:40.746 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-17T14:27:40.773 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-17T14:27:40.839 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-17T14:27:40.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-17T14:27:40.967 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:40.969 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-17T14:27:41.021 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-17T14:27:41.021 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-17T14:27:41.022 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-17T14:27:41.024 INFO:tasks.ceph.mon.a:Started 2024-02-17T14:27:41.024 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-17T14:27:41.024 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-17T14:27:41.064 INFO:tasks.ceph.mon.b:Started 2024-02-17T14:27:41.064 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-17T14:27:41.064 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-17T14:27:41.066 INFO:tasks.ceph.mon.c:Started 2024-02-17T14:27:41.066 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-17T14:27:41.067 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-17T14:27:41.067 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-17T14:27:41.069 INFO:tasks.ceph.mgr.y:Started 2024-02-17T14:27:41.069 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-17T14:27:41.069 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-17T14:27:41.071 INFO:tasks.ceph.mgr.x:Started 2024-02-17T14:27:41.071 INFO:tasks.ceph:Setting crush tunables to default 2024-02-17T14:27:41.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd crush tunables default 2024-02-17T14:27:41.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.172+0000 7fac83365640 1 Processor -- start 2024-02-17T14:27:41.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.172+0000 7fac83365640 1 -- start start 2024-02-17T14:27:41.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac83365640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:41.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac83365640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac83365640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac83365640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac7c0b51f0 con 0x7fac7c0ada50 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac83365640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac7c0b6640 con 0x7fac7c0acb20 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac83365640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c0ad2b0 con 0x7fac7c141090 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac80900640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac80900640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58674/0 (socket says 172.21.15.134:58674) 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac80900640 1 -- 172.21.15.134:0/1968043886 learned_addr learned my addr 172.21.15.134:0/1968043886 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac80900640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 msgr2=0x7fac7c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac80900640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 msgr2=0x7fac7c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac80900640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac80900640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac81101640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:41.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac81902640 1 -- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 msgr2=0x7fac7c14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T14:27:41.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac81902640 1 -- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 msgr2=0x7fac7c14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T14:27:41.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T14:27:41.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T14:27:41.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac81101640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 msgr2=0x7fac7c146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T14:27:41.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac81101640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 msgr2=0x7fac7c146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T14:27:41.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac81101640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T14:27:41.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.173+0000 7fac81101640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T14:27:41.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac80900640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:41.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac80900640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 msgr2=0x7fac7c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T14:27:41.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac80900640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 msgr2=0x7fac7c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T14:27:41.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac80900640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T14:27:41.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:41.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac80900640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T14:27:41.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac81101640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:41.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac81902640 1 -- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 msgr2=0x7fac7c14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T14:27:41.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac81902640 1 -- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 msgr2=0x7fac7c14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T14:27:41.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T14:27:41.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac81101640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 msgr2=0x7fac7c146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-17T14:27:41.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T14:27:41.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac81101640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 msgr2=0x7fac7c146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T14:27:41.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac81101640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T14:27:41.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.375+0000 7fac81101640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T14:27:41.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac80900640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:41.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac80900640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 msgr2=0x7fac7c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T14:27:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac80900640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 msgr2=0x7fac7c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T14:27:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac80900640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T14:27:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac80900640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T14:27:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac81101640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac81902640 1 -- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 msgr2=0x7fac7c14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T14:27:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac81902640 1 -- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 msgr2=0x7fac7c14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T14:27:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac81101640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 msgr2=0x7fac7c146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-17T14:27:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac81101640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 msgr2=0x7fac7c146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T14:27:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T14:27:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac81101640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T14:27:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T14:27:41.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:41.776+0000 7fac81101640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T14:27:42.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac80900640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:42.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac80900640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 msgr2=0x7fac7c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T14:27:42.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac80900640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 msgr2=0x7fac7c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T14:27:42.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac80900640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T14:27:42.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac80900640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T14:27:42.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:42.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac81101640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:42.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac81902640 1 -- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 msgr2=0x7fac7c14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-17T14:27:42.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac81902640 1 -- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 msgr2=0x7fac7c14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T14:27:42.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T14:27:42.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T14:27:42.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac81101640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 msgr2=0x7fac7c146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T14:27:42.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac81101640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 msgr2=0x7fac7c146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T14:27:42.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac81101640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T14:27:42.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:42.578+0000 7fac81101640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T14:27:44.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:44.174+0000 7fac72ffd640 1 -- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 msgr2=0x7fac7c14a480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T14:27:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:44.174+0000 7fac72ffd640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac7c14a480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:44.174+0000 7fac72ffd640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 msgr2=0x7fac7c146e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T14:27:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:44.174+0000 7fac72ffd640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.142:3300/0 conn(0x7fac7c0acb20 0x7fac7c146e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:44.174+0000 7fac72ffd640 1 -- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 msgr2=0x7fac7c140b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T14:27:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:44.174+0000 7fac72ffd640 1 --2- 172.21.15.134:0/1968043886 >> v2:172.21.15.134:3300/0 conn(0x7fac7c0ada50 0x7fac7c140b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:44.174+0000 7fac72ffd640 1 -- 172.21.15.134:0/1968043886 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7c0ad590 con 0x7fac68003690 2024-02-17T14:27:44.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:44.174+0000 7fac72ffd640 1 -- 172.21.15.134:0/1968043886 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6800c090 con 0x7fac68007320 2024-02-17T14:27:46.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.399+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998724370 0 0) 0x7fac7c0ad590 con 0x7fac68003690 2024-02-17T14:27:46.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.399+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac60003520 con 0x7fac68003690 2024-02-17T14:27:46.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461814639 0 0) 0x7fac6800c090 con 0x7fac68007320 2024-02-17T14:27:46.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac7c0ad590 con 0x7fac68007320 2024-02-17T14:27:46.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1763631082 0 0) 0x7fac7c0ad590 con 0x7fac68007320 2024-02-17T14:27:46.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 >> v1:172.21.15.134:6789/0 conn(0x7fac68003690 legacy=0x7fac68005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6800d270 con 0x7fac68007320 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7fac7800c570 con 0x7fac68007320 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 >> v1:172.21.15.142:6789/0 conn(0x7fac68007320 legacy=0x7fac680097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac81902640 1 -- 172.21.15.134:0/1968043886 reap_dead start 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac73fff640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac60003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac73fff640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac60004130 0x7fac600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac73fff640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac60004f00 0x7fac6000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6000bec0 con 0x7fac60004f00 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6000c000 con 0x7fac60004130 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.400+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6000c140 con 0x7fac7c141090 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.401+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac60004f00 0x7fac6000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.401+0000 7fac81101640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac60003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.401+0000 7fac80900640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac60004130 0x7fac600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.401+0000 7fac81902640 1 -- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 msgr2=0x7fac60003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:46.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.401+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac60003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:46.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.401+0000 7fac81902640 1 -- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac60004130 msgr2=0x7fac600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:46.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.401+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac60004130 0x7fac600047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:46.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.401+0000 7fac81902640 1 -- 172.21.15.134:0/1968043886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c0ad590 con 0x7fac60004f00 2024-02-17T14:27:46.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.402+0000 7fac81902640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac60004f00 0x7fac6000b980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fac7c06e660 tx=0x7fac600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b18553348a258d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:46.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.402+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac74035410 con 0x7fac60004f00 2024-02-17T14:27:46.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.402+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7402f030 con 0x7fac60004f00 2024-02-17T14:27:46.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.402+0000 7fac73fff640 1 -- 172.21.15.134:0/1968043886 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac740357f0 con 0x7fac60004f00 2024-02-17T14:27:46.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.403+0000 7fac83365640 1 -- 172.21.15.134:0/1968043886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac60004f00 msgr2=0x7fac6000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:46.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.403+0000 7fac83365640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac60004f00 0x7fac6000b980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fac7c06e660 tx=0x7fac600057f0 comp rx=0 tx=0).stop 2024-02-17T14:27:46.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.403+0000 7fac83365640 1 -- 172.21.15.134:0/1968043886 shutdown_connections 2024-02-17T14:27:46.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.403+0000 7fac83365640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac60004f00 0x7fac6000b980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:46.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.403+0000 7fac83365640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac60004130 0x7fac600047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:46.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.403+0000 7fac83365640 1 --2- 172.21.15.134:0/1968043886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac7c141090 0x7fac60003ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:46.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.403+0000 7fac83365640 1 -- 172.21.15.134:0/1968043886 >> 172.21.15.134:0/1968043886 conn(0x7fac7c0ba420 msgr2=0x7fac7c0ba830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:46.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.404+0000 7fac83365640 1 -- 172.21.15.134:0/1968043886 shutdown_connections 2024-02-17T14:27:46.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.404+0000 7fac83365640 1 -- 172.21.15.134:0/1968043886 wait complete. 2024-02-17T14:27:46.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.405+0000 7fac83365640 1 Processor -- start 2024-02-17T14:27:46.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.405+0000 7fac83365640 1 -- start start 2024-02-17T14:27:46.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac83365640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac60004130 0x7fac7c1497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:46.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac83365640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac60004f00 0x7fac7c1dc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:46.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac83365640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac7c141090 0x7fac7c1dc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:46.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac83365640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c148800 con 0x7fac60004130 2024-02-17T14:27:46.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac83365640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c14a1a0 con 0x7fac7c141090 2024-02-17T14:27:46.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac83365640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c14aed0 con 0x7fac60004f00 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac81101640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac60004130 0x7fac7c1497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac80900640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac60004f00 0x7fac7c1dc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac81101640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac60004130 0x7fac7c1497f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34456/0 (socket says 172.21.15.134:34456) 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac81101640 1 -- 172.21.15.134:0/40677688 learned_addr learned my addr 172.21.15.134:0/40677688 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac81902640 1 --2- 172.21.15.134:0/40677688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac7c141090 0x7fac7c1dc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac81101640 1 -- 172.21.15.134:0/40677688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac60004f00 msgr2=0x7fac7c1dc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac81101640 1 --2- 172.21.15.134:0/40677688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac60004f00 0x7fac7c1dc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac81101640 1 -- 172.21.15.134:0/40677688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac7c141090 msgr2=0x7fac7c1dc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac81101640 1 --2- 172.21.15.134:0/40677688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac7c141090 0x7fac7c1dc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac81101640 1 -- 172.21.15.134:0/40677688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c0b5800 con 0x7fac60004130 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac80900640 1 --2- 172.21.15.134:0/40677688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac60004f00 0x7fac7c1dc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac81101640 1 --2- 172.21.15.134:0/40677688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac60004130 0x7fac7c1497f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fac6c011f20 tx=0x7fac6c0064d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.406+0000 7fac71ffb640 1 -- 172.21.15.134:0/40677688 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c0165f0 con 0x7fac60004130 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.407+0000 7fac71ffb640 1 -- 172.21.15.134:0/40677688 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c01b070 con 0x7fac60004130 2024-02-17T14:27:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.407+0000 7fac83365640 1 -- 172.21.15.134:0/40677688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7c148a30 con 0x7fac60004130 2024-02-17T14:27:46.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.407+0000 7fac71ffb640 1 -- 172.21.15.134:0/40677688 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c016970 con 0x7fac60004130 2024-02-17T14:27:46.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.407+0000 7fac83365640 1 -- 172.21.15.134:0/40677688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7c0b10a0 con 0x7fac60004130 2024-02-17T14:27:46.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.407+0000 7fac71ffb640 1 -- 172.21.15.134:0/40677688 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fac6c01d030 con 0x7fac60004130 2024-02-17T14:27:46.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.407+0000 7fac71ffb640 1 -- 172.21.15.134:0/40677688 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fac6c017890 con 0x7fac60004130 2024-02-17T14:27:46.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.408+0000 7fac83365640 1 -- 172.21.15.134:0/40677688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7c068280 con 0x7fac60004130 2024-02-17T14:27:46.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.412+0000 7fac71ffb640 1 -- 172.21.15.134:0/40677688 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fac6c017aa0 con 0x7fac60004130 2024-02-17T14:27:46.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.481+0000 7fac83365640 1 -- 172.21.15.134:0/40677688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fac7c0b4fd0 con 0x7fac60004130 2024-02-17T14:27:46.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.483+0000 7fac71ffb640 1 -- 172.21.15.134:0/40677688 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fac6c017c40 con 0x7fac60004130 2024-02-17T14:27:46.482 INFO:teuthology.orchestra.run.smithi134.stderr:adjusted tunables profile to default 2024-02-17T14:27:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.484+0000 7fac83365640 1 -- 172.21.15.134:0/40677688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac60004130 msgr2=0x7fac7c1497f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.484+0000 7fac83365640 1 --2- 172.21.15.134:0/40677688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac60004130 0x7fac7c1497f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fac6c011f20 tx=0x7fac6c0064d0 comp rx=0 tx=0).stop 2024-02-17T14:27:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.484+0000 7fac83365640 1 -- 172.21.15.134:0/40677688 shutdown_connections 2024-02-17T14:27:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.484+0000 7fac83365640 1 --2- 172.21.15.134:0/40677688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac7c141090 0x7fac7c1dc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.484+0000 7fac83365640 1 --2- 172.21.15.134:0/40677688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac60004f00 0x7fac7c1dc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:46.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.484+0000 7fac83365640 1 --2- 172.21.15.134:0/40677688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac60004130 0x7fac7c1497f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.484+0000 7fac83365640 1 -- 172.21.15.134:0/40677688 >> 172.21.15.134:0/40677688 conn(0x7fac7c0ba420 msgr2=0x7fac7c13d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.484+0000 7fac83365640 1 -- 172.21.15.134:0/40677688 shutdown_connections 2024-02-17T14:27:46.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:46.484+0000 7fac83365640 1 -- 172.21.15.134:0/40677688 wait complete. 2024-02-17T14:27:46.495 INFO:tasks.ceph:check_enable_crimson: False 2024-02-17T14:27:46.495 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-17T14:27:46.495 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:46.495 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-17T14:27:46.522 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:46.522 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-17T14:27:46.589 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:46.589 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-17T14:27:46.657 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:27:46.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-17T14:27:46.723 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:46.724 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-17T14:27:46.751 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:46.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-17T14:27:46.819 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:46.819 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-17T14:27:46.866 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:46.867+0000 7fd0fde3e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-17T14:27:46.878 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:46.879+0000 7fcc4223c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-17T14:27:46.886 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-17T14:27:46.886 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-17T14:27:46.923 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:46.923+0000 7fd0fde3e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T14:27:46.933 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:46.934+0000 7fcc4223c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T14:27:46.950 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 1fe51099-49d8-4cb5-9f61-ac89029c1f2a 0 2024-02-17T14:27:47.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.090+0000 7f1750040640 1 Processor -- start 2024-02-17T14:27:47.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.091+0000 7f1750040640 1 -- start start 2024-02-17T14:27:47.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.092+0000 7f1750040640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f17480720e0 0x7f1748070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.092+0000 7f1750040640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1748070c50 0x7f17480b5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.092+0000 7f1750040640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17481474e0 con 0x7f17480b3440 2024-02-17T14:27:47.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.092+0000 7f1750040640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17480b5c60 con 0x7f17480720e0 2024-02-17T14:27:47.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.092+0000 7f1750040640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1748071090 con 0x7f1748070c50 2024-02-17T14:27:47.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.092+0000 7f174d5db640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f17480b3440 0x7f17480b5010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41470/0 (socket says 172.21.15.142:41470) 2024-02-17T14:27:47.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.092+0000 7f174d5db640 1 -- 172.21.15.142:0/899885220 learned_addr learned my addr 172.21.15.142:0/899885220 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-02-17T14:27:47.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.092+0000 7f174e5dd640 1 --2- 172.21.15.142:0/899885220 >> v2:172.21.15.142:3300/0 conn(0x7f1748070c50 0x7f17480b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.092+0000 7f174dddc640 1 --2- 172.21.15.142:0/899885220 >> v2:172.21.15.134:3300/0 conn(0x7f17480720e0 0x7f1748070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.092+0000 7f174e5dd640 1 -- 172.21.15.142:0/899885220 >> v2:172.21.15.134:3300/0 conn(0x7f17480720e0 msgr2=0x7f1748070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:47.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.092+0000 7f174e5dd640 1 --2- 172.21.15.142:0/899885220 >> v2:172.21.15.134:3300/0 conn(0x7f17480720e0 0x7f1748070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.092+0000 7f174e5dd640 1 -- 172.21.15.142:0/899885220 >> v1:172.21.15.142:6789/0 conn(0x7f17480b3440 legacy=0x7f17480b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.092+0000 7f174e5dd640 1 -- 172.21.15.142:0/899885220 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748147720 con 0x7f1748070c50 2024-02-17T14:27:47.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.093+0000 7f174e5dd640 1 --2- 172.21.15.142:0/899885220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1748070c50 0x7f17480b5720 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f17480b2bf0 tx=0x7f174002be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deaffcbeed38411f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:47.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.093+0000 7f174cdda640 1 -- 172.21.15.142:0/899885220 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174002cbf0 con 0x7f1748070c50 2024-02-17T14:27:47.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.093+0000 7f174cdda640 1 -- 172.21.15.142:0/899885220 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174002cd50 con 0x7f1748070c50 2024-02-17T14:27:47.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.093+0000 7f174cdda640 1 -- 172.21.15.142:0/899885220 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740034660 con 0x7f1748070c50 2024-02-17T14:27:47.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.094+0000 7f1750040640 1 -- 172.21.15.142:0/899885220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1748070c50 msgr2=0x7f17480b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.094+0000 7f1750040640 1 --2- 172.21.15.142:0/899885220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1748070c50 0x7f17480b5720 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f17480b2bf0 tx=0x7f174002be40 comp rx=0 tx=0).stop 2024-02-17T14:27:47.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.094+0000 7f1750040640 1 -- 172.21.15.142:0/899885220 shutdown_connections 2024-02-17T14:27:47.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.094+0000 7f1750040640 1 --2- 172.21.15.142:0/899885220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1748070c50 0x7f17480b5720 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.094+0000 7f1750040640 1 --2- 172.21.15.142:0/899885220 >> v2:172.21.15.134:3300/0 conn(0x7f17480720e0 0x7f1748070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.094+0000 7f1750040640 1 -- 172.21.15.142:0/899885220 >> 172.21.15.142:0/899885220 conn(0x7f17480b9350 msgr2=0x7f17480b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:47.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.094+0000 7f1750040640 1 -- 172.21.15.142:0/899885220 shutdown_connections 2024-02-17T14:27:47.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.094+0000 7f1750040640 1 -- 172.21.15.142:0/899885220 wait complete. 2024-02-17T14:27:47.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.095+0000 7f1750040640 1 Processor -- start 2024-02-17T14:27:47.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.095+0000 7f1750040640 1 -- start start 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f1750040640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1748070c50 0x7f17481cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f1750040640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17480720e0 0x7f17481db950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f1750040640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17480b3440 0x7f17481dbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f1750040640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1748138770 con 0x7f17480720e0 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f1750040640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174813a500 con 0x7f17480b3440 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f1750040640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174813a7e0 con 0x7f1748070c50 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f174dddc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1748070c50 0x7f17481cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f174e5dd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17480b3440 0x7f17481dbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f174dddc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1748070c50 0x7f17481cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57732/0 (socket says 172.21.15.142:57732) 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f174e5dd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17480b3440 0x7f17481dbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42998/0 (socket says 172.21.15.142:42998) 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f174dddc640 1 -- 172.21.15.142:0/1440649221 learned_addr learned my addr 172.21.15.142:0/1440649221 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f174d5db640 1 --2- 172.21.15.142:0/1440649221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17480720e0 0x7f17481db950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f174e5dd640 1 -- 172.21.15.142:0/1440649221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1748070c50 msgr2=0x7f17481cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f174e5dd640 1 --2- 172.21.15.142:0/1440649221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1748070c50 0x7f17481cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f174e5dd640 1 -- 172.21.15.142:0/1440649221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17480720e0 msgr2=0x7f17481db950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f174e5dd640 1 --2- 172.21.15.142:0/1440649221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17480720e0 0x7f17481db950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f174e5dd640 1 -- 172.21.15.142:0/1440649221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1740009a70 con 0x7f17480b3440 2024-02-17T14:27:47.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f174e5dd640 1 --2- 172.21.15.142:0/1440649221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17480b3440 0x7f17481dbe90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1740033000 tx=0x7f1740004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:47.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f173e7fc640 1 -- 172.21.15.142:0/1440649221 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740040650 con 0x7f17480b3440 2024-02-17T14:27:47.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f173e7fc640 1 -- 172.21.15.142:0/1440649221 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17400407b0 con 0x7f17480b3440 2024-02-17T14:27:47.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f1750040640 1 -- 172.21.15.142:0/1440649221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17481441f0 con 0x7f17480b3440 2024-02-17T14:27:47.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.096+0000 7f173e7fc640 1 -- 172.21.15.142:0/1440649221 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740040b60 con 0x7f17480b3440 2024-02-17T14:27:47.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.097+0000 7f1750040640 1 -- 172.21.15.142:0/1440649221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17481447b0 con 0x7f17480b3440 2024-02-17T14:27:47.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.097+0000 7f173e7fc640 1 -- 172.21.15.142:0/1440649221 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1740049790 con 0x7f17480b3440 2024-02-17T14:27:47.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.097+0000 7f173e7fc640 1 -- 172.21.15.142:0/1440649221 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f174003e6f0 con 0x7f17480b3440 2024-02-17T14:27:47.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.097+0000 7f1750040640 1 -- 172.21.15.142:0/1440649221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1748068280 con 0x7f17480b3440 2024-02-17T14:27:47.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.101+0000 7f173e7fc640 1 -- 172.21.15.142:0/1440649221 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1740044020 con 0x7f17480b3440 2024-02-17T14:27:47.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.172+0000 7f1750040640 1 -- 172.21.15.142:0/1440649221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1fe51099-49d8-4cb5-9f61-ac89029c1f2a", "id": 0} v 0) v1 -- 0x7f17480b9730 con 0x7f17480b3440 2024-02-17T14:27:47.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.175+0000 7f173e7fc640 1 -- 172.21.15.142:0/1440649221 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1fe51099-49d8-4cb5-9f61-ac89029c1f2a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1740039070 con 0x7f17480b3440 2024-02-17T14:27:47.174 INFO:teuthology.orchestra.run.smithi142.stdout:0 2024-02-17T14:27:47.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.176+0000 7f1750040640 1 -- 172.21.15.142:0/1440649221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17480b3440 msgr2=0x7f17481dbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.176+0000 7f1750040640 1 --2- 172.21.15.142:0/1440649221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17480b3440 0x7f17481dbe90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1740033000 tx=0x7f1740004a40 comp rx=0 tx=0).stop 2024-02-17T14:27:47.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.176+0000 7f1750040640 1 -- 172.21.15.142:0/1440649221 shutdown_connections 2024-02-17T14:27:47.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.176+0000 7f1750040640 1 --2- 172.21.15.142:0/1440649221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17480b3440 0x7f17481dbe90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.176+0000 7f1750040640 1 --2- 172.21.15.142:0/1440649221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17480720e0 0x7f17481db950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.176+0000 7f1750040640 1 --2- 172.21.15.142:0/1440649221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1748070c50 0x7f17481cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.176+0000 7f1750040640 1 -- 172.21.15.142:0/1440649221 >> 172.21.15.142:0/1440649221 conn(0x7f17480b9350 msgr2=0x7f17480b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.176+0000 7f1750040640 1 -- 172.21.15.142:0/1440649221 shutdown_connections 2024-02-17T14:27:47.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.176+0000 7f1750040640 1 -- 172.21.15.142:0/1440649221 wait complete. 2024-02-17T14:27:47.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 7f46f0ae-43cb-4075-8096-cf2928cae7cf 1 2024-02-17T14:27:47.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.287+0000 7f8ed42dd640 1 Processor -- start 2024-02-17T14:27:47.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.287+0000 7f8ed42dd640 1 -- start start 2024-02-17T14:27:47.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.287+0000 7f8ed42dd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ecc072810 0x7f8ecc0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.287+0000 7f8ed42dd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 0x7f8ecc1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.288+0000 7f8ed42dd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc0b1b40 con 0x7f8ecc13e870 2024-02-17T14:27:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.288+0000 7f8ed42dd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ecc0b0ee0 con 0x7f8ecc072810 2024-02-17T14:27:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.288+0000 7f8ed42dd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0b20e0 con 0x7f8ecc0b3160 2024-02-17T14:27:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.288+0000 7f8ed1878640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 0x7f8ecc1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.288+0000 7f8ed287a640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8ecc13e870 0x7f8ecc13ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41484/0 (socket says 172.21.15.142:41484) 2024-02-17T14:27:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.288+0000 7f8ed287a640 1 -- 172.21.15.142:0/3382793744 learned_addr learned my addr 172.21.15.142:0/3382793744 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-02-17T14:27:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.288+0000 7f8ed1878640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 0x7f8ecc1481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57742/0 (socket says 172.21.15.142:57742) 2024-02-17T14:27:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.288+0000 7f8ed2079640 1 --2- 172.21.15.142:0/3382793744 >> v2:172.21.15.134:3300/0 conn(0x7f8ecc072810 0x7f8ecc0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.288+0000 7f8ed1077640 1 -- 172.21.15.142:0/3382793744 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653403497 0 0) 0x7f8ecc0b1b40 con 0x7f8ecc13e870 2024-02-17T14:27:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.288+0000 7f8ed1878640 1 -- 172.21.15.142:0/3382793744 >> v2:172.21.15.134:3300/0 conn(0x7f8ecc072810 msgr2=0x7f8ecc0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.288+0000 7f8ed1878640 1 --2- 172.21.15.142:0/3382793744 >> v2:172.21.15.134:3300/0 conn(0x7f8ecc072810 0x7f8ecc0b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.288+0000 7f8ed1878640 1 -- 172.21.15.142:0/3382793744 >> v1:172.21.15.142:6789/0 conn(0x7f8ecc13e870 legacy=0x7f8ecc13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.288+0000 7f8ed1878640 1 -- 172.21.15.142:0/3382793744 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc072bf0 con 0x7f8ecc0b3160 2024-02-17T14:27:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.289+0000 7f8ed1878640 1 --2- 172.21.15.142:0/3382793744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 0x7f8ecc1481a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0097a0 tx=0x7f8ebc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f39f1d98d8286a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.289+0000 7f8ed1077640 1 -- 172.21.15.142:0/3382793744 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc031830 con 0x7f8ecc0b3160 2024-02-17T14:27:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.289+0000 7f8ed1077640 1 -- 172.21.15.142:0/3382793744 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc031990 con 0x7f8ecc0b3160 2024-02-17T14:27:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.289+0000 7f8ed1077640 1 -- 172.21.15.142:0/3382793744 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc031d20 con 0x7f8ecc0b3160 2024-02-17T14:27:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.290+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3382793744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 msgr2=0x7f8ecc1481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.290+0000 7f8ed42dd640 1 --2- 172.21.15.142:0/3382793744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 0x7f8ecc1481a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0097a0 tx=0x7f8ebc02b8d0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.290+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3382793744 shutdown_connections 2024-02-17T14:27:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.290+0000 7f8ed42dd640 1 --2- 172.21.15.142:0/3382793744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 0x7f8ecc1481a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.290+0000 7f8ed42dd640 1 --2- 172.21.15.142:0/3382793744 >> v2:172.21.15.134:3300/0 conn(0x7f8ecc072810 0x7f8ecc0b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.290+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3382793744 >> 172.21.15.142:0/3382793744 conn(0x7f8ecc0b9350 msgr2=0x7f8ecc0b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.290+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3382793744 shutdown_connections 2024-02-17T14:27:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.290+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3382793744 wait complete. 2024-02-17T14:27:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.291+0000 7f8ed42dd640 1 Processor -- start 2024-02-17T14:27:47.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.291+0000 7f8ed42dd640 1 -- start start 2024-02-17T14:27:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.291+0000 7f8ed42dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ecc072810 0x7f8ecc140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed42dd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 0x7f8ecc13f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed42dd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ecc13e870 0x7f8ecc070390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed42dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc140030 con 0x7f8ecc072810 2024-02-17T14:27:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed42dd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc141300 con 0x7f8ecc13e870 2024-02-17T14:27:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed42dd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc1420a0 con 0x7f8ecc0b3160 2024-02-17T14:27:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed1878640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 0x7f8ecc13f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed287a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ecc13e870 0x7f8ecc070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed1878640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 0x7f8ecc13f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57748/0 (socket says 172.21.15.142:57748) 2024-02-17T14:27:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed1878640 1 -- 172.21.15.142:0/3789831030 learned_addr learned my addr 172.21.15.142:0/3789831030 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-17T14:27:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed2079640 1 --2- 172.21.15.142:0/3789831030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ecc072810 0x7f8ecc140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed287a640 1 -- 172.21.15.142:0/3789831030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 msgr2=0x7f8ecc13f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed287a640 1 --2- 172.21.15.142:0/3789831030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 0x7f8ecc13f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed287a640 1 -- 172.21.15.142:0/3789831030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ecc072810 msgr2=0x7f8ecc140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed287a640 1 --2- 172.21.15.142:0/3789831030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ecc072810 0x7f8ecc140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed287a640 1 -- 172.21.15.142:0/3789831030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc009400 con 0x7f8ecc13e870 2024-02-17T14:27:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed1878640 1 --2- 172.21.15.142:0/3789831030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 0x7f8ecc13f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:27:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed2079640 1 --2- 172.21.15.142:0/3789831030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ecc072810 0x7f8ecc140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:27:47.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed287a640 1 --2- 172.21.15.142:0/3789831030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ecc13e870 0x7f8ecc070390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400c750 tx=0x7f8ec400cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ec2ffd640 1 -- 172.21.15.142:0/3789831030 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4004d60 con 0x7f8ecc13e870 2024-02-17T14:27:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ec2ffd640 1 -- 172.21.15.142:0/3789831030 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec400a640 con 0x7f8ecc13e870 2024-02-17T14:27:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ec2ffd640 1 -- 172.21.15.142:0/3789831030 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec400aa30 con 0x7f8ecc13e870 2024-02-17T14:27:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3789831030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc0b29f0 con 0x7f8ecc13e870 2024-02-17T14:27:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3789831030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc140c40 con 0x7f8ecc13e870 2024-02-17T14:27:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ec2ffd640 1 -- 172.21.15.142:0/3789831030 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f8ec400ab90 con 0x7f8ecc13e870 2024-02-17T14:27:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.292+0000 7f8ec2ffd640 1 -- 172.21.15.142:0/3789831030 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f8ec401d7f0 con 0x7f8ecc13e870 2024-02-17T14:27:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.293+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3789831030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc1401a0 con 0x7f8ecc13e870 2024-02-17T14:27:47.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.295+0000 7f8ec2ffd640 1 -- 172.21.15.142:0/3789831030 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f8ec4018070 con 0x7f8ecc13e870 2024-02-17T14:27:47.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.367+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3789831030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7f46f0ae-43cb-4075-8096-cf2928cae7cf", "id": 1} v 0) v1 -- 0x7f8ecc068280 con 0x7f8ecc13e870 2024-02-17T14:27:47.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.369+0000 7f8ec2ffd640 1 -- 172.21.15.142:0/3789831030 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f46f0ae-43cb-4075-8096-cf2928cae7cf", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ec401da00 con 0x7f8ecc13e870 2024-02-17T14:27:47.369 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-02-17T14:27:47.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.370+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3789831030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ecc13e870 msgr2=0x7f8ecc070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.370+0000 7f8ed42dd640 1 --2- 172.21.15.142:0/3789831030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ecc13e870 0x7f8ecc070390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400c750 tx=0x7f8ec400cc10 comp rx=0 tx=0).stop 2024-02-17T14:27:47.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.370+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3789831030 shutdown_connections 2024-02-17T14:27:47.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.370+0000 7f8ed42dd640 1 --2- 172.21.15.142:0/3789831030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ecc13e870 0x7f8ecc070390 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.370+0000 7f8ed42dd640 1 --2- 172.21.15.142:0/3789831030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ecc0b3160 0x7f8ecc13f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.370+0000 7f8ed42dd640 1 --2- 172.21.15.142:0/3789831030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ecc072810 0x7f8ecc140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.370+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3789831030 >> 172.21.15.142:0/3789831030 conn(0x7f8ecc0b9350 msgr2=0x7f8ecc13dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:47.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.371+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3789831030 shutdown_connections 2024-02-17T14:27:47.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.371+0000 7f8ed42dd640 1 -- 172.21.15.142:0/3789831030 wait complete. 2024-02-17T14:27:47.380 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 0d3cba9c-f40a-4f28-894d-359ced1fcb48 2 2024-02-17T14:27:47.462 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:47.463+0000 7fcc4223c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T14:27:47.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.482+0000 7f72cc655640 1 Processor -- start 2024-02-17T14:27:47.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.482+0000 7f72cc655640 1 -- start start 2024-02-17T14:27:47.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.483+0000 7f72cc655640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f72c409d2b0 0x7f72c409c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.483+0000 7f72cc655640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4146eb0 0x7f72c4147310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.483+0000 7f72cc655640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c40730f0 con 0x7f72c4147850 2024-02-17T14:27:47.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.483+0000 7f72cc655640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c409ddd0 con 0x7f72c409d2b0 2024-02-17T14:27:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.483+0000 7f72cc655640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c409c010 con 0x7f72c4146eb0 2024-02-17T14:27:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.483+0000 7f72c9bf0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4146eb0 0x7f72c4147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.483+0000 7f72c9bf0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4146eb0 0x7f72c4147310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57752/0 (socket says 172.21.15.142:57752) 2024-02-17T14:27:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.483+0000 7f72c9bf0640 1 -- 172.21.15.142:0/3106176937 learned_addr learned my addr 172.21.15.142:0/3106176937 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-17T14:27:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.483+0000 7f72ca3f1640 1 --2- 172.21.15.142:0/3106176937 >> v2:172.21.15.134:3300/0 conn(0x7f72c409d2b0 0x7f72c409c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.483+0000 7f72c9bf0640 1 -- 172.21.15.142:0/3106176937 >> v2:172.21.15.134:3300/0 conn(0x7f72c409d2b0 msgr2=0x7f72c409c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.483+0000 7f72c9bf0640 1 --2- 172.21.15.142:0/3106176937 >> v2:172.21.15.134:3300/0 conn(0x7f72c409d2b0 0x7f72c409c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.483+0000 7f72c9bf0640 1 -- 172.21.15.142:0/3106176937 >> v1:172.21.15.134:6789/0 conn(0x7f72c4147850 legacy=0x7f72c4099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.483+0000 7f72c9bf0640 1 -- 172.21.15.142:0/3106176937 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c4147ce0 con 0x7f72c4146eb0 2024-02-17T14:27:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.484+0000 7f72c9bf0640 1 --2- 172.21.15.142:0/3106176937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4146eb0 0x7f72c4147310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009870 tx=0x7f72c002cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99f68ba92abe84f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.484+0000 7f72c93ef640 1 -- 172.21.15.142:0/3106176937 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c002d9d0 con 0x7f72c4146eb0 2024-02-17T14:27:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.484+0000 7f72c93ef640 1 -- 172.21.15.142:0/3106176937 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c002db30 con 0x7f72c4146eb0 2024-02-17T14:27:47.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.484+0000 7f72c93ef640 1 -- 172.21.15.142:0/3106176937 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c0035440 con 0x7f72c4146eb0 2024-02-17T14:27:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.485+0000 7f72cc655640 1 -- 172.21.15.142:0/3106176937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4146eb0 msgr2=0x7f72c4147310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.485+0000 7f72cc655640 1 --2- 172.21.15.142:0/3106176937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4146eb0 0x7f72c4147310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009870 tx=0x7f72c002cc20 comp rx=0 tx=0).stop 2024-02-17T14:27:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.485+0000 7f72cc655640 1 -- 172.21.15.142:0/3106176937 shutdown_connections 2024-02-17T14:27:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.485+0000 7f72cc655640 1 --2- 172.21.15.142:0/3106176937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4146eb0 0x7f72c4147310 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.485+0000 7f72cc655640 1 --2- 172.21.15.142:0/3106176937 >> v2:172.21.15.134:3300/0 conn(0x7f72c409d2b0 0x7f72c409c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.485+0000 7f72cc655640 1 -- 172.21.15.142:0/3106176937 >> 172.21.15.142:0/3106176937 conn(0x7f72c40b8cb0 msgr2=0x7f72c40b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.485+0000 7f72cc655640 1 -- 172.21.15.142:0/3106176937 shutdown_connections 2024-02-17T14:27:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.485+0000 7f72cc655640 1 -- 172.21.15.142:0/3106176937 wait complete. 2024-02-17T14:27:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.486+0000 7f72cc655640 1 Processor -- start 2024-02-17T14:27:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.486+0000 7f72cc655640 1 -- start start 2024-02-17T14:27:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cc655640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c409d2b0 0x7f72c4070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cc655640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72c4146eb0 0x7f72c41df8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cc655640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4147850 0x7f72c41dfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cc655640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40725a0 con 0x7f72c4146eb0 2024-02-17T14:27:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cc655640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40b2ab0 con 0x7f72c409d2b0 2024-02-17T14:27:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cc655640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4070ad0 con 0x7f72c4147850 2024-02-17T14:27:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72ca3f1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c409d2b0 0x7f72c4070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cabf2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4147850 0x7f72c41dfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72ca3f1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c409d2b0 0x7f72c4070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43014/0 (socket says 172.21.15.142:43014) 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cabf2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4147850 0x7f72c41dfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57768/0 (socket says 172.21.15.142:57768) 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72ca3f1640 1 -- 172.21.15.142:0/2072338661 learned_addr learned my addr 172.21.15.142:0/2072338661 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72c9bf0640 1 --2- 172.21.15.142:0/2072338661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72c4146eb0 0x7f72c41df8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cabf2640 1 -- 172.21.15.142:0/2072338661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c409d2b0 msgr2=0x7f72c4070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cabf2640 1 --2- 172.21.15.142:0/2072338661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c409d2b0 0x7f72c4070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cabf2640 1 -- 172.21.15.142:0/2072338661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72c4146eb0 msgr2=0x7f72c41df8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cabf2640 1 --2- 172.21.15.142:0/2072338661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72c4146eb0 0x7f72c41df8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cabf2640 1 -- 172.21.15.142:0/2072338661 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00094d0 con 0x7f72c4147850 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72ca3f1640 1 --2- 172.21.15.142:0/2072338661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c409d2b0 0x7f72c4070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72cabf2640 1 --2- 172.21.15.142:0/2072338661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4147850 0x7f72c41dfde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00c700 tx=0x7f72bc00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72baffd640 1 -- 172.21.15.142:0/2072338661 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc003b70 con 0x7f72c4147850 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.487+0000 7f72baffd640 1 -- 172.21.15.142:0/2072338661 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc003cd0 con 0x7f72c4147850 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.488+0000 7f72cc655640 1 -- 172.21.15.142:0/2072338661 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c4071c70 con 0x7f72c4147850 2024-02-17T14:27:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.488+0000 7f72baffd640 1 -- 172.21.15.142:0/2072338661 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc005310 con 0x7f72c4147850 2024-02-17T14:27:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.488+0000 7f72cc655640 1 -- 172.21.15.142:0/2072338661 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c4070e20 con 0x7f72c4147850 2024-02-17T14:27:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.488+0000 7f72baffd640 1 -- 172.21.15.142:0/2072338661 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f72bc005470 con 0x7f72c4147850 2024-02-17T14:27:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.488+0000 7f72baffd640 1 -- 172.21.15.142:0/2072338661 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f72bc012840 con 0x7f72c4147850 2024-02-17T14:27:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.488+0000 7f72cc655640 1 -- 172.21.15.142:0/2072338661 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c4072710 con 0x7f72c4147850 2024-02-17T14:27:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.491+0000 7f72baffd640 1 -- 172.21.15.142:0/2072338661 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f72bc003e40 con 0x7f72c4147850 2024-02-17T14:27:47.490 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:47.491+0000 7fd0fde3e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T14:27:47.517 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:47.518+0000 7fcc4223c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T14:27:47.546 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:47.547+0000 7fd0fde3e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T14:27:47.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.563+0000 7f72cc655640 1 -- 172.21.15.142:0/2072338661 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0d3cba9c-f40a-4f28-894d-359ced1fcb48", "id": 2} v 0) v1 -- 0x7f72c4068280 con 0x7f72c4147850 2024-02-17T14:27:47.562 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:47.564+0000 7fcc4223c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T14:27:47.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.566+0000 7f72baffd640 1 -- 172.21.15.142:0/2072338661 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d3cba9c-f40a-4f28-894d-359ced1fcb48", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72bc012420 con 0x7f72c4147850 2024-02-17T14:27:47.565 INFO:teuthology.orchestra.run.smithi142.stdout:2 2024-02-17T14:27:47.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.567+0000 7f72cc655640 1 -- 172.21.15.142:0/2072338661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4147850 msgr2=0x7f72c41dfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.567+0000 7f72cc655640 1 --2- 172.21.15.142:0/2072338661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4147850 0x7f72c41dfde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00c700 tx=0x7f72bc00cbc0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.567+0000 7f72cc655640 1 -- 172.21.15.142:0/2072338661 shutdown_connections 2024-02-17T14:27:47.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.567+0000 7f72cc655640 1 --2- 172.21.15.142:0/2072338661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4147850 0x7f72c41dfde0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.567+0000 7f72cc655640 1 --2- 172.21.15.142:0/2072338661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72c4146eb0 0x7f72c41df8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.567+0000 7f72cc655640 1 --2- 172.21.15.142:0/2072338661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c409d2b0 0x7f72c4070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.567+0000 7f72cc655640 1 -- 172.21.15.142:0/2072338661 >> 172.21.15.142:0/2072338661 conn(0x7f72c40b8cb0 msgr2=0x7f72c406c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:47.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.567+0000 7f72cc655640 1 -- 172.21.15.142:0/2072338661 shutdown_connections 2024-02-17T14:27:47.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.567+0000 7f72cc655640 1 -- 172.21.15.142:0/2072338661 wait complete. 2024-02-17T14:27:47.577 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new b23b3526-bd03-408f-8bea-aa0b11b2fddf 3 2024-02-17T14:27:47.593 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:47.593+0000 7fd0fde3e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T14:27:47.617 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:47.618+0000 7fcc4223c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T14:27:47.649 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:47.650+0000 7fd0fde3e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T14:27:47.659 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:47.660+0000 7fcc4223c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T14:27:47.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.678+0000 7f277a1e2640 1 Processor -- start 2024-02-17T14:27:47.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.678+0000 7f277a1e2640 1 -- start start 2024-02-17T14:27:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.678+0000 7f277a1e2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2774070e20 0x7f27740b5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.678+0000 7f277a1e2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f27740b3440 0x7f27740b5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.678+0000 7f277a1e2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27741474e0 con 0x7f27740720e0 2024-02-17T14:27:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.678+0000 7f277a1e2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2774147720 con 0x7f27740b3440 2024-02-17T14:27:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.678+0000 7f277a1e2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2774147a00 con 0x7f2774070e20 2024-02-17T14:27:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.678+0000 7f2772ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2774070e20 0x7f27740b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.678+0000 7f27737fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f27740720e0 0x7f2774070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41496/0 (socket says 172.21.15.142:41496) 2024-02-17T14:27:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.678+0000 7f27737fe640 1 -- 172.21.15.142:0/2676667549 learned_addr learned my addr 172.21.15.142:0/2676667549 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-02-17T14:27:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.679+0000 7f2773fff640 1 --2- 172.21.15.142:0/2676667549 >> v2:172.21.15.134:3300/0 conn(0x7f27740b3440 0x7f27740b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.679+0000 7f27727fc640 1 -- 172.21.15.142:0/2676667549 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174401290 0 0) 0x7f2764001110 con 0x7f27740720e0 2024-02-17T14:27:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.679+0000 7f27727fc640 1 -- 172.21.15.142:0/2676667549 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f275c003520 con 0x7f27740720e0 2024-02-17T14:27:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.679+0000 7f2772ffd640 1 -- 172.21.15.142:0/2676667549 >> v2:172.21.15.134:3300/0 conn(0x7f27740b3440 msgr2=0x7f27740b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.679+0000 7f2772ffd640 1 --2- 172.21.15.142:0/2676667549 >> v2:172.21.15.134:3300/0 conn(0x7f27740b3440 0x7f27740b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.679+0000 7f2772ffd640 1 -- 172.21.15.142:0/2676667549 >> v1:172.21.15.142:6789/0 conn(0x7f27740720e0 legacy=0x7f2774070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.679+0000 7f2772ffd640 1 -- 172.21.15.142:0/2676667549 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2774147ce0 con 0x7f2774070e20 2024-02-17T14:27:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.679+0000 7f2772ffd640 1 --2- 172.21.15.142:0/2676667549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2774070e20 0x7f27740b5010 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f27680097a0 tx=0x7f276802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=825180b1e06c5906 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.680+0000 7f27727fc640 1 -- 172.21.15.142:0/2676667549 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768031780 con 0x7f2774070e20 2024-02-17T14:27:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.680+0000 7f27727fc640 1 -- 172.21.15.142:0/2676667549 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27680318e0 con 0x7f2774070e20 2024-02-17T14:27:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.680+0000 7f27727fc640 1 -- 172.21.15.142:0/2676667549 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768031c70 con 0x7f2774070e20 2024-02-17T14:27:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.680+0000 7f277a1e2640 1 -- 172.21.15.142:0/2676667549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2774070e20 msgr2=0x7f27740b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.680+0000 7f277a1e2640 1 --2- 172.21.15.142:0/2676667549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2774070e20 0x7f27740b5010 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f27680097a0 tx=0x7f276802b820 comp rx=0 tx=0).stop 2024-02-17T14:27:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.680+0000 7f277a1e2640 1 -- 172.21.15.142:0/2676667549 shutdown_connections 2024-02-17T14:27:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.680+0000 7f277a1e2640 1 --2- 172.21.15.142:0/2676667549 >> v2:172.21.15.134:3300/0 conn(0x7f27740b3440 0x7f27740b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.680+0000 7f277a1e2640 1 --2- 172.21.15.142:0/2676667549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2774070e20 0x7f27740b5010 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.680+0000 7f277a1e2640 1 -- 172.21.15.142:0/2676667549 >> 172.21.15.142:0/2676667549 conn(0x7f27740b9350 msgr2=0x7f27740b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.680+0000 7f277a1e2640 1 -- 172.21.15.142:0/2676667549 shutdown_connections 2024-02-17T14:27:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.680+0000 7f277a1e2640 1 -- 172.21.15.142:0/2676667549 wait complete. 2024-02-17T14:27:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.681+0000 7f277a1e2640 1 Processor -- start 2024-02-17T14:27:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.681+0000 7f277a1e2640 1 -- start start 2024-02-17T14:27:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f277a1e2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2774070e20 0x7f277406ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f277a1e2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27740720e0 0x7f27741424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f277a1e2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27740b3440 0x7f27741368f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f277a1e2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2774144080 con 0x7f27740720e0 2024-02-17T14:27:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f277a1e2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27741438a0 con 0x7f27740b3440 2024-02-17T14:27:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f277a1e2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27741442d0 con 0x7f2774070e20 2024-02-17T14:27:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f27737fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2774070e20 0x7f277406ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f2773fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27740b3440 0x7f27741368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f27737fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2774070e20 0x7f277406ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57788/0 (socket says 172.21.15.142:57788) 2024-02-17T14:27:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f27737fe640 1 -- 172.21.15.142:0/986717945 learned_addr learned my addr 172.21.15.142:0/986717945 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-17T14:27:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f2772ffd640 1 --2- 172.21.15.142:0/986717945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27740720e0 0x7f27741424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f2773fff640 1 -- 172.21.15.142:0/986717945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2774070e20 msgr2=0x7f277406ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f2773fff640 1 --2- 172.21.15.142:0/986717945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2774070e20 0x7f277406ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f2773fff640 1 -- 172.21.15.142:0/986717945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27740720e0 msgr2=0x7f27741424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f2773fff640 1 --2- 172.21.15.142:0/986717945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27740720e0 0x7f27741424a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f2773fff640 1 -- 172.21.15.142:0/986717945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2768009400 con 0x7f27740b3440 2024-02-17T14:27:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f27737fe640 1 --2- 172.21.15.142:0/986717945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2774070e20 0x7f277406ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:27:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.682+0000 7f2772ffd640 1 --2- 172.21.15.142:0/986717945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27740720e0 0x7f27741424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:27:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.683+0000 7f2773fff640 1 --2- 172.21.15.142:0/986717945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27740b3440 0x7f27741368f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f276c00eb80 tx=0x7f276c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.683+0000 7f275bfff640 1 -- 172.21.15.142:0/986717945 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c00cd20 con 0x7f27740b3440 2024-02-17T14:27:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.683+0000 7f275bfff640 1 -- 172.21.15.142:0/986717945 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c00f040 con 0x7f27740b3440 2024-02-17T14:27:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.683+0000 7f275bfff640 1 -- 172.21.15.142:0/986717945 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c00cea0 con 0x7f27740b3440 2024-02-17T14:27:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.683+0000 7f277a1e2640 1 -- 172.21.15.142:0/986717945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27741445b0 con 0x7f27740b3440 2024-02-17T14:27:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.683+0000 7f277a1e2640 1 -- 172.21.15.142:0/986717945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27741434e0 con 0x7f27740b3440 2024-02-17T14:27:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.683+0000 7f275bfff640 1 -- 172.21.15.142:0/986717945 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f276c014a50 con 0x7f27740b3440 2024-02-17T14:27:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.683+0000 7f275bfff640 1 -- 172.21.15.142:0/986717945 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f276c013870 con 0x7f27740b3440 2024-02-17T14:27:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.684+0000 7f277a1e2640 1 -- 172.21.15.142:0/986717945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2774068280 con 0x7f27740b3440 2024-02-17T14:27:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.688+0000 7f275bfff640 1 -- 172.21.15.142:0/986717945 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f276c03bdd0 con 0x7f27740b3440 2024-02-17T14:27:47.695 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:47.696+0000 7fd0fde3e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T14:27:47.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.759+0000 7f277a1e2640 1 -- 172.21.15.142:0/986717945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b23b3526-bd03-408f-8bea-aa0b11b2fddf", "id": 3} v 0) v1 -- 0x7f27740b8260 con 0x7f27740b3440 2024-02-17T14:27:47.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.765+0000 7f275bfff640 1 -- 172.21.15.142:0/986717945 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b23b3526-bd03-408f-8bea-aa0b11b2fddf", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f276c02a070 con 0x7f27740b3440 2024-02-17T14:27:47.764 INFO:teuthology.orchestra.run.smithi142.stdout:3 2024-02-17T14:27:47.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.766+0000 7f277a1e2640 1 -- 172.21.15.142:0/986717945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27740b3440 msgr2=0x7f27741368f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.766+0000 7f277a1e2640 1 --2- 172.21.15.142:0/986717945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27740b3440 0x7f27741368f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f276c00eb80 tx=0x7f276c00c490 comp rx=0 tx=0).stop 2024-02-17T14:27:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.766+0000 7f277a1e2640 1 -- 172.21.15.142:0/986717945 shutdown_connections 2024-02-17T14:27:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.766+0000 7f277a1e2640 1 --2- 172.21.15.142:0/986717945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27740b3440 0x7f27741368f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.766+0000 7f277a1e2640 1 --2- 172.21.15.142:0/986717945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27740720e0 0x7f27741424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.766+0000 7f277a1e2640 1 --2- 172.21.15.142:0/986717945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2774070e20 0x7f277406ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.766+0000 7f277a1e2640 1 -- 172.21.15.142:0/986717945 >> 172.21.15.142:0/986717945 conn(0x7f27740b9350 msgr2=0x7f27740b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.766+0000 7f277a1e2640 1 -- 172.21.15.142:0/986717945 shutdown_connections 2024-02-17T14:27:47.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.766+0000 7f277a1e2640 1 -- 172.21.15.142:0/986717945 wait complete. 2024-02-17T14:27:47.776 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 6467569a-b74d-4dc6-97e4-9fc8486ba038 4 2024-02-17T14:27:47.776 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:47.777+0000 7fcc4223c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-17T14:27:47.815 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:47.816+0000 7fd0fde3e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-17T14:27:47.845 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:47.846+0000 7fcc4223c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T14:27:47.888 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:47.889+0000 7fd0fde3e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T14:27:47.890 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:47.891+0000 7fcc4223c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T14:27:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.916+0000 7f1097577640 1 Processor -- start 2024-02-17T14:27:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.916+0000 7f1097577640 1 -- start start 2024-02-17T14:27:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1097577640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1090066b20 0x7f10900b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1097577640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1090070140 0x7f10900705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1097577640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1090140ce0 0x7f1090141170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1097577640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10900b49d0 con 0x7f1090066b20 2024-02-17T14:27:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1097577640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1090066f00 con 0x7f1090140ce0 2024-02-17T14:27:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1097577640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1090071f60 con 0x7f1090070140 2024-02-17T14:27:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1095b14640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1090140ce0 0x7f1090141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1094b12640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1090070140 0x7f10900705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1095b14640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1090140ce0 0x7f1090141170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43034/0 (socket says 172.21.15.142:43034) 2024-02-17T14:27:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1095b14640 1 -- 172.21.15.142:0/2060994724 learned_addr learned my addr 172.21.15.142:0/2060994724 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-17T14:27:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1095313640 1 --2- 172.21.15.142:0/2060994724 >> v2:172.21.15.134:3300/0 conn(0x7f1090066b20 0x7f10900b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1094b12640 1 -- 172.21.15.142:0/2060994724 >> v2:172.21.15.142:3300/0 conn(0x7f1090140ce0 msgr2=0x7f1090141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1094b12640 1 --2- 172.21.15.142:0/2060994724 >> v2:172.21.15.142:3300/0 conn(0x7f1090140ce0 0x7f1090141170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1094b12640 1 -- 172.21.15.142:0/2060994724 >> v2:172.21.15.134:3300/0 conn(0x7f1090066b20 msgr2=0x7f10900b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1094b12640 1 --2- 172.21.15.142:0/2060994724 >> v2:172.21.15.134:3300/0 conn(0x7f1090066b20 0x7f10900b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1094b12640 1 -- 172.21.15.142:0/2060994724 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1090072240 con 0x7f1090070140 2024-02-17T14:27:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.917+0000 7f1095b14640 1 --2- 172.21.15.142:0/2060994724 >> v2:172.21.15.142:3300/0 conn(0x7f1090140ce0 0x7f1090141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:27:47.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.918+0000 7f1094b12640 1 --2- 172.21.15.142:0/2060994724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1090070140 0x7f10900705a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f10900b5190 tx=0x7f108c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7278fae2ff89d01 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:47.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.918+0000 7f1083fff640 1 -- 172.21.15.142:0/2060994724 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c02e070 con 0x7f1090070140 2024-02-17T14:27:47.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.918+0000 7f1083fff640 1 -- 172.21.15.142:0/2060994724 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c0315a0 con 0x7f1090070140 2024-02-17T14:27:47.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.918+0000 7f1083fff640 1 -- 172.21.15.142:0/2060994724 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c031930 con 0x7f1090070140 2024-02-17T14:27:47.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.919+0000 7f1097577640 1 -- 172.21.15.142:0/2060994724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1090070140 msgr2=0x7f10900705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.919+0000 7f1097577640 1 --2- 172.21.15.142:0/2060994724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1090070140 0x7f10900705a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f10900b5190 tx=0x7f108c02b840 comp rx=0 tx=0).stop 2024-02-17T14:27:47.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.919+0000 7f1097577640 1 -- 172.21.15.142:0/2060994724 shutdown_connections 2024-02-17T14:27:47.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.919+0000 7f1097577640 1 --2- 172.21.15.142:0/2060994724 >> v2:172.21.15.142:3300/0 conn(0x7f1090140ce0 0x7f1090141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.919+0000 7f1097577640 1 --2- 172.21.15.142:0/2060994724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1090070140 0x7f10900705a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.919+0000 7f1097577640 1 --2- 172.21.15.142:0/2060994724 >> v2:172.21.15.134:3300/0 conn(0x7f1090066b20 0x7f10900b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.919+0000 7f1097577640 1 -- 172.21.15.142:0/2060994724 >> 172.21.15.142:0/2060994724 conn(0x7f10900b9320 msgr2=0x7f10900b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.919+0000 7f1097577640 1 -- 172.21.15.142:0/2060994724 shutdown_connections 2024-02-17T14:27:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.919+0000 7f1097577640 1 -- 172.21.15.142:0/2060994724 wait complete. 2024-02-17T14:27:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.920+0000 7f1097577640 1 Processor -- start 2024-02-17T14:27:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.920+0000 7f1097577640 1 -- start start 2024-02-17T14:27:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.920+0000 7f1097577640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1090066b20 0x7f1090141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.920+0000 7f1097577640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1090070140 0x7f10901422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.920+0000 7f1097577640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1090140ce0 0x7f10901dc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.920+0000 7f1097577640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1090146fe0 con 0x7f1090066b20 2024-02-17T14:27:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.920+0000 7f1097577640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1090143310 con 0x7f1090070140 2024-02-17T14:27:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.920+0000 7f1097577640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1090144430 con 0x7f1090140ce0 2024-02-17T14:27:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1094b12640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1090070140 0x7f10901422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1095b14640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1090140ce0 0x7f10901dc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1094b12640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1090070140 0x7f10901422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43050/0 (socket says 172.21.15.142:43050) 2024-02-17T14:27:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1094b12640 1 -- 172.21.15.142:0/1963294746 learned_addr learned my addr 172.21.15.142:0/1963294746 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-17T14:27:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1095313640 1 --2- 172.21.15.142:0/1963294746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1090066b20 0x7f1090141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1094b12640 1 -- 172.21.15.142:0/1963294746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1090140ce0 msgr2=0x7f10901dc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1094b12640 1 --2- 172.21.15.142:0/1963294746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1090140ce0 0x7f10901dc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1094b12640 1 -- 172.21.15.142:0/1963294746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1090066b20 msgr2=0x7f1090141d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1094b12640 1 --2- 172.21.15.142:0/1963294746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1090066b20 0x7f1090141d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1094b12640 1 -- 172.21.15.142:0/1963294746 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1088009b30 con 0x7f1090070140 2024-02-17T14:27:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1094b12640 1 --2- 172.21.15.142:0/1963294746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1090070140 0x7f10901422a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f108c000c00 tx=0x7f108c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1081ffb640 1 -- 172.21.15.142:0/1963294746 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c032840 con 0x7f1090070140 2024-02-17T14:27:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1081ffb640 1 -- 172.21.15.142:0/1963294746 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c031f00 con 0x7f1090070140 2024-02-17T14:27:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1097577640 1 -- 172.21.15.142:0/1963294746 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c009400 con 0x7f1090070140 2024-02-17T14:27:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1081ffb640 1 -- 172.21.15.142:0/1963294746 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c032c00 con 0x7f1090070140 2024-02-17T14:27:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.921+0000 7f1097577640 1 -- 172.21.15.142:0/1963294746 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1090143530 con 0x7f1090070140 2024-02-17T14:27:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.922+0000 7f1081ffb640 1 -- 172.21.15.142:0/1963294746 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f108c045780 con 0x7f1090070140 2024-02-17T14:27:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.922+0000 7f1081ffb640 1 -- 172.21.15.142:0/1963294746 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f108c04dcc0 con 0x7f1090070140 2024-02-17T14:27:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.922+0000 7f1097577640 1 -- 172.21.15.142:0/1963294746 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10900744c0 con 0x7f1090070140 2024-02-17T14:27:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.926+0000 7f1081ffb640 1 -- 172.21.15.142:0/1963294746 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f108c032d60 con 0x7f1090070140 2024-02-17T14:27:47.938 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:47.939+0000 7fd0fde3e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T14:27:47.942 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:47.944+0000 7fcc4223c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T14:27:47.990 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:47.991+0000 7fcc4223c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-17T14:27:47.992 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:47.993+0000 7fd0fde3e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T14:27:47.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:47.999+0000 7f1097577640 1 -- 172.21.15.142:0/1963294746 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6467569a-b74d-4dc6-97e4-9fc8486ba038", "id": 4} v 0) v1 -- 0x7f1090068280 con 0x7f1090070140 2024-02-17T14:27:48.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.005+0000 7f1081ffb640 1 -- 172.21.15.142:0/1963294746 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6467569a-b74d-4dc6-97e4-9fc8486ba038", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f108c045bc0 con 0x7f1090070140 2024-02-17T14:27:48.004 INFO:teuthology.orchestra.run.smithi142.stdout:4 2024-02-17T14:27:48.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.006+0000 7f1097577640 1 -- 172.21.15.142:0/1963294746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1090070140 msgr2=0x7f10901422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.006+0000 7f1097577640 1 --2- 172.21.15.142:0/1963294746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1090070140 0x7f10901422a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f108c000c00 tx=0x7f108c0046c0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.006+0000 7f1097577640 1 -- 172.21.15.142:0/1963294746 shutdown_connections 2024-02-17T14:27:48.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.006+0000 7f1097577640 1 --2- 172.21.15.142:0/1963294746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1090140ce0 0x7f10901dc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.006+0000 7f1097577640 1 --2- 172.21.15.142:0/1963294746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1090070140 0x7f10901422a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.006+0000 7f1097577640 1 --2- 172.21.15.142:0/1963294746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1090066b20 0x7f1090141d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.006+0000 7f1097577640 1 -- 172.21.15.142:0/1963294746 >> 172.21.15.142:0/1963294746 conn(0x7f10900b9320 msgr2=0x7f109013e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:48.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.006+0000 7f1097577640 1 -- 172.21.15.142:0/1963294746 shutdown_connections 2024-02-17T14:27:48.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.006+0000 7f1097577640 1 -- 172.21.15.142:0/1963294746 wait complete. 2024-02-17T14:27:48.015 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 349c3144-c5bc-4a98-96f9-7da56cc489a6 5 2024-02-17T14:27:48.042 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:48.043+0000 7fd0fde3e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-17T14:27:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.116+0000 7fd15faae640 1 Processor -- start 2024-02-17T14:27:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.116+0000 7fd15faae640 1 -- start start 2024-02-17T14:27:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.116+0000 7fd15faae640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1580ada50 0x7fd158140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.117+0000 7fd15faae640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1580b51f0 con 0x7fd158141090 2024-02-17T14:27:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.117+0000 7fd15faae640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1581475a0 con 0x7fd1580acb20 2024-02-17T14:27:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.117+0000 7fd15faae640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580b6640 con 0x7fd1580ada50 2024-02-17T14:27:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.117+0000 7fd15d049640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1580ada50 0x7fd158140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.117+0000 7fd15d84a640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd1580acb20 0x7fd158146e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41508/0 (socket says 172.21.15.142:41508) 2024-02-17T14:27:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.117+0000 7fd15d84a640 1 -- 172.21.15.142:0/2007491073 learned_addr learned my addr 172.21.15.142:0/2007491073 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-02-17T14:27:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.117+0000 7fd15c848640 1 -- 172.21.15.142:0/2007491073 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056139173 0 0) 0x7fd1581475a0 con 0x7fd1580acb20 2024-02-17T14:27:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.117+0000 7fd15d049640 1 -- 172.21.15.142:0/2007491073 >> v1:172.21.15.142:6789/0 conn(0x7fd1580acb20 legacy=0x7fd158146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.117+0000 7fd15d049640 1 -- 172.21.15.142:0/2007491073 >> v1:172.21.15.134:6789/0 conn(0x7fd158141090 legacy=0x7fd158151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.117+0000 7fd15d049640 1 -- 172.21.15.142:0/2007491073 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1580ad2b0 con 0x7fd1580ada50 2024-02-17T14:27:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.118+0000 7fd15d049640 1 --2- 172.21.15.142:0/2007491073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1580ada50 0x7fd158140b50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1480097d0 tx=0x7fd14802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4dc2bf5f2265dd1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.118+0000 7fd15c848640 1 -- 172.21.15.142:0/2007491073 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148031800 con 0x7fd1580ada50 2024-02-17T14:27:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.118+0000 7fd15c848640 1 -- 172.21.15.142:0/2007491073 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd148031960 con 0x7fd1580ada50 2024-02-17T14:27:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.118+0000 7fd15c848640 1 -- 172.21.15.142:0/2007491073 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148031cf0 con 0x7fd1580ada50 2024-02-17T14:27:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.118+0000 7fd15faae640 1 -- 172.21.15.142:0/2007491073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1580ada50 msgr2=0x7fd158140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.118+0000 7fd15faae640 1 --2- 172.21.15.142:0/2007491073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1580ada50 0x7fd158140b50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1480097d0 tx=0x7fd14802b8a0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.118+0000 7fd15faae640 1 -- 172.21.15.142:0/2007491073 shutdown_connections 2024-02-17T14:27:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.118+0000 7fd15faae640 1 --2- 172.21.15.142:0/2007491073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1580ada50 0x7fd158140b50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.118+0000 7fd15faae640 1 -- 172.21.15.142:0/2007491073 >> 172.21.15.142:0/2007491073 conn(0x7fd1580ba420 msgr2=0x7fd1580ba830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.119+0000 7fd15faae640 1 -- 172.21.15.142:0/2007491073 shutdown_connections 2024-02-17T14:27:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.119+0000 7fd15faae640 1 -- 172.21.15.142:0/2007491073 wait complete. 2024-02-17T14:27:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.119+0000 7fd15faae640 1 Processor -- start 2024-02-17T14:27:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.120+0000 7fd15faae640 1 -- start start 2024-02-17T14:27:48.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.120+0000 7fd15faae640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1580acb20 0x7fd1581dca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.120+0000 7fd15faae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1580ada50 0x7fd158149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.120+0000 7fd15faae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd158141090 0x7fd1580b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.120+0000 7fd15faae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1581dcf80 con 0x7fd1580ada50 2024-02-17T14:27:48.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.120+0000 7fd15faae640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580ae9c0 con 0x7fd158141090 2024-02-17T14:27:48.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.120+0000 7fd15faae640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1581e00e0 con 0x7fd1580acb20 2024-02-17T14:27:48.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.120+0000 7fd15d84a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1580acb20 0x7fd1581dca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.120+0000 7fd15d84a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1580acb20 0x7fd1581dca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57846/0 (socket says 172.21.15.142:57846) 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.120+0000 7fd15e04b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd158141090 0x7fd1580b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.120+0000 7fd15d84a640 1 -- 172.21.15.142:0/1039781599 learned_addr learned my addr 172.21.15.142:0/1039781599 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.120+0000 7fd15d049640 1 --2- 172.21.15.142:0/1039781599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1580ada50 0x7fd158149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd15d84a640 1 -- 172.21.15.142:0/1039781599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd158141090 msgr2=0x7fd1580b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd15d84a640 1 --2- 172.21.15.142:0/1039781599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd158141090 0x7fd1580b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd15d84a640 1 -- 172.21.15.142:0/1039781599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1580ada50 msgr2=0x7fd158149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd15d84a640 1 --2- 172.21.15.142:0/1039781599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1580ada50 0x7fd158149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd15d84a640 1 -- 172.21.15.142:0/1039781599 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd148009400 con 0x7fd1580acb20 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd15e04b640 1 --2- 172.21.15.142:0/1039781599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd158141090 0x7fd1580b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd15d84a640 1 --2- 172.21.15.142:0/1039781599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1580acb20 0x7fd1581dca40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd15400c760 tx=0x7fd15400cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd14e7fc640 1 -- 172.21.15.142:0/1039781599 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154007270 con 0x7fd1580acb20 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd14e7fc640 1 -- 172.21.15.142:0/1039781599 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1540073f0 con 0x7fd1580acb20 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd15faae640 1 -- 172.21.15.142:0/1039781599 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1581e0380 con 0x7fd1580acb20 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd14e7fc640 1 -- 172.21.15.142:0/1039781599 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154001d00 con 0x7fd1580acb20 2024-02-17T14:27:48.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd15faae640 1 -- 172.21.15.142:0/1039781599 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1581e0710 con 0x7fd1580acb20 2024-02-17T14:27:48.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd14e7fc640 1 -- 172.21.15.142:0/1039781599 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd1540057a0 con 0x7fd1580acb20 2024-02-17T14:27:48.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.121+0000 7fd14e7fc640 1 -- 172.21.15.142:0/1039781599 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd15400ac80 con 0x7fd1580acb20 2024-02-17T14:27:48.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.122+0000 7fd15faae640 1 -- 172.21.15.142:0/1039781599 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1581e08a0 con 0x7fd1580acb20 2024-02-17T14:27:48.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.124+0000 7fd14e7fc640 1 -- 172.21.15.142:0/1039781599 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd1581e08a0 con 0x7fd1580acb20 2024-02-17T14:27:48.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.196+0000 7fd15faae640 1 -- 172.21.15.142:0/1039781599 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "349c3144-c5bc-4a98-96f9-7da56cc489a6", "id": 5} v 0) v1 -- 0x7fd158068280 con 0x7fd1580acb20 2024-02-17T14:27:48.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.202+0000 7fd14e7fc640 1 -- 172.21.15.142:0/1039781599 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "349c3144-c5bc-4a98-96f9-7da56cc489a6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd154005be0 con 0x7fd1580acb20 2024-02-17T14:27:48.201 INFO:teuthology.orchestra.run.smithi142.stdout:5 2024-02-17T14:27:48.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.202+0000 7fd15faae640 1 -- 172.21.15.142:0/1039781599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1580acb20 msgr2=0x7fd1581dca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.202+0000 7fd15faae640 1 --2- 172.21.15.142:0/1039781599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1580acb20 0x7fd1581dca40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd15400c760 tx=0x7fd15400cc20 comp rx=0 tx=0).stop 2024-02-17T14:27:48.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.203+0000 7fd15faae640 1 -- 172.21.15.142:0/1039781599 shutdown_connections 2024-02-17T14:27:48.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.203+0000 7fd15faae640 1 --2- 172.21.15.142:0/1039781599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd158141090 0x7fd1580b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.203+0000 7fd15faae640 1 --2- 172.21.15.142:0/1039781599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1580ada50 0x7fd158149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.203+0000 7fd15faae640 1 --2- 172.21.15.142:0/1039781599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1580acb20 0x7fd1581dca40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.203+0000 7fd15faae640 1 -- 172.21.15.142:0/1039781599 >> 172.21.15.142:0/1039781599 conn(0x7fd1580ba420 msgr2=0x7fd15813d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:48.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.203+0000 7fd15faae640 1 -- 172.21.15.142:0/1039781599 shutdown_connections 2024-02-17T14:27:48.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.203+0000 7fd15faae640 1 -- 172.21.15.142:0/1039781599 wait complete. 2024-02-17T14:27:48.212 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new d9e80b9b-4def-47f9-8807-43f245f76eb8 6 2024-02-17T14:27:48.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.355+0000 7efe4596c640 1 Processor -- start 2024-02-17T14:27:48.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.355+0000 7efe4596c640 1 -- start start 2024-02-17T14:27:48.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe4596c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efe400b4de0 0x7efe40070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe4596c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efe40140a90 0x7efe40140e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe4596c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4006b1f0 con 0x7efe4006ae10 2024-02-17T14:27:48.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe4596c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe40071850 con 0x7efe40140a90 2024-02-17T14:27:48.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe4596c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe40073240 con 0x7efe400b4de0 2024-02-17T14:27:48.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe3e7fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efe400b4de0 0x7efe40070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe3effd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7efe4006ae10 0x7efe400afe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41510/0 (socket says 172.21.15.142:41510) 2024-02-17T14:27:48.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe3e7fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efe400b4de0 0x7efe40070ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43074/0 (socket says 172.21.15.142:43074) 2024-02-17T14:27:48.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe3effd640 1 -- 172.21.15.142:0/608136238 learned_addr learned my addr 172.21.15.142:0/608136238 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-02-17T14:27:48.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe3f7fe640 1 --2- 172.21.15.142:0/608136238 >> v2:172.21.15.134:3300/0 conn(0x7efe40140a90 0x7efe40140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe3e7fc640 1 -- 172.21.15.142:0/608136238 >> v2:172.21.15.134:3300/0 conn(0x7efe40140a90 msgr2=0x7efe40140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:48.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe3e7fc640 1 --2- 172.21.15.142:0/608136238 >> v2:172.21.15.134:3300/0 conn(0x7efe40140a90 0x7efe40140e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe3e7fc640 1 -- 172.21.15.142:0/608136238 >> v1:172.21.15.142:6789/0 conn(0x7efe4006ae10 legacy=0x7efe400afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.356+0000 7efe3e7fc640 1 -- 172.21.15.142:0/608136238 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe40072c80 con 0x7efe400b4de0 2024-02-17T14:27:48.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.357+0000 7efe3e7fc640 1 --2- 172.21.15.142:0/608136238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe400b4de0 0x7efe40070ef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efe40070320 tx=0x7efe3002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1967eb05854e1bcd server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:48.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.357+0000 7efe3dffb640 1 -- 172.21.15.142:0/608136238 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3002e070 con 0x7efe400b4de0 2024-02-17T14:27:48.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.357+0000 7efe3dffb640 1 -- 172.21.15.142:0/608136238 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe300315a0 con 0x7efe400b4de0 2024-02-17T14:27:48.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.357+0000 7efe3dffb640 1 -- 172.21.15.142:0/608136238 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30031930 con 0x7efe400b4de0 2024-02-17T14:27:48.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.358+0000 7efe4596c640 1 -- 172.21.15.142:0/608136238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe400b4de0 msgr2=0x7efe40070ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.358+0000 7efe4596c640 1 --2- 172.21.15.142:0/608136238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe400b4de0 0x7efe40070ef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efe40070320 tx=0x7efe3002b840 comp rx=0 tx=0).stop 2024-02-17T14:27:48.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.358+0000 7efe4596c640 1 -- 172.21.15.142:0/608136238 shutdown_connections 2024-02-17T14:27:48.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.358+0000 7efe4596c640 1 --2- 172.21.15.142:0/608136238 >> v2:172.21.15.134:3300/0 conn(0x7efe40140a90 0x7efe40140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.358+0000 7efe4596c640 1 --2- 172.21.15.142:0/608136238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe400b4de0 0x7efe40070ef0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.358+0000 7efe4596c640 1 -- 172.21.15.142:0/608136238 >> 172.21.15.142:0/608136238 conn(0x7efe400b9350 msgr2=0x7efe400b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:48.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.358+0000 7efe4596c640 1 -- 172.21.15.142:0/608136238 shutdown_connections 2024-02-17T14:27:48.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.358+0000 7efe4596c640 1 -- 172.21.15.142:0/608136238 wait complete. 2024-02-17T14:27:48.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.359+0000 7efe4596c640 1 Processor -- start 2024-02-17T14:27:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.359+0000 7efe4596c640 1 -- start start 2024-02-17T14:27:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.359+0000 7efe4596c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4006ae10 0x7efe401464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.359+0000 7efe4596c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe400b4de0 0x7efe401dfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.359+0000 7efe4596c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe40140a90 0x7efe40137e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.359+0000 7efe4596c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe40146060 con 0x7efe4006ae10 2024-02-17T14:27:48.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.359+0000 7efe4596c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe40145d30 con 0x7efe400b4de0 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.359+0000 7efe4596c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe401479a0 con 0x7efe40140a90 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe3e7fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe400b4de0 0x7efe401dfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe3f7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe40140a90 0x7efe40137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe3e7fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe400b4de0 0x7efe401dfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43086/0 (socket says 172.21.15.142:43086) 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe3e7fc640 1 -- 172.21.15.142:0/1274572524 learned_addr learned my addr 172.21.15.142:0/1274572524 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe3effd640 1 --2- 172.21.15.142:0/1274572524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4006ae10 0x7efe401464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe3effd640 1 -- 172.21.15.142:0/1274572524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe40140a90 msgr2=0x7efe40137e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe3effd640 1 --2- 172.21.15.142:0/1274572524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe40140a90 0x7efe40137e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe3effd640 1 -- 172.21.15.142:0/1274572524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe400b4de0 msgr2=0x7efe401dfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe3effd640 1 --2- 172.21.15.142:0/1274572524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe400b4de0 0x7efe401dfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe3effd640 1 -- 172.21.15.142:0/1274572524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30009400 con 0x7efe4006ae10 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe3e7fc640 1 --2- 172.21.15.142:0/1274572524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe400b4de0 0x7efe401dfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe3f7fe640 1 --2- 172.21.15.142:0/1274572524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe40140a90 0x7efe40137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:27:48.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe3effd640 1 --2- 172.21.15.142:0/1274572524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4006ae10 0x7efe401464f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efe34000f60 tx=0x7efe3400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:48.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe27fff640 1 -- 172.21.15.142:0/1274572524 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34005ce0 con 0x7efe4006ae10 2024-02-17T14:27:48.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe27fff640 1 -- 172.21.15.142:0/1274572524 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe34005e40 con 0x7efe4006ae10 2024-02-17T14:27:48.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe27fff640 1 -- 172.21.15.142:0/1274572524 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34007310 con 0x7efe4006ae10 2024-02-17T14:27:48.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe4596c640 1 -- 172.21.15.142:0/1274572524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe400ad640 con 0x7efe4006ae10 2024-02-17T14:27:48.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe4596c640 1 -- 172.21.15.142:0/1274572524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe40147220 con 0x7efe4006ae10 2024-02-17T14:27:48.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe27fff640 1 -- 172.21.15.142:0/1274572524 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7efe34007470 con 0x7efe4006ae10 2024-02-17T14:27:48.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.360+0000 7efe27fff640 1 -- 172.21.15.142:0/1274572524 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7efe340129f0 con 0x7efe4006ae10 2024-02-17T14:27:48.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.361+0000 7efe4596c640 1 -- 172.21.15.142:0/1274572524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe40145ea0 con 0x7efe4006ae10 2024-02-17T14:27:48.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.363+0000 7efe27fff640 1 -- 172.21.15.142:0/1274572524 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7efe40145ea0 con 0x7efe4006ae10 2024-02-17T14:27:48.374 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:48.375+0000 7fcc4223c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-17T14:27:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.436+0000 7efe4596c640 1 -- 172.21.15.142:0/1274572524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d9e80b9b-4def-47f9-8807-43f245f76eb8", "id": 6} v 0) v1 -- 0x7efe40068280 con 0x7efe4006ae10 2024-02-17T14:27:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.440+0000 7efe27fff640 1 -- 172.21.15.142:0/1274572524 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d9e80b9b-4def-47f9-8807-43f245f76eb8", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7efe34017070 con 0x7efe4006ae10 2024-02-17T14:27:48.439 INFO:teuthology.orchestra.run.smithi142.stdout:6 2024-02-17T14:27:48.440 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:48.441+0000 7fd0fde3e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-17T14:27:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.441+0000 7efe4596c640 1 -- 172.21.15.142:0/1274572524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4006ae10 msgr2=0x7efe401464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.441+0000 7efe4596c640 1 --2- 172.21.15.142:0/1274572524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4006ae10 0x7efe401464f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efe34000f60 tx=0x7efe3400c800 comp rx=0 tx=0).stop 2024-02-17T14:27:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.441+0000 7efe4596c640 1 -- 172.21.15.142:0/1274572524 shutdown_connections 2024-02-17T14:27:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.441+0000 7efe4596c640 1 --2- 172.21.15.142:0/1274572524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe40140a90 0x7efe40137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.441+0000 7efe4596c640 1 --2- 172.21.15.142:0/1274572524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe400b4de0 0x7efe401dfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.441+0000 7efe4596c640 1 --2- 172.21.15.142:0/1274572524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe4006ae10 0x7efe401464f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.441+0000 7efe4596c640 1 -- 172.21.15.142:0/1274572524 >> 172.21.15.142:0/1274572524 conn(0x7efe400b9350 msgr2=0x7efe400b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.441+0000 7efe4596c640 1 -- 172.21.15.142:0/1274572524 shutdown_connections 2024-02-17T14:27:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.441+0000 7efe4596c640 1 -- 172.21.15.142:0/1274572524 wait complete. 2024-02-17T14:27:48.450 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e 7 2024-02-17T14:27:48.510 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:48.511+0000 7fcc4223c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T14:27:48.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.550+0000 7fcefcb0f640 1 Processor -- start 2024-02-17T14:27:48.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.550+0000 7fcefcb0f640 1 -- start start 2024-02-17T14:27:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.551+0000 7fcefcb0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef80b51e0 0x7fcef80ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.551+0000 7fcefcb0f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcef8148b40 0x7fcef814f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.551+0000 7fcefcb0f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80b6520 con 0x7fcef80b21d0 2024-02-17T14:27:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.551+0000 7fcefcb0f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef80b5d70 con 0x7fcef8148b40 2024-02-17T14:27:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.551+0000 7fcefcb0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80b26e0 con 0x7fcef80b51e0 2024-02-17T14:27:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.551+0000 7fcef659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef80b51e0 0x7fcef80ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.551+0000 7fcef6d9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcef8148b40 0x7fcef814f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.551+0000 7fcef6d9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcef8148b40 0x7fcef814f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43100/0 (socket says 172.21.15.142:43100) 2024-02-17T14:27:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.551+0000 7fcef659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef80b51e0 0x7fcef80ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57860/0 (socket says 172.21.15.142:57860) 2024-02-17T14:27:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.551+0000 7fcef6d9d640 1 -- 172.21.15.142:0/1732430298 learned_addr learned my addr 172.21.15.142:0/1732430298 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-17T14:27:48.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.552+0000 7fcef659c640 1 -- 172.21.15.142:0/1732430298 >> v2:172.21.15.142:3300/0 conn(0x7fcef8148b40 msgr2=0x7fcef814f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.552+0000 7fcef659c640 1 --2- 172.21.15.142:0/1732430298 >> v2:172.21.15.142:3300/0 conn(0x7fcef8148b40 0x7fcef814f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.552+0000 7fcef659c640 1 -- 172.21.15.142:0/1732430298 >> v1:172.21.15.134:6789/0 conn(0x7fcef80b21d0 legacy=0x7fcef8148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.552+0000 7fcef659c640 1 -- 172.21.15.142:0/1732430298 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80b29c0 con 0x7fcef80b51e0 2024-02-17T14:27:48.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.552+0000 7fcef6d9d640 1 --2- 172.21.15.142:0/1732430298 >> v2:172.21.15.142:3300/0 conn(0x7fcef8148b40 0x7fcef814f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:27:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.552+0000 7fcef659c640 1 --2- 172.21.15.142:0/1732430298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef80b51e0 0x7fcef80ad700 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fceec009790 tx=0x7fceec02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faee4c4479ececd4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.552+0000 7fcef559a640 1 -- 172.21.15.142:0/1732430298 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec0316f0 con 0x7fcef80b51e0 2024-02-17T14:27:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.552+0000 7fcef559a640 1 -- 172.21.15.142:0/1732430298 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec031850 con 0x7fcef80b51e0 2024-02-17T14:27:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.552+0000 7fcef559a640 1 -- 172.21.15.142:0/1732430298 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec031be0 con 0x7fcef80b51e0 2024-02-17T14:27:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.553+0000 7fcefcb0f640 1 -- 172.21.15.142:0/1732430298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef80b51e0 msgr2=0x7fcef80ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.553+0000 7fcefcb0f640 1 --2- 172.21.15.142:0/1732430298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef80b51e0 0x7fcef80ad700 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fceec009790 tx=0x7fceec02b790 comp rx=0 tx=0).stop 2024-02-17T14:27:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.553+0000 7fcefcb0f640 1 -- 172.21.15.142:0/1732430298 shutdown_connections 2024-02-17T14:27:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.553+0000 7fcefcb0f640 1 --2- 172.21.15.142:0/1732430298 >> v2:172.21.15.142:3300/0 conn(0x7fcef8148b40 0x7fcef814f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.553+0000 7fcefcb0f640 1 --2- 172.21.15.142:0/1732430298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef80b51e0 0x7fcef80ad700 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.553+0000 7fcefcb0f640 1 -- 172.21.15.142:0/1732430298 >> 172.21.15.142:0/1732430298 conn(0x7fcef80ba420 msgr2=0x7fcef80ba830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.553+0000 7fcefcb0f640 1 -- 172.21.15.142:0/1732430298 shutdown_connections 2024-02-17T14:27:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.553+0000 7fcefcb0f640 1 -- 172.21.15.142:0/1732430298 wait complete. 2024-02-17T14:27:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.554+0000 7fcefcb0f640 1 Processor -- start 2024-02-17T14:27:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.554+0000 7fcefcb0f640 1 -- start start 2024-02-17T14:27:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcefcb0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcef80b51e0 0x7fcef8144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcefcb0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef8148b40 0x7fcef81dfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcefcb0f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcef81ce5f0 0x7fcef8140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcefcb0f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef806dd80 con 0x7fcef81ce5f0 2024-02-17T14:27:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcefcb0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef806c0b0 con 0x7fcef80b51e0 2024-02-17T14:27:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcefcb0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef81cead0 con 0x7fcef8148b40 2024-02-17T14:27:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcef659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcef80b51e0 0x7fcef8144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcef5d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef8148b40 0x7fcef81dfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcef5d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef8148b40 0x7fcef81dfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:57870/0 (socket says 172.21.15.142:57870) 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcef659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcef80b51e0 0x7fcef8144660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43116/0 (socket says 172.21.15.142:43116) 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcef5d9b640 1 -- 172.21.15.142:0/4224305414 learned_addr learned my addr 172.21.15.142:0/4224305414 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcef6d9d640 1 --2- 172.21.15.142:0/4224305414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcef81ce5f0 0x7fcef8140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcef659c640 1 -- 172.21.15.142:0/4224305414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef8148b40 msgr2=0x7fcef81dfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcef659c640 1 --2- 172.21.15.142:0/4224305414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef8148b40 0x7fcef81dfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcef659c640 1 -- 172.21.15.142:0/4224305414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcef81ce5f0 msgr2=0x7fcef8140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcef659c640 1 --2- 172.21.15.142:0/4224305414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcef81ce5f0 0x7fcef8140c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcef659c640 1 -- 172.21.15.142:0/4224305414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef0009b30 con 0x7fcef80b51e0 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcef5d9b640 1 --2- 172.21.15.142:0/4224305414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef8148b40 0x7fcef81dfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.555+0000 7fcef659c640 1 --2- 172.21.15.142:0/4224305414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcef80b51e0 0x7fcef8144660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fceec033000 tx=0x7fceec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.556+0000 7fcee6ffd640 1 -- 172.21.15.142:0/4224305414 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec005b90 con 0x7fcef80b51e0 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.556+0000 7fcee6ffd640 1 -- 172.21.15.142:0/4224305414 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec005d30 con 0x7fcef80b51e0 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.556+0000 7fcefcb0f640 1 -- 172.21.15.142:0/4224305414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec0093a0 con 0x7fcef80b51e0 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.556+0000 7fcee6ffd640 1 -- 172.21.15.142:0/4224305414 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec005ea0 con 0x7fcef80b51e0 2024-02-17T14:27:48.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.556+0000 7fcefcb0f640 1 -- 172.21.15.142:0/4224305414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef806daa0 con 0x7fcef80b51e0 2024-02-17T14:27:48.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.556+0000 7fcee6ffd640 1 -- 172.21.15.142:0/4224305414 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fceec03b040 con 0x7fcef80b51e0 2024-02-17T14:27:48.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.556+0000 7fcee6ffd640 1 -- 172.21.15.142:0/4224305414 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fceec048400 con 0x7fcef80b51e0 2024-02-17T14:27:48.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.557+0000 7fcefcb0f640 1 -- 172.21.15.142:0/4224305414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef80b6d10 con 0x7fcef80b51e0 2024-02-17T14:27:48.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.559+0000 7fcee6ffd640 1 -- 172.21.15.142:0/4224305414 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fceec04d060 con 0x7fcef80b51e0 2024-02-17T14:27:48.580 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:48.581+0000 7fd0fde3e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T14:27:48.618 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:48.619+0000 7fcc4223c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T14:27:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.629+0000 7fcefcb0f640 1 -- 172.21.15.142:0/4224305414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e", "id": 7} v 0) v1 -- 0x7fcef8068280 con 0x7fcef80b51e0 2024-02-17T14:27:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.637+0000 7fcee6ffd640 1 -- 172.21.15.142:0/4224305414 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fceec044070 con 0x7fcef80b51e0 2024-02-17T14:27:48.637 INFO:teuthology.orchestra.run.smithi142.stdout:7 2024-02-17T14:27:48.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.638+0000 7fcefcb0f640 1 -- 172.21.15.142:0/4224305414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcef80b51e0 msgr2=0x7fcef8144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.638+0000 7fcefcb0f640 1 --2- 172.21.15.142:0/4224305414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcef80b51e0 0x7fcef8144660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fceec033000 tx=0x7fceec0046c0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.638+0000 7fcefcb0f640 1 -- 172.21.15.142:0/4224305414 shutdown_connections 2024-02-17T14:27:48.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.638+0000 7fcefcb0f640 1 --2- 172.21.15.142:0/4224305414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcef81ce5f0 0x7fcef8140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.638+0000 7fcefcb0f640 1 --2- 172.21.15.142:0/4224305414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef8148b40 0x7fcef81dfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.638+0000 7fcefcb0f640 1 --2- 172.21.15.142:0/4224305414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcef80b51e0 0x7fcef8144660 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.638+0000 7fcefcb0f640 1 -- 172.21.15.142:0/4224305414 >> 172.21.15.142:0/4224305414 conn(0x7fcef80ba420 msgr2=0x7fcef80b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:48.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.638+0000 7fcefcb0f640 1 -- 172.21.15.142:0/4224305414 shutdown_connections 2024-02-17T14:27:48.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-17T14:27:48.638+0000 7fcefcb0f640 1 -- 172.21.15.142:0/4224305414 wait complete. 2024-02-17T14:27:48.647 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-17T14:27:48.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-17T14:27:48.650 INFO:tasks.ceph.osd.0:Started 2024-02-17T14:27:48.650 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-17T14:27:48.650 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-17T14:27:48.653 INFO:tasks.ceph.osd.1:Started 2024-02-17T14:27:48.653 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-17T14:27:48.653 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-17T14:27:48.655 INFO:tasks.ceph.osd.2:Started 2024-02-17T14:27:48.655 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-17T14:27:48.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-17T14:27:48.657 INFO:tasks.ceph.osd.3:Started 2024-02-17T14:27:48.657 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-17T14:27:48.657 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-02-17T14:27:48.659 INFO:tasks.ceph.osd.4:Started 2024-02-17T14:27:48.659 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-17T14:27:48.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-02-17T14:27:48.662 INFO:tasks.ceph.osd.5:Started 2024-02-17T14:27:48.662 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-17T14:27:48.662 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-02-17T14:27:48.664 INFO:tasks.ceph.osd.6:Started 2024-02-17T14:27:48.664 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-17T14:27:48.664 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-02-17T14:27:48.666 INFO:tasks.ceph.osd.7:Started 2024-02-17T14:27:48.667 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:27:48.668 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:48.669+0000 7fcc4223c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T14:27:48.718 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:48.719+0000 7fd0fde3e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T14:27:48.780 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:48.780+0000 7fd0fde3e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T14:27:48.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.793+0000 7f3fdbfeb640 1 Processor -- start 2024-02-17T14:27:48.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.793+0000 7f3fdbfeb640 1 -- start start 2024-02-17T14:27:48.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.794+0000 7f3fdbfeb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3fd4144960 0x7f3fd40b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.794+0000 7f3fdbfeb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3fd409b190 0x7f3fd41517d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.794+0000 7f3fdbfeb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd414aaf0 con 0x7f3fd414a710 2024-02-17T14:27:48.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.794+0000 7f3fdbfeb640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd409c280 con 0x7f3fd4144960 2024-02-17T14:27:48.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.794+0000 7f3fdbfeb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd409b5c0 con 0x7f3fd409b190 2024-02-17T14:27:48.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.794+0000 7f3fd9586640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3fd4144960 0x7f3fd40b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.794+0000 7f3fd9586640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3fd4144960 0x7f3fd40b6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34476/0 (socket says 172.21.15.134:34476) 2024-02-17T14:27:48.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.794+0000 7f3fd9586640 1 -- 172.21.15.134:0/505045230 learned_addr learned my addr 172.21.15.134:0/505045230 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:27:48.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.794+0000 7f3fda588640 1 --2- 172.21.15.134:0/505045230 >> v2:172.21.15.142:3300/0 conn(0x7f3fd409b190 0x7f3fd41517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.794+0000 7f3fd9586640 1 -- 172.21.15.134:0/505045230 >> v2:172.21.15.142:3300/0 conn(0x7f3fd409b190 msgr2=0x7f3fd41517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:48.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.794+0000 7f3fd9586640 1 --2- 172.21.15.134:0/505045230 >> v2:172.21.15.142:3300/0 conn(0x7f3fd409b190 0x7f3fd41517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.794+0000 7f3fd9586640 1 -- 172.21.15.134:0/505045230 >> v1:172.21.15.142:6789/0 conn(0x7f3fd414a710 legacy=0x7f3fd4144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.794+0000 7f3fd9586640 1 -- 172.21.15.134:0/505045230 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd409c4f0 con 0x7f3fd4144960 2024-02-17T14:27:48.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.795+0000 7f3fd9586640 1 --2- 172.21.15.134:0/505045230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4144960 0x7f3fd40b6fc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40b00a0 tx=0x7f3fd002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16436e0170c8e96c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:48.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.795+0000 7f3fd8d85640 1 -- 172.21.15.134:0/505045230 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0031870 con 0x7f3fd4144960 2024-02-17T14:27:48.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.795+0000 7f3fd8d85640 1 -- 172.21.15.134:0/505045230 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd00319d0 con 0x7f3fd4144960 2024-02-17T14:27:48.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.795+0000 7f3fd8d85640 1 -- 172.21.15.134:0/505045230 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0031d60 con 0x7f3fd4144960 2024-02-17T14:27:48.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.796+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/505045230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4144960 msgr2=0x7f3fd40b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.796+0000 7f3fdbfeb640 1 --2- 172.21.15.134:0/505045230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4144960 0x7f3fd40b6fc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40b00a0 tx=0x7f3fd002b910 comp rx=0 tx=0).stop 2024-02-17T14:27:48.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.796+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/505045230 shutdown_connections 2024-02-17T14:27:48.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.796+0000 7f3fdbfeb640 1 --2- 172.21.15.134:0/505045230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd4144960 0x7f3fd40b6fc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.796+0000 7f3fdbfeb640 1 --2- 172.21.15.134:0/505045230 >> v2:172.21.15.142:3300/0 conn(0x7f3fd409b190 0x7f3fd41517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.796+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/505045230 >> 172.21.15.134:0/505045230 conn(0x7f3fd40b90c0 msgr2=0x7f3fd40b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:48.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.796+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/505045230 shutdown_connections 2024-02-17T14:27:48.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.796+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/505045230 wait complete. 2024-02-17T14:27:48.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.797+0000 7f3fdbfeb640 1 Processor -- start 2024-02-17T14:27:48.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.797+0000 7f3fdbfeb640 1 -- start start 2024-02-17T14:27:48.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fdbfeb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fd409b190 0x7f3fd40b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fdbfeb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fd4144960 0x7f3fd41dfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fdbfeb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd414a710 0x7f3fd413f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:48.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fdbfeb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd4147180 con 0x7f3fd414a710 2024-02-17T14:27:48.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fdbfeb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd40b4e30 con 0x7f3fd4144960 2024-02-17T14:27:48.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fdbfeb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd4147610 con 0x7f3fd409b190 2024-02-17T14:27:48.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fda588640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd414a710 0x7f3fd413f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fda588640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd414a710 0x7f3fd413f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34486/0 (socket says 172.21.15.134:34486) 2024-02-17T14:27:48.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fda588640 1 -- 172.21.15.134:0/4058226841 learned_addr learned my addr 172.21.15.134:0/4058226841 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:27:48.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fd9586640 1 --2- 172.21.15.134:0/4058226841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fd4144960 0x7f3fd41dfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fd9d87640 1 --2- 172.21.15.134:0/4058226841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fd409b190 0x7f3fd40b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:48.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fda588640 1 -- 172.21.15.134:0/4058226841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fd409b190 msgr2=0x7f3fd40b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fda588640 1 --2- 172.21.15.134:0/4058226841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fd409b190 0x7f3fd40b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fda588640 1 -- 172.21.15.134:0/4058226841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fd4144960 msgr2=0x7f3fd41dfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fda588640 1 --2- 172.21.15.134:0/4058226841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fd4144960 0x7f3fd41dfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fda588640 1 -- 172.21.15.134:0/4058226841 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd00094d0 con 0x7f3fd414a710 2024-02-17T14:27:48.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.798+0000 7f3fda588640 1 --2- 172.21.15.134:0/4058226841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd414a710 0x7f3fd413f4a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009dd0 tx=0x7f3fcc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:48.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.799+0000 7f3fca7fc640 1 -- 172.21.15.134:0/4058226841 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc014480 con 0x7f3fd414a710 2024-02-17T14:27:48.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.799+0000 7f3fca7fc640 1 -- 172.21.15.134:0/4058226841 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc00f040 con 0x7f3fd414a710 2024-02-17T14:27:48.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.799+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/4058226841 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd40b5110 con 0x7f3fd414a710 2024-02-17T14:27:48.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.799+0000 7f3fca7fc640 1 -- 172.21.15.134:0/4058226841 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc014840 con 0x7f3fd414a710 2024-02-17T14:27:48.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.799+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/4058226841 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd41e0120 con 0x7f3fd414a710 2024-02-17T14:27:48.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.799+0000 7f3fca7fc640 1 -- 172.21.15.134:0/4058226841 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3fcc014d30 con 0x7f3fd414a710 2024-02-17T14:27:48.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.799+0000 7f3fca7fc640 1 -- 172.21.15.134:0/4058226841 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3fcc013bf0 con 0x7f3fd414a710 2024-02-17T14:27:48.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.800+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/4058226841 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd41e0370 con 0x7f3fd414a710 2024-02-17T14:27:48.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.802+0000 7f3fca7fc640 1 -- 172.21.15.134:0/4058226841 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3fd41e0370 con 0x7f3fd414a710 2024-02-17T14:27:48.816 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:48.817+0000 7fcc4223c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T14:27:48.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.861+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/4058226841 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fd40b1eb0 con 0x7f3fd414a710 2024-02-17T14:27:48.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.862+0000 7f3fca7fc640 1 -- 172.21.15.134:0/4058226841 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f3fd40b1eb0 con 0x7f3fd414a710 2024-02-17T14:27:48.861 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:48.861 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":10,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:27:48.631311+0000","last_up_change":"0.000000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:27:48.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.863+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/4058226841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd414a710 msgr2=0x7f3fd413f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:48.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.863+0000 7f3fdbfeb640 1 --2- 172.21.15.134:0/4058226841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd414a710 0x7f3fd413f4a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009dd0 tx=0x7f3fcc00c490 comp rx=0 tx=0).stop 2024-02-17T14:27:48.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.863+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/4058226841 shutdown_connections 2024-02-17T14:27:48.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.863+0000 7f3fdbfeb640 1 --2- 172.21.15.134:0/4058226841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fd414a710 0x7f3fd413f4a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.863+0000 7f3fdbfeb640 1 --2- 172.21.15.134:0/4058226841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fd4144960 0x7f3fd41dfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.863+0000 7f3fdbfeb640 1 --2- 172.21.15.134:0/4058226841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fd409b190 0x7f3fd40b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:48.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.863+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/4058226841 >> 172.21.15.134:0/4058226841 conn(0x7f3fd40b90c0 msgr2=0x7f3fd41436c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:48.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.863+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/4058226841 shutdown_connections 2024-02-17T14:27:48.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:48.863+0000 7f3fdbfeb640 1 -- 172.21.15.134:0/4058226841 wait complete. 2024-02-17T14:27:48.873 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-17T14:27:48.873 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-17T14:27:48.890 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:48.891+0000 7fd0fde3e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T14:27:48.914 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:48.915+0000 7fcc4223c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T14:27:48.983 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:48.984+0000 7fd0fde3e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T14:27:49.071 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:49.072+0000 7fcc4223c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T14:27:49.113 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:49.114+0000 7fcc4223c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T14:27:49.137 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:49.138+0000 7fd0fde3e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T14:27:49.179 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:49.180+0000 7fd0fde3e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T14:27:49.260 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-17T14:27:49.261+0000 7feaec12a640 -1 Falling back to public interface 2024-02-17T14:27:49.265 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-17T14:27:49.266+0000 7fda378c4640 -1 Falling back to public interface 2024-02-17T14:27:49.268 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:49.270+0000 7fcc4223c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T14:27:49.270 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-02-17T14:27:49.271+0000 7feb42815640 -1 Falling back to public interface 2024-02-17T14:27:49.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-02-17T14:27:49.276+0000 7f9883210640 -1 Falling back to public interface 2024-02-17T14:27:49.275 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-02-17T14:27:49.276+0000 7f24f101e640 -1 Falling back to public interface 2024-02-17T14:27:49.276 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-02-17T14:27:49.277+0000 7f5e5a00e640 -1 Falling back to public interface 2024-02-17T14:27:49.278 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-17T14:27:49.279+0000 7fdd10e13640 -1 Falling back to public interface 2024-02-17T14:27:49.286 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-17T14:27:49.287+0000 7fdd54c15640 -1 Falling back to public interface 2024-02-17T14:27:49.336 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:49.337+0000 7fd0fde3e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T14:27:49.678 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-17T14:27:49.769 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.770+0000 7f10d4464640 1 Processor -- start 2024-02-17T14:27:49.769 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.770+0000 7f10d4464640 1 -- start start 2024-02-17T14:27:49.771 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.771+0000 7f10d4464640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f10cc0b32c0 0x7f10cc0b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:49.771 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.771+0000 7f10d4464640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f10cc0b4230 0x7f10cc14a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:49.771 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.771+0000 7f10d4464640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10cc0b2c70 con 0x7f10cc0b59d0 2024-02-17T14:27:49.771 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.771+0000 7f10d4464640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc0b36a0 con 0x7f10cc0b32c0 2024-02-17T14:27:49.772 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.771+0000 7f10d4464640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc0b6a50 con 0x7f10cc0b4230 2024-02-17T14:27:49.772 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.771+0000 7f10d2200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f10cc0b32c0 0x7f10cc0b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:49.772 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.771+0000 7f10d2200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f10cc0b32c0 0x7f10cc0b3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34498/0 (socket says 172.21.15.134:34498) 2024-02-17T14:27:49.772 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.771+0000 7f10d2200640 1 -- 172.21.15.134:0/4176917290 learned_addr learned my addr 172.21.15.134:0/4176917290 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:27:49.772 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.771+0000 7f10d19ff640 1 --2- 172.21.15.134:0/4176917290 >> v2:172.21.15.142:3300/0 conn(0x7f10cc0b4230 0x7f10cc14a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:49.772 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.771+0000 7f10d2200640 1 -- 172.21.15.134:0/4176917290 >> v2:172.21.15.142:3300/0 conn(0x7f10cc0b4230 msgr2=0x7f10cc14a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:49.772 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.771+0000 7f10d2200640 1 --2- 172.21.15.134:0/4176917290 >> v2:172.21.15.142:3300/0 conn(0x7f10cc0b4230 0x7f10cc14a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:49.772 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.771+0000 7f10d2200640 1 -- 172.21.15.134:0/4176917290 >> v1:172.21.15.142:6789/0 conn(0x7f10cc0b59d0 legacy=0x7f10cc14a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:49.772 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.771+0000 7f10d2200640 1 -- 172.21.15.134:0/4176917290 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc147310 con 0x7f10cc0b32c0 2024-02-17T14:27:49.772 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.772+0000 7f10d2200640 1 --2- 172.21.15.134:0/4176917290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc0b32c0 0x7f10cc0b3cf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009870 tx=0x7f10c802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240521a789b5192a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:49.772 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.772+0000 7f10d11fe640 1 -- 172.21.15.134:0/4176917290 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c80317e0 con 0x7f10cc0b32c0 2024-02-17T14:27:49.772 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.772+0000 7f10d11fe640 1 -- 172.21.15.134:0/4176917290 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c8031940 con 0x7f10cc0b32c0 2024-02-17T14:27:49.772 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.772+0000 7f10d11fe640 1 -- 172.21.15.134:0/4176917290 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8031cd0 con 0x7f10cc0b32c0 2024-02-17T14:27:49.775 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.773+0000 7f10d4464640 1 -- 172.21.15.134:0/4176917290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc0b32c0 msgr2=0x7f10cc0b3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:49.775 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.773+0000 7f10d4464640 1 --2- 172.21.15.134:0/4176917290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc0b32c0 0x7f10cc0b3cf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009870 tx=0x7f10c802b880 comp rx=0 tx=0).stop 2024-02-17T14:27:49.776 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.773+0000 7f10d4464640 1 -- 172.21.15.134:0/4176917290 shutdown_connections 2024-02-17T14:27:49.776 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.773+0000 7f10d4464640 1 --2- 172.21.15.134:0/4176917290 >> v2:172.21.15.142:3300/0 conn(0x7f10cc0b4230 0x7f10cc14a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:49.776 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.773+0000 7f10d4464640 1 --2- 172.21.15.134:0/4176917290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc0b32c0 0x7f10cc0b3cf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:49.776 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.773+0000 7f10d4464640 1 -- 172.21.15.134:0/4176917290 >> 172.21.15.134:0/4176917290 conn(0x7f10cc072dc0 msgr2=0x7f10cc0bc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:49.776 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.773+0000 7f10d4464640 1 -- 172.21.15.134:0/4176917290 shutdown_connections 2024-02-17T14:27:49.776 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.773+0000 7f10d4464640 1 -- 172.21.15.134:0/4176917290 wait complete. 2024-02-17T14:27:49.776 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.774+0000 7f10d4464640 1 Processor -- start 2024-02-17T14:27:49.776 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.774+0000 7f10d4464640 1 -- start start 2024-02-17T14:27:49.776 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d4464640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc0b32c0 0x7f10cc13cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:49.776 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d4464640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10cc0b59d0 0x7f10cc1dff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:49.776 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d4464640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10cc144720 0x7f10cc13a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:49.776 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d4464640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc136f90 con 0x7f10cc0b32c0 2024-02-17T14:27:49.776 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d4464640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc1df750 con 0x7f10cc144720 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d4464640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc1dfa30 con 0x7f10cc0b59d0 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d2200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc0b32c0 0x7f10cc13cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d2200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc0b32c0 0x7f10cc13cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34514/0 (socket says 172.21.15.134:34514) 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d2200640 1 -- 172.21.15.134:0/2965237895 learned_addr learned my addr 172.21.15.134:0/2965237895 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d19ff640 1 --2- 172.21.15.134:0/2965237895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10cc0b59d0 0x7f10cc1dff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d2a01640 1 --2- 172.21.15.134:0/2965237895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10cc144720 0x7f10cc13a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d2200640 1 -- 172.21.15.134:0/2965237895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10cc0b59d0 msgr2=0x7f10cc1dff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d2200640 1 --2- 172.21.15.134:0/2965237895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10cc0b59d0 0x7f10cc1dff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d2200640 1 -- 172.21.15.134:0/2965237895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10cc144720 msgr2=0x7f10cc13a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d2200640 1 --2- 172.21.15.134:0/2965237895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10cc144720 0x7f10cc13a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d2200640 1 -- 172.21.15.134:0/2965237895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c80094d0 con 0x7f10cc0b32c0 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d2200640 1 --2- 172.21.15.134:0/2965237895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc0b32c0 0x7f10cc13cd10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f10c802b8c0 tx=0x7f10c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10c2ffd640 1 -- 172.21.15.134:0/2965237895 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8032880 con 0x7f10cc0b32c0 2024-02-17T14:27:49.777 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10c2ffd640 1 -- 172.21.15.134:0/2965237895 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c80329e0 con 0x7f10cc0b32c0 2024-02-17T14:27:49.778 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d4464640 1 -- 172.21.15.134:0/2965237895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc13dae0 con 0x7f10cc0b32c0 2024-02-17T14:27:49.778 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10c2ffd640 1 -- 172.21.15.134:0/2965237895 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8032d90 con 0x7f10cc0b32c0 2024-02-17T14:27:49.778 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10d4464640 1 -- 172.21.15.134:0/2965237895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc1e0490 con 0x7f10cc0b32c0 2024-02-17T14:27:49.778 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10c2ffd640 1 -- 172.21.15.134:0/2965237895 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f10c804e7e0 con 0x7f10cc0b32c0 2024-02-17T14:27:49.778 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.775+0000 7f10c2ffd640 1 -- 172.21.15.134:0/2965237895 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f10c803bac0 con 0x7f10cc0b32c0 2024-02-17T14:27:49.778 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.776+0000 7f10d4464640 1 -- 172.21.15.134:0/2965237895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc04eee0 con 0x7f10cc0b32c0 2024-02-17T14:27:49.778 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.778+0000 7f10c2ffd640 1 -- 172.21.15.134:0/2965237895 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f10c802e070 con 0x7f10cc0b32c0 2024-02-17T14:27:49.838 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.839+0000 7f10d4464640 1 -- 172.21.15.134:0/2965237895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10cc1dfbf0 con 0x7f10cc0b32c0 2024-02-17T14:27:49.839 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.840+0000 7f10c2ffd640 1 -- 172.21.15.134:0/2965237895 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f10c803bd60 con 0x7f10cc0b32c0 2024-02-17T14:27:49.839 INFO:teuthology.misc.health.smithi134.stdout: 2024-02-17T14:27:49.839 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":10,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:27:48.631311+0000","last_up_change":"0.000000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:27:49.841 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.841+0000 7f10d4464640 1 -- 172.21.15.134:0/2965237895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc0b32c0 msgr2=0x7f10cc13cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:49.841 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.841+0000 7f10d4464640 1 --2- 172.21.15.134:0/2965237895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc0b32c0 0x7f10cc13cd10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f10c802b8c0 tx=0x7f10c80046c0 comp rx=0 tx=0).stop 2024-02-17T14:27:49.841 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.841+0000 7f10d4464640 1 -- 172.21.15.134:0/2965237895 shutdown_connections 2024-02-17T14:27:49.841 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.841+0000 7f10d4464640 1 --2- 172.21.15.134:0/2965237895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10cc144720 0x7f10cc13a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:49.841 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.841+0000 7f10d4464640 1 --2- 172.21.15.134:0/2965237895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10cc0b59d0 0x7f10cc1dff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:49.841 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.841+0000 7f10d4464640 1 --2- 172.21.15.134:0/2965237895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10cc0b32c0 0x7f10cc13cd10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:49.841 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.841+0000 7f10d4464640 1 -- 172.21.15.134:0/2965237895 >> 172.21.15.134:0/2965237895 conn(0x7f10cc072dc0 msgr2=0x7f10cc0bab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:49.841 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.841+0000 7f10d4464640 1 -- 172.21.15.134:0/2965237895 shutdown_connections 2024-02-17T14:27:49.841 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:49.841+0000 7f10d4464640 1 -- 172.21.15.134:0/2965237895 wait complete. 2024-02-17T14:27:49.850 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-17T14:27:50.091 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:50.092+0000 7fcc4223c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T14:27:50.154 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:50.155+0000 7fd0fde3e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T14:27:50.367 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:50.368+0000 7fcc4223c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T14:27:50.421 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:50.422+0000 7fcc4223c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T14:27:50.430 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:50.431+0000 7fd0fde3e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T14:27:50.481 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:50.482+0000 7fd0fde3e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T14:27:50.536 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:50.537+0000 7fcc4223c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T14:27:50.601 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-02-17T14:27:50.602+0000 7fd0fde3e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T14:27:51.563 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:51.564+0000 7fcbe2edc640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-17T14:27:51.563 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-02-17T14:27:51.564+0000 7fcbe2edc640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-17T14:27:52.742 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-17T14:27:52.743+0000 7feaec12a640 -1 osd.4 0 log_to_monitors true 2024-02-17T14:27:52.745 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-02-17T14:27:52.747+0000 7feb42815640 -1 osd.2 0 log_to_monitors true 2024-02-17T14:27:52.786 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-17T14:27:52.787+0000 7fda378c4640 -1 osd.7 0 log_to_monitors true 2024-02-17T14:27:52.791 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-17T14:27:52.793+0000 7fdd10e13640 -1 osd.6 0 log_to_monitors true 2024-02-17T14:27:52.801 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-17T14:27:52.802+0000 7fdd54c15640 -1 osd.5 0 log_to_monitors true 2024-02-17T14:27:52.802 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-02-17T14:27:52.803+0000 7f9883210640 -1 osd.1 0 log_to_monitors true 2024-02-17T14:27:52.816 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-02-17T14:27:52.817+0000 7f5e5a00e640 -1 osd.3 0 log_to_monitors true 2024-02-17T14:27:52.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-02-17T14:27:52.825+0000 7f24f101e640 -1 osd.0 0 log_to_monitors true 2024-02-17T14:27:55.548 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-17T14:27:55.549+0000 7fdd504ed640 -1 osd.5 0 waiting for initial osdmap 2024-02-17T14:27:55.569 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-02-17T14:27:55.570+0000 7feb3e27d640 -1 osd.2 0 waiting for initial osdmap 2024-02-17T14:27:55.573 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-02-17T14:27:55.573+0000 7fdd4830d640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T14:27:55.578 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-02-17T14:27:55.579+0000 7feb3609d640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T14:27:55.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-02-17T14:27:55.583+0000 7f24eca0c640 -1 osd.0 0 waiting for initial osdmap 2024-02-17T14:27:55.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2024-02-17T14:27:55.588+0000 7f24e483d640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T14:27:55.597 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-17T14:27:55.598+0000 7feae80c0640 -1 osd.4 0 waiting for initial osdmap 2024-02-17T14:27:55.605 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-17T14:27:55.606+0000 7fda3385a640 -1 osd.7 0 waiting for initial osdmap 2024-02-17T14:27:55.612 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-02-17T14:27:55.614+0000 7f987ec75640 -1 osd.1 0 waiting for initial osdmap 2024-02-17T14:27:55.613 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-02-17T14:27:55.614+0000 7feadfee0640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T14:27:55.618 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-02-17T14:27:55.619+0000 7fda2b67a640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T14:27:55.619 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-17T14:27:55.620+0000 7fdd0d089640 -1 osd.6 0 waiting for initial osdmap 2024-02-17T14:27:55.622 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-02-17T14:27:55.623+0000 7f5e558d4640 -1 osd.3 0 waiting for initial osdmap 2024-02-17T14:27:55.631 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-02-17T14:27:55.632+0000 7fdd04695640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T14:27:55.634 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-02-17T14:27:55.635+0000 7f9876a95640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T14:27:55.645 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-02-17T14:27:55.646+0000 7f5e4d6f4640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T14:27:56.657 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-17T14:27:56.753 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.753+0000 7fc4fee57640 1 Processor -- start 2024-02-17T14:27:56.754 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.753+0000 7fc4fee57640 1 -- start start 2024-02-17T14:27:56.754 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.753+0000 7fc4fee57640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4f80b8d60 0x7fc4f81489e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:56.754 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.753+0000 7fc4fee57640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc4f8142700 0x7fc4f8148f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:56.754 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.753+0000 7fc4fee57640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f8148550 con 0x7fc4f80b5ea0 2024-02-17T14:27:56.754 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.753+0000 7fc4fee57640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f80b7970 con 0x7fc4f8142700 2024-02-17T14:27:56.754 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.753+0000 7fc4fee57640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80b8640 con 0x7fc4f80b8d60 2024-02-17T14:27:56.754 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.753+0000 7fc4fd3f4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc4f8142700 0x7fc4f8148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:56.754 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.753+0000 7fc4fd3f4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc4f8142700 0x7fc4f8148f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47688/0 (socket says 172.21.15.134:47688) 2024-02-17T14:27:56.754 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.753+0000 7fc4f7fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc4f80b5ea0 0x7fc4f8141ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45956/0 (socket says 172.21.15.134:45956) 2024-02-17T14:27:56.755 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.753+0000 7fc4fd3f4640 1 -- 172.21.15.134:0/1935105604 learned_addr learned my addr 172.21.15.134:0/1935105604 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:27:56.755 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.754+0000 7fc4fcbf3640 1 --2- 172.21.15.134:0/1935105604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4f80b8d60 0x7fc4f81489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:56.755 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.754+0000 7fc4fd3f4640 1 -- 172.21.15.134:0/1935105604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4f80b8d60 msgr2=0x7fc4f81489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:56.755 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.754+0000 7fc4fd3f4640 1 --2- 172.21.15.134:0/1935105604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4f80b8d60 0x7fc4f81489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:56.755 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.754+0000 7fc4fd3f4640 1 -- 172.21.15.134:0/1935105604 >> v1:172.21.15.134:6789/0 conn(0x7fc4f80b5ea0 legacy=0x7fc4f8141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:56.755 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.754+0000 7fc4fd3f4640 1 -- 172.21.15.134:0/1935105604 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f80b9140 con 0x7fc4f8142700 2024-02-17T14:27:56.755 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.754+0000 7fc4f77fe640 1 -- 172.21.15.134:0/1935105604 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954950827 0 0) 0x7fc4f8148550 con 0x7fc4f80b5ea0 2024-02-17T14:27:56.755 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.754+0000 7fc4fd3f4640 1 --2- 172.21.15.134:0/1935105604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f8142700 0x7fc4f8148f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0009e50 tx=0x7fc4f002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b4bbb1604ce076 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:56.755 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.755+0000 7fc4f77fe640 1 -- 172.21.15.134:0/1935105604 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f002c9e0 con 0x7fc4f8142700 2024-02-17T14:27:56.755 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.755+0000 7fc4f77fe640 1 -- 172.21.15.134:0/1935105604 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f002cb40 con 0x7fc4f8142700 2024-02-17T14:27:56.756 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.755+0000 7fc4f77fe640 1 -- 172.21.15.134:0/1935105604 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00343f0 con 0x7fc4f8142700 2024-02-17T14:27:56.759 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.755+0000 7fc4fee57640 1 -- 172.21.15.134:0/1935105604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f8142700 msgr2=0x7fc4f8148f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:56.759 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.755+0000 7fc4fee57640 1 --2- 172.21.15.134:0/1935105604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f8142700 0x7fc4f8148f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0009e50 tx=0x7fc4f002be40 comp rx=0 tx=0).stop 2024-02-17T14:27:56.759 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.755+0000 7fc4fee57640 1 -- 172.21.15.134:0/1935105604 shutdown_connections 2024-02-17T14:27:56.759 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.755+0000 7fc4fee57640 1 --2- 172.21.15.134:0/1935105604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f8142700 0x7fc4f8148f20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:56.760 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.755+0000 7fc4fee57640 1 --2- 172.21.15.134:0/1935105604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4f80b8d60 0x7fc4f81489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:56.760 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.755+0000 7fc4fee57640 1 -- 172.21.15.134:0/1935105604 >> 172.21.15.134:0/1935105604 conn(0x7fc4f80b94a0 msgr2=0x7fc4f80b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:56.760 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.755+0000 7fc4fee57640 1 -- 172.21.15.134:0/1935105604 shutdown_connections 2024-02-17T14:27:56.760 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.755+0000 7fc4fee57640 1 -- 172.21.15.134:0/1935105604 wait complete. 2024-02-17T14:27:56.760 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.756+0000 7fc4fee57640 1 Processor -- start 2024-02-17T14:27:56.760 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.756+0000 7fc4fee57640 1 -- start start 2024-02-17T14:27:56.760 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4fee57640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4f80b8d60 0x7fc4f81cef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:56.760 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4fee57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f8142700 0x7fc4f81da120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:56.760 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4fee57640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4f81cf470 0x7fc4f81da660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:56.760 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4fee57640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f81ce1f0 con 0x7fc4f8142700 2024-02-17T14:27:56.761 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4fee57640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f81d0480 con 0x7fc4f81cf470 2024-02-17T14:27:56.761 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4fee57640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f8142fd0 con 0x7fc4f80b8d60 2024-02-17T14:27:56.761 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f8142700 0x7fc4f81da120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:56.761 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f8142700 0x7fc4f81da120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47700/0 (socket says 172.21.15.134:47700) 2024-02-17T14:27:56.761 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4f7fff640 1 -- 172.21.15.134:0/3942310016 learned_addr learned my addr 172.21.15.134:0/3942310016 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:27:56.761 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4fcbf3640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4f80b8d60 0x7fc4f81cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:56.761 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4fd3f4640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4f81cf470 0x7fc4f81da660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:56.762 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4f7fff640 1 -- 172.21.15.134:0/3942310016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4f80b8d60 msgr2=0x7fc4f81cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:56.762 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4f7fff640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4f80b8d60 0x7fc4f81cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:56.762 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4f7fff640 1 -- 172.21.15.134:0/3942310016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4f81cf470 msgr2=0x7fc4f81da660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:56.762 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4f7fff640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4f81cf470 0x7fc4f81da660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:56.762 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4f7fff640 1 -- 172.21.15.134:0/3942310016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f0009b30 con 0x7fc4f8142700 2024-02-17T14:27:56.762 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4fcbf3640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4f80b8d60 0x7fc4f81cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:27:56.762 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4f7fff640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f8142700 0x7fc4f81da120 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400c4d0 tx=0x7fc4e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:56.762 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.757+0000 7fc4f57fa640 1 -- 172.21.15.134:0/3942310016 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e40074e0 con 0x7fc4f8142700 2024-02-17T14:27:56.762 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.758+0000 7fc4f57fa640 1 -- 172.21.15.134:0/3942310016 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e4007660 con 0x7fc4f8142700 2024-02-17T14:27:56.762 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.758+0000 7fc4fee57640 1 -- 172.21.15.134:0/3942310016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f81432b0 con 0x7fc4f8142700 2024-02-17T14:27:56.763 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.758+0000 7fc4f57fa640 1 -- 172.21.15.134:0/3942310016 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4004a20 con 0x7fc4f8142700 2024-02-17T14:27:56.763 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.758+0000 7fc4fee57640 1 -- 172.21.15.134:0/3942310016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f81d0050 con 0x7fc4f8142700 2024-02-17T14:27:56.763 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.759+0000 7fc4fee57640 1 -- 172.21.15.134:0/3942310016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f813ded0 con 0x7fc4f8142700 2024-02-17T14:27:56.763 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.759+0000 7fc4f57fa640 1 -- 172.21.15.134:0/3942310016 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7fc4e4004b80 con 0x7fc4f8142700 2024-02-17T14:27:56.763 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.759+0000 7fc4f57fa640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc4dc06b780 0x7fc4dc06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:56.763 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.759+0000 7fc4f57fa640 1 -- 172.21.15.134:0/3942310016 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fc4e4089060 con 0x7fc4f8142700 2024-02-17T14:27:56.763 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.759+0000 7fc4fcbf3640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc4dc06b780 0x7fc4dc06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:56.763 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.760+0000 7fc4fcbf3640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc4dc06b780 0x7fc4dc06dc40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec006fd0 tx=0x7fc4ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:56.764 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.764+0000 7fc4f57fa640 1 -- 172.21.15.134:0/3942310016 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc4f813ded0 con 0x7fc4f8142700 2024-02-17T14:27:56.936 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.937+0000 7fc4fee57640 1 -- 172.21.15.134:0/3942310016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4f813ded0 con 0x7fc4f8142700 2024-02-17T14:27:56.937 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.938+0000 7fc4f57fa640 1 -- 172.21.15.134:0/3942310016 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10945 (secure 0 0 0) 0x7fc4f813ded0 con 0x7fc4f8142700 2024-02-17T14:27:56.937 INFO:teuthology.misc.health.smithi134.stdout: 2024-02-17T14:27:56.937 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":13,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:27:56.587817+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:27:56.939 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.940+0000 7fc4fee57640 1 -- 172.21.15.134:0/3942310016 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc4dc06b780 msgr2=0x7fc4dc06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:56.939 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.940+0000 7fc4fee57640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc4dc06b780 0x7fc4dc06dc40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec006fd0 tx=0x7fc4ec008040 comp rx=0 tx=0).stop 2024-02-17T14:27:56.939 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.940+0000 7fc4fee57640 1 -- 172.21.15.134:0/3942310016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f8142700 msgr2=0x7fc4f81da120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:56.939 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.940+0000 7fc4fee57640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f8142700 0x7fc4f81da120 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400c4d0 tx=0x7fc4e400c990 comp rx=0 tx=0).stop 2024-02-17T14:27:56.940 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.940+0000 7fc4fee57640 1 -- 172.21.15.134:0/3942310016 shutdown_connections 2024-02-17T14:27:56.940 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.940+0000 7fc4fee57640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4f81cf470 0x7fc4f81da660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:56.940 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.940+0000 7fc4fee57640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc4dc06b780 0x7fc4dc06dc40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:56.940 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.940+0000 7fc4fee57640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4f8142700 0x7fc4f81da120 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:56.940 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.940+0000 7fc4fee57640 1 --2- 172.21.15.134:0/3942310016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4f80b8d60 0x7fc4f81cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:56.940 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.940+0000 7fc4fee57640 1 -- 172.21.15.134:0/3942310016 >> 172.21.15.134:0/3942310016 conn(0x7fc4f80b94a0 msgr2=0x7fc4f8146c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:56.940 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.940+0000 7fc4fee57640 1 -- 172.21.15.134:0/3942310016 shutdown_connections 2024-02-17T14:27:56.940 INFO:teuthology.misc.health.smithi134.stderr:2024-02-17T14:27:56.940+0000 7fc4fee57640 1 -- 172.21.15.134:0/3942310016 wait complete. 2024-02-17T14:27:56.949 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-02-17T14:27:56.950 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-17T14:27:56.951 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-17T14:27:56.951 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-17T14:27:56.954 INFO:tasks.ceph.mds.a:Started 2024-02-17T14:27:56.954 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-17T14:27:56.954 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-17T14:27:56.957 INFO:tasks.ceph.mds.b:Started 2024-02-17T14:27:56.957 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-02-17T14:27:56.958 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:27:57.028 INFO:tasks.ceph.mds.a.smithi134.stdout:starting mds.a at 2024-02-17T14:27:57.041 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-02-17T14:27:57.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.063+0000 7f0a78fa0640 1 Processor -- start 2024-02-17T14:27:57.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.063+0000 7f0a78fa0640 1 -- start start 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.063+0000 7f0a78fa0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0a7409e8b0 0x7f0a7414a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.063+0000 7f0a78fa0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0a7414abc0 0x7f0a7406ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.063+0000 7f0a78fa0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7406b360 0x7f0a7406b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.063+0000 7f0a78fa0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7414b020 con 0x7f0a7414abc0 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.063+0000 7f0a78fa0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7409ec90 con 0x7f0a7409e8b0 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.063+0000 7f0a78fa0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740b7690 con 0x7f0a7406b360 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.063+0000 7f0a72ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0a7414abc0 0x7f0a7406ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.064+0000 7f0a72ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0a7414abc0 0x7f0a7406ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47720/0 (socket says 172.21.15.134:47720) 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.064+0000 7f0a72ffd640 1 -- 172.21.15.134:0/1319233304 learned_addr learned my addr 172.21.15.134:0/1319233304 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.064+0000 7f0a737fe640 1 --2- 172.21.15.134:0/1319233304 >> v2:172.21.15.142:3300/0 conn(0x7f0a7409e8b0 0x7f0a7414a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.064+0000 7f0a73fff640 1 --2- 172.21.15.134:0/1319233304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7406b360 0x7f0a7406b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.064+0000 7f0a72ffd640 1 -- 172.21.15.134:0/1319233304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7406b360 msgr2=0x7f0a7406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.064+0000 7f0a72ffd640 1 --2- 172.21.15.134:0/1319233304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7406b360 0x7f0a7406b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.064+0000 7f0a72ffd640 1 -- 172.21.15.134:0/1319233304 >> v2:172.21.15.142:3300/0 conn(0x7f0a7409e8b0 msgr2=0x7f0a7414a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.064+0000 7f0a72ffd640 1 --2- 172.21.15.134:0/1319233304 >> v2:172.21.15.142:3300/0 conn(0x7f0a7409e8b0 0x7f0a7414a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.064+0000 7f0a72ffd640 1 -- 172.21.15.134:0/1319233304 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740b8440 con 0x7f0a7414abc0 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.064+0000 7f0a737fe640 1 --2- 172.21.15.134:0/1319233304 >> v2:172.21.15.142:3300/0 conn(0x7f0a7409e8b0 0x7f0a7414a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.064+0000 7f0a73fff640 1 --2- 172.21.15.134:0/1319233304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7406b360 0x7f0a7406b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.064+0000 7f0a72ffd640 1 --2- 172.21.15.134:0/1319233304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a7414abc0 0x7f0a7406ae20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0a740bd4e0 tx=0x7f0a6802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680013d09a2b1eb1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.065+0000 7f0a727fc640 1 -- 172.21.15.134:0/1319233304 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a680317e0 con 0x7f0a7414abc0 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.065+0000 7f0a727fc640 1 -- 172.21.15.134:0/1319233304 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a68031940 con 0x7f0a7414abc0 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.065+0000 7f0a727fc640 1 -- 172.21.15.134:0/1319233304 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68031cd0 con 0x7f0a7414abc0 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.065+0000 7f0a78fa0640 1 -- 172.21.15.134:0/1319233304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a7414abc0 msgr2=0x7f0a7406ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.065+0000 7f0a78fa0640 1 --2- 172.21.15.134:0/1319233304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a7414abc0 0x7f0a7406ae20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0a740bd4e0 tx=0x7f0a6802b880 comp rx=0 tx=0).stop 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.065+0000 7f0a78fa0640 1 -- 172.21.15.134:0/1319233304 shutdown_connections 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.065+0000 7f0a78fa0640 1 --2- 172.21.15.134:0/1319233304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7406b360 0x7f0a7406b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.065+0000 7f0a78fa0640 1 --2- 172.21.15.134:0/1319233304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a7414abc0 0x7f0a7406ae20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.065+0000 7f0a78fa0640 1 --2- 172.21.15.134:0/1319233304 >> v2:172.21.15.142:3300/0 conn(0x7f0a7409e8b0 0x7f0a7414a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.065+0000 7f0a78fa0640 1 -- 172.21.15.134:0/1319233304 >> 172.21.15.134:0/1319233304 conn(0x7f0a740bc930 msgr2=0x7f0a740bcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:57.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.065+0000 7f0a78fa0640 1 -- 172.21.15.134:0/1319233304 shutdown_connections 2024-02-17T14:27:57.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.065+0000 7f0a78fa0640 1 -- 172.21.15.134:0/1319233304 wait complete. 2024-02-17T14:27:57.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.066+0000 7f0a78fa0640 1 Processor -- start 2024-02-17T14:27:57.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.066+0000 7f0a78fa0640 1 -- start start 2024-02-17T14:27:57.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a78fa0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7406b360 0x7f0a740b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:57.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a78fa0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a7409e8b0 0x7f0a740a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:57.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a78fa0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a7414abc0 0x7f0a74143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a78fa0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a741dfc30 con 0x7f0a7414abc0 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a78fa0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a741e04d0 con 0x7f0a7409e8b0 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a78fa0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740b4f70 con 0x7f0a7406b360 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a73fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a7414abc0 0x7f0a74143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a73fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a7414abc0 0x7f0a74143d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47728/0 (socket says 172.21.15.134:47728) 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a73fff640 1 -- 172.21.15.134:0/2069600634 learned_addr learned my addr 172.21.15.134:0/2069600634 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a737fe640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7406b360 0x7f0a740b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a72ffd640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a7409e8b0 0x7f0a740a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a73fff640 1 -- 172.21.15.134:0/2069600634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7406b360 msgr2=0x7f0a740b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a73fff640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7406b360 0x7f0a740b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a73fff640 1 -- 172.21.15.134:0/2069600634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a7409e8b0 msgr2=0x7f0a740a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a73fff640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a7409e8b0 0x7f0a740a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a73fff640 1 -- 172.21.15.134:0/2069600634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680094d0 con 0x7f0a7414abc0 2024-02-17T14:27:57.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.067+0000 7f0a73fff640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a7414abc0 0x7f0a74143d00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c007de0 tx=0x7f0a6c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:57.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.068+0000 7f0a5bfff640 1 -- 172.21.15.134:0/2069600634 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c003990 con 0x7f0a7414abc0 2024-02-17T14:27:57.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.068+0000 7f0a5bfff640 1 -- 172.21.15.134:0/2069600634 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c00f040 con 0x7f0a7414abc0 2024-02-17T14:27:57.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.068+0000 7f0a5bfff640 1 -- 172.21.15.134:0/2069600634 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c003d50 con 0x7f0a7414abc0 2024-02-17T14:27:57.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.068+0000 7f0a78fa0640 1 -- 172.21.15.134:0/2069600634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a740a0430 con 0x7f0a7414abc0 2024-02-17T14:27:57.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.068+0000 7f0a78fa0640 1 -- 172.21.15.134:0/2069600634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a741e0160 con 0x7f0a7414abc0 2024-02-17T14:27:57.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.069+0000 7f0a78fa0640 1 -- 172.21.15.134:0/2069600634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a740b4d40 con 0x7f0a7414abc0 2024-02-17T14:27:57.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.069+0000 7f0a5bfff640 1 -- 172.21.15.134:0/2069600634 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7f0a6c004030 con 0x7f0a7414abc0 2024-02-17T14:27:57.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.069+0000 7f0a5bfff640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0a6006b780 0x7f0a6006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:57.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.069+0000 7f0a5bfff640 1 -- 172.21.15.134:0/2069600634 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f0a6c089eb0 con 0x7f0a7414abc0 2024-02-17T14:27:57.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.069+0000 7f0a737fe640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0a6006b780 0x7f0a6006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:57.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.070+0000 7f0a737fe640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0a6006b780 0x7f0a6006dc40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0a64006fd0 tx=0x7f0a64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:57.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.074+0000 7f0a5bfff640 1 -- 172.21.15.134:0/2069600634 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0a6c054f30 con 0x7f0a7414abc0 2024-02-17T14:27:57.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.246+0000 7f0a78fa0640 1 -- 172.21.15.134:0/2069600634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a74074d50 con 0x7f0a7414abc0 2024-02-17T14:27:57.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.247+0000 7f0a5bfff640 1 -- 172.21.15.134:0/2069600634 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10945 (secure 0 0 0) 0x7f0a6c0585f0 con 0x7f0a7414abc0 2024-02-17T14:27:57.246 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:57.246 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":13,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:27:56.587817+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:27:57.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.249+0000 7f0a78fa0640 1 -- 172.21.15.134:0/2069600634 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0a6006b780 msgr2=0x7f0a6006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:57.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.249+0000 7f0a78fa0640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0a6006b780 0x7f0a6006dc40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0a64006fd0 tx=0x7f0a64008040 comp rx=0 tx=0).stop 2024-02-17T14:27:57.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.249+0000 7f0a78fa0640 1 -- 172.21.15.134:0/2069600634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a7414abc0 msgr2=0x7f0a74143d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:57.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.249+0000 7f0a78fa0640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a7414abc0 0x7f0a74143d00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c007de0 tx=0x7f0a6c00d4a0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.249+0000 7f0a78fa0640 1 -- 172.21.15.134:0/2069600634 shutdown_connections 2024-02-17T14:27:57.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.249+0000 7f0a78fa0640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0a6006b780 0x7f0a6006dc40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.249+0000 7f0a78fa0640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a7414abc0 0x7f0a74143d00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.249+0000 7f0a78fa0640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a7409e8b0 0x7f0a740a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.249+0000 7f0a78fa0640 1 --2- 172.21.15.134:0/2069600634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7406b360 0x7f0a740b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.249+0000 7f0a78fa0640 1 -- 172.21.15.134:0/2069600634 >> 172.21.15.134:0/2069600634 conn(0x7f0a740bc930 msgr2=0x7f0a741475f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:57.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.249+0000 7f0a78fa0640 1 -- 172.21.15.134:0/2069600634 shutdown_connections 2024-02-17T14:27:57.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.249+0000 7f0a78fa0640 1 -- 172.21.15.134:0/2069600634 wait complete. 2024-02-17T14:27:57.259 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-02-17T14:27:57.262 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T14:27:57.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.363+0000 7fe9dd7f4640 1 Processor -- start 2024-02-17T14:27:57.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.363+0000 7fe9dd7f4640 1 -- start start 2024-02-17T14:27:57.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.363+0000 7fe9dd7f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d814a710 0x7fe9d80b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:57.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.363+0000 7fe9dd7f4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe9d8144960 0x7fe9d81517d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:57.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.363+0000 7fe9dd7f4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d814aaf0 con 0x7fe9d809b190 2024-02-17T14:27:57.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.363+0000 7fe9dd7f4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d809c280 con 0x7fe9d8144960 2024-02-17T14:27:57.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.363+0000 7fe9dd7f4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d809b5f0 con 0x7fe9d814a710 2024-02-17T14:27:57.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.364+0000 7fe9d77fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe9d8144960 0x7fe9d81517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:57.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.364+0000 7fe9cffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe9d809b190 0x7fe9d8144250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45976/0 (socket says 172.21.15.134:45976) 2024-02-17T14:27:57.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.364+0000 7fe9cffff640 1 -- 172.21.15.134:0/3325847066 learned_addr learned my addr 172.21.15.134:0/3325847066 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:27:57.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.364+0000 7fe9d6ffd640 1 --2- 172.21.15.134:0/3325847066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d814a710 0x7fe9d80b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:57.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.364+0000 7fe9d77fe640 1 -- 172.21.15.134:0/3325847066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d814a710 msgr2=0x7fe9d80b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:57.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.364+0000 7fe9d77fe640 1 --2- 172.21.15.134:0/3325847066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d814a710 0x7fe9d80b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.364+0000 7fe9d77fe640 1 -- 172.21.15.134:0/3325847066 >> v1:172.21.15.134:6789/0 conn(0x7fe9d809b190 legacy=0x7fe9d8144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:57.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.364+0000 7fe9d77fe640 1 -- 172.21.15.134:0/3325847066 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d809c4f0 con 0x7fe9d8144960 2024-02-17T14:27:57.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.364+0000 7fe9d67fc640 1 -- 172.21.15.134:0/3325847066 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609060901 0 0) 0x7fe9d814aaf0 con 0x7fe9d809b190 2024-02-17T14:27:57.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.364+0000 7fe9d6ffd640 1 --2- 172.21.15.134:0/3325847066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d814a710 0x7fe9d80b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:27:57.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.365+0000 7fe9d77fe640 1 --2- 172.21.15.134:0/3325847066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9d8144960 0x7fe9d81517d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009d90 tx=0x7fe9d002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887048b7e5ad84af server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:57.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.365+0000 7fe9d67fc640 1 -- 172.21.15.134:0/3325847066 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d002cbc0 con 0x7fe9d8144960 2024-02-17T14:27:57.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.365+0000 7fe9d67fc640 1 -- 172.21.15.134:0/3325847066 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d002cd20 con 0x7fe9d8144960 2024-02-17T14:27:57.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.365+0000 7fe9d67fc640 1 -- 172.21.15.134:0/3325847066 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0034660 con 0x7fe9d8144960 2024-02-17T14:27:57.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.365+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/3325847066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9d8144960 msgr2=0x7fe9d81517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:57.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.365+0000 7fe9dd7f4640 1 --2- 172.21.15.134:0/3325847066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9d8144960 0x7fe9d81517d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009d90 tx=0x7fe9d002be10 comp rx=0 tx=0).stop 2024-02-17T14:27:57.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.365+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/3325847066 shutdown_connections 2024-02-17T14:27:57.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.365+0000 7fe9dd7f4640 1 --2- 172.21.15.134:0/3325847066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9d8144960 0x7fe9d81517d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.365+0000 7fe9dd7f4640 1 --2- 172.21.15.134:0/3325847066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d814a710 0x7fe9d80b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.365+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/3325847066 >> 172.21.15.134:0/3325847066 conn(0x7fe9d80b90c0 msgr2=0x7fe9d80b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:57.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.365+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/3325847066 shutdown_connections 2024-02-17T14:27:57.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.365+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/3325847066 wait complete. 2024-02-17T14:27:57.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.366+0000 7fe9dd7f4640 1 Processor -- start 2024-02-17T14:27:57.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.366+0000 7fe9dd7f4640 1 -- start start 2024-02-17T14:27:57.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9dd7f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d809b190 0x7fe9d81452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:57.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9dd7f4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d8144960 0x7fe9d813e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:57.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9dd7f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9d814a710 0x7fe9d81dc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:57.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9dd7f4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d8145b30 con 0x7fe9d814a710 2024-02-17T14:27:57.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9dd7f4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d81e0210 con 0x7fe9d8144960 2024-02-17T14:27:57.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9dd7f4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d81e04f0 con 0x7fe9d809b190 2024-02-17T14:27:57.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9d77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9d814a710 0x7fe9d81dc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9d77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9d814a710 0x7fe9d81dc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47748/0 (socket says 172.21.15.134:47748) 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9d77fe640 1 -- 172.21.15.134:0/1212635472 learned_addr learned my addr 172.21.15.134:0/1212635472 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9d6ffd640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d809b190 0x7fe9d81452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9cffff640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d8144960 0x7fe9d813e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9d77fe640 1 -- 172.21.15.134:0/1212635472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d809b190 msgr2=0x7fe9d81452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9d77fe640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d809b190 0x7fe9d81452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9d77fe640 1 -- 172.21.15.134:0/1212635472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d8144960 msgr2=0x7fe9d813e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9d77fe640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d8144960 0x7fe9d813e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9d77fe640 1 -- 172.21.15.134:0/1212635472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0009a70 con 0x7fe9d814a710 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9d6ffd640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d809b190 0x7fe9d81452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9cffff640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d8144960 0x7fe9d813e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9d77fe640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9d814a710 0x7fe9d81dc930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009d90 tx=0x7fe9d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.367+0000 7fe9cf7fe640 1 -- 172.21.15.134:0/1212635472 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0040650 con 0x7fe9d814a710 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.368+0000 7fe9cf7fe640 1 -- 172.21.15.134:0/1212635472 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d002ce90 con 0x7fe9d814a710 2024-02-17T14:27:57.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.368+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/1212635472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d81e0cf0 con 0x7fe9d814a710 2024-02-17T14:27:57.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.368+0000 7fe9cf7fe640 1 -- 172.21.15.134:0/1212635472 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0040a10 con 0x7fe9d814a710 2024-02-17T14:27:57.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.368+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/1212635472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d80b2ec0 con 0x7fe9d814a710 2024-02-17T14:27:57.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.369+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/1212635472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d81e0080 con 0x7fe9d814a710 2024-02-17T14:27:57.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.369+0000 7fe9cf7fe640 1 -- 172.21.15.134:0/1212635472 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7fe9d0040b70 con 0x7fe9d814a710 2024-02-17T14:27:57.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.369+0000 7fe9cf7fe640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe9b806b7b0 0x7fe9b806dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:57.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.369+0000 7fe9cf7fe640 1 -- 172.21.15.134:0/1212635472 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fe9d00ac980 con 0x7fe9d814a710 2024-02-17T14:27:57.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.369+0000 7fe9d6ffd640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe9b806b7b0 0x7fe9b806dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:57.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.370+0000 7fe9d6ffd640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe9b806b7b0 0x7fe9b806dc70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8006fd0 tx=0x7fe9c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:57.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.374+0000 7fe9cf7fe640 1 -- 172.21.15.134:0/1212635472 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe9d0077a80 con 0x7fe9d814a710 2024-02-17T14:27:57.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.580+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/1212635472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9d81e0a10 con 0x7fe9d814a710 2024-02-17T14:27:57.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.581+0000 7fe9cf7fe640 1 -- 172.21.15.134:0/1212635472 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fe9d0044540 con 0x7fe9d814a710 2024-02-17T14:27:57.580 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:57.580 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/137239145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":137239145},{"type":"v1","addr":"172.21.15.134:6835","nonce":137239145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-17T14:27:57.580 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 2 2024-02-17T14:27:57.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.583+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/1212635472 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe9b806b7b0 msgr2=0x7fe9b806dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:57.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.583+0000 7fe9dd7f4640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe9b806b7b0 0x7fe9b806dc70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8006fd0 tx=0x7fe9c8008040 comp rx=0 tx=0).stop 2024-02-17T14:27:57.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.583+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/1212635472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9d814a710 msgr2=0x7fe9d81dc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:57.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.583+0000 7fe9dd7f4640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9d814a710 0x7fe9d81dc930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009d90 tx=0x7fe9d0004a40 comp rx=0 tx=0).stop 2024-02-17T14:27:57.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.583+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/1212635472 shutdown_connections 2024-02-17T14:27:57.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.583+0000 7fe9dd7f4640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe9b806b7b0 0x7fe9b806dc70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.583+0000 7fe9dd7f4640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9d814a710 0x7fe9d81dc930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.583+0000 7fe9dd7f4640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d8144960 0x7fe9d813e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.583+0000 7fe9dd7f4640 1 --2- 172.21.15.134:0/1212635472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d809b190 0x7fe9d81452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:57.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.583+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/1212635472 >> 172.21.15.134:0/1212635472 conn(0x7fe9d80b90c0 msgr2=0x7fe9d80b94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:57.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.583+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/1212635472 shutdown_connections 2024-02-17T14:27:57.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:57.583+0000 7fe9dd7f4640 1 -- 172.21.15.134:0/1212635472 wait complete. 2024-02-17T14:27:59.594 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T14:27:59.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.706+0000 7f36dad2c640 1 Processor -- start 2024-02-17T14:27:59.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.706+0000 7f36dad2c640 1 -- start start 2024-02-17T14:27:59.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36dad2c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f36d40b0bb0 0x7f36d4140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:59.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36dad2c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36d409cc70 0x7f36d4141110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36dad2c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d4141650 con 0x7f36d40b56c0 2024-02-17T14:27:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36dad2c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d40afc10 con 0x7f36d409cc70 2024-02-17T14:27:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36dad2c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d40b5aa0 con 0x7f36d40b0bb0 2024-02-17T14:27:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36d92c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36d409cc70 0x7f36d4141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36d92c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36d409cc70 0x7f36d4141110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47758/0 (socket says 172.21.15.134:47758) 2024-02-17T14:27:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36d92c9640 1 -- 172.21.15.134:0/791154162 learned_addr learned my addr 172.21.15.134:0/791154162 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:27:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36d3fff640 1 --2- 172.21.15.134:0/791154162 >> v2:172.21.15.142:3300/0 conn(0x7f36d40b0bb0 0x7f36d4140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36d92c9640 1 -- 172.21.15.134:0/791154162 >> v2:172.21.15.142:3300/0 conn(0x7f36d40b0bb0 msgr2=0x7f36d4140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:27:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36d92c9640 1 --2- 172.21.15.134:0/791154162 >> v2:172.21.15.142:3300/0 conn(0x7f36d40b0bb0 0x7f36d4140bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36d92c9640 1 -- 172.21.15.134:0/791154162 >> v1:172.21.15.142:6789/0 conn(0x7f36d40b56c0 legacy=0x7f36d40b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36d92c9640 1 -- 172.21.15.134:0/791154162 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d40b6010 con 0x7f36d409cc70 2024-02-17T14:27:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.707+0000 7f36d3fff640 1 --2- 172.21.15.134:0/791154162 >> v2:172.21.15.142:3300/0 conn(0x7f36d40b0bb0 0x7f36d4140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:27:59.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.708+0000 7f36d92c9640 1 --2- 172.21.15.134:0/791154162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36d409cc70 0x7f36d4141110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f36d4074720 tx=0x7f36cc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3621e8307f9eaa58 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:59.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.708+0000 7f36d37fe640 1 -- 172.21.15.134:0/791154162 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc02cb20 con 0x7f36d409cc70 2024-02-17T14:27:59.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.708+0000 7f36d37fe640 1 -- 172.21.15.134:0/791154162 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc02cc80 con 0x7f36d409cc70 2024-02-17T14:27:59.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.708+0000 7f36d37fe640 1 -- 172.21.15.134:0/791154162 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0343f0 con 0x7f36d409cc70 2024-02-17T14:27:59.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.709+0000 7f36dad2c640 1 -- 172.21.15.134:0/791154162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36d409cc70 msgr2=0x7f36d4141110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:59.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.709+0000 7f36dad2c640 1 --2- 172.21.15.134:0/791154162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36d409cc70 0x7f36d4141110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f36d4074720 tx=0x7f36cc02bf80 comp rx=0 tx=0).stop 2024-02-17T14:27:59.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.709+0000 7f36dad2c640 1 -- 172.21.15.134:0/791154162 shutdown_connections 2024-02-17T14:27:59.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.709+0000 7f36dad2c640 1 --2- 172.21.15.134:0/791154162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36d409cc70 0x7f36d4141110 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:59.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.709+0000 7f36dad2c640 1 --2- 172.21.15.134:0/791154162 >> v2:172.21.15.142:3300/0 conn(0x7f36d40b0bb0 0x7f36d4140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:59.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.709+0000 7f36dad2c640 1 -- 172.21.15.134:0/791154162 >> 172.21.15.134:0/791154162 conn(0x7f36d40b6e70 msgr2=0x7f36d40b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:59.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.709+0000 7f36dad2c640 1 -- 172.21.15.134:0/791154162 shutdown_connections 2024-02-17T14:27:59.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.709+0000 7f36dad2c640 1 -- 172.21.15.134:0/791154162 wait complete. 2024-02-17T14:27:59.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.710+0000 7f36dad2c640 1 Processor -- start 2024-02-17T14:27:59.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.710+0000 7f36dad2c640 1 -- start start 2024-02-17T14:27:59.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36dad2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36d409cc70 0x7f36d41dfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:59.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36dad2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d40b0bb0 0x7f36d41dc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:59.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36dad2c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d40b56c0 0x7f36d41dc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:59.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36dad2c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4147a90 con 0x7f36d409cc70 2024-02-17T14:27:59.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36dad2c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d40b4460 con 0x7f36d40b56c0 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36dad2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4147320 con 0x7f36d40b0bb0 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36d8ac8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36d409cc70 0x7f36d41dfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36d8ac8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36d409cc70 0x7f36d41dfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47770/0 (socket says 172.21.15.134:47770) 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36d8ac8640 1 -- 172.21.15.134:0/321846993 learned_addr learned my addr 172.21.15.134:0/321846993 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36d3fff640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d40b0bb0 0x7f36d41dc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36d92c9640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d40b56c0 0x7f36d41dc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36d8ac8640 1 -- 172.21.15.134:0/321846993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d40b0bb0 msgr2=0x7f36d41dc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36d8ac8640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d40b0bb0 0x7f36d41dc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36d8ac8640 1 -- 172.21.15.134:0/321846993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d40b56c0 msgr2=0x7f36d41dc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36d8ac8640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d40b56c0 0x7f36d41dc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36d8ac8640 1 -- 172.21.15.134:0/321846993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc009b30 con 0x7f36d409cc70 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.711+0000 7f36d8ac8640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36d409cc70 0x7f36d41dfc00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f36c800c3f0 tx=0x7f36c800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.712+0000 7f36d17fa640 1 -- 172.21.15.134:0/321846993 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c80052d0 con 0x7f36d409cc70 2024-02-17T14:27:59.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.712+0000 7f36d17fa640 1 -- 172.21.15.134:0/321846993 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c8005450 con 0x7f36d409cc70 2024-02-17T14:27:59.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.712+0000 7f36d17fa640 1 -- 172.21.15.134:0/321846993 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8007260 con 0x7f36d409cc70 2024-02-17T14:27:59.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.712+0000 7f36dad2c640 1 -- 172.21.15.134:0/321846993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d40b3550 con 0x7f36d409cc70 2024-02-17T14:27:59.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.712+0000 7f36dad2c640 1 -- 172.21.15.134:0/321846993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d41e06d0 con 0x7f36d409cc70 2024-02-17T14:27:59.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.713+0000 7f36dad2c640 1 -- 172.21.15.134:0/321846993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d4067110 con 0x7f36d409cc70 2024-02-17T14:27:59.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.713+0000 7f36d17fa640 1 -- 172.21.15.134:0/321846993 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7f36c80073c0 con 0x7f36d409cc70 2024-02-17T14:27:59.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.714+0000 7f36d17fa640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f36b806b780 0x7f36b806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:27:59.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.714+0000 7f36d3fff640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f36b806b780 0x7f36b806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:27:59.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.714+0000 7f36d17fa640 1 -- 172.21.15.134:0/321846993 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f36c8088ff0 con 0x7f36d409cc70 2024-02-17T14:27:59.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.714+0000 7f36d3fff640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f36b806b780 0x7f36b806dc40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f36d40b8f30 tx=0x7f36c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:27:59.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.718+0000 7f36d17fa640 1 -- 172.21.15.134:0/321846993 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f36c80bc8c0 con 0x7f36d409cc70 2024-02-17T14:27:59.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.929+0000 7f36dad2c640 1 -- 172.21.15.134:0/321846993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36d4067b70 con 0x7f36d409cc70 2024-02-17T14:27:59.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.929+0000 7f36d17fa640 1 -- 172.21.15.134:0/321846993 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2114 (secure 0 0 0) 0x7f36c8053f90 con 0x7f36d409cc70 2024-02-17T14:27:59.928 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:27:59.929 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/137239145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":137239145},{"type":"v1","addr":"172.21.15.134:6835","nonce":137239145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/177127534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":177127534},{"type":"v1","addr":"172.21.15.142:6833","nonce":177127534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-02-17T14:27:59.929 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 3 2024-02-17T14:27:59.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.931+0000 7f36dad2c640 1 -- 172.21.15.134:0/321846993 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f36b806b780 msgr2=0x7f36b806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:59.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.931+0000 7f36dad2c640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f36b806b780 0x7f36b806dc40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f36d40b8f30 tx=0x7f36c0008040 comp rx=0 tx=0).stop 2024-02-17T14:27:59.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.931+0000 7f36dad2c640 1 -- 172.21.15.134:0/321846993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36d409cc70 msgr2=0x7f36d41dfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:27:59.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.931+0000 7f36dad2c640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36d409cc70 0x7f36d41dfc00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f36c800c3f0 tx=0x7f36c800c8b0 comp rx=0 tx=0).stop 2024-02-17T14:27:59.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.931+0000 7f36dad2c640 1 -- 172.21.15.134:0/321846993 shutdown_connections 2024-02-17T14:27:59.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.931+0000 7f36dad2c640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d40b56c0 0x7f36d41dc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:59.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.931+0000 7f36dad2c640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36d40b0bb0 0x7f36d41dc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:59.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.931+0000 7f36dad2c640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f36b806b780 0x7f36b806dc40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:59.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.931+0000 7f36dad2c640 1 --2- 172.21.15.134:0/321846993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36d409cc70 0x7f36d41dfc00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:27:59.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.931+0000 7f36dad2c640 1 -- 172.21.15.134:0/321846993 >> 172.21.15.134:0/321846993 conn(0x7f36d40b6e70 msgr2=0x7f36d40b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:27:59.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.931+0000 7f36dad2c640 1 -- 172.21.15.134:0/321846993 shutdown_connections 2024-02-17T14:27:59.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:27:59.931+0000 7f36dad2c640 1 -- 172.21.15.134:0/321846993 wait complete. 2024-02-17T14:27:59.941 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:00.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.042+0000 7f18345e2640 1 Processor -- start 2024-02-17T14:28:00.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.042+0000 7f18345e2640 1 -- start start 2024-02-17T14:28:00.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.043+0000 7f18345e2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f182c0ada50 0x7f182c140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.043+0000 7f18345e2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f182c141090 0x7f182c151810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.043+0000 7f18345e2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182c0b51f0 con 0x7f182c0acb20 2024-02-17T14:28:00.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.043+0000 7f18345e2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182c1475a0 con 0x7f182c0ada50 2024-02-17T14:28:00.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.043+0000 7f18345e2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0b6640 con 0x7f182c141090 2024-02-17T14:28:00.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.043+0000 7f1831b7d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f182c0ada50 0x7f182c140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.043+0000 7f1831b7d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f182c0ada50 0x7f182c140b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47780/0 (socket says 172.21.15.134:47780) 2024-02-17T14:28:00.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.043+0000 7f1831b7d640 1 -- 172.21.15.134:0/304202267 learned_addr learned my addr 172.21.15.134:0/304202267 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:00.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.043+0000 7f1832b7f640 1 --2- 172.21.15.134:0/304202267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f182c141090 0x7f182c151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.043+0000 7f1831b7d640 1 -- 172.21.15.134:0/304202267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f182c141090 msgr2=0x7f182c151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:00.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.043+0000 7f1831b7d640 1 --2- 172.21.15.134:0/304202267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f182c141090 0x7f182c151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.043+0000 7f1831b7d640 1 -- 172.21.15.134:0/304202267 >> v1:172.21.15.142:6789/0 conn(0x7f182c0acb20 legacy=0x7f182c146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.043+0000 7f1831b7d640 1 -- 172.21.15.134:0/304202267 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c0ad2b0 con 0x7f182c0ada50 2024-02-17T14:28:00.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.044+0000 7f1831b7d640 1 --2- 172.21.15.134:0/304202267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f182c0ada50 0x7f182c140b50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f181c009870 tx=0x7f181c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8920cf876db0abdf server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:00.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.044+0000 7f183137c640 1 -- 172.21.15.134:0/304202267 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c030840 con 0x7f182c0ada50 2024-02-17T14:28:00.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.044+0000 7f183137c640 1 -- 172.21.15.134:0/304202267 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c0309a0 con 0x7f182c0ada50 2024-02-17T14:28:00.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.044+0000 7f183137c640 1 -- 172.21.15.134:0/304202267 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c030d30 con 0x7f182c0ada50 2024-02-17T14:28:00.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.045+0000 7f18345e2640 1 -- 172.21.15.134:0/304202267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f182c0ada50 msgr2=0x7f182c140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.045+0000 7f18345e2640 1 --2- 172.21.15.134:0/304202267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f182c0ada50 0x7f182c140b50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f181c009870 tx=0x7f181c02b980 comp rx=0 tx=0).stop 2024-02-17T14:28:00.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.045+0000 7f18345e2640 1 -- 172.21.15.134:0/304202267 shutdown_connections 2024-02-17T14:28:00.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.045+0000 7f18345e2640 1 --2- 172.21.15.134:0/304202267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f182c141090 0x7f182c151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.045+0000 7f18345e2640 1 --2- 172.21.15.134:0/304202267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f182c0ada50 0x7f182c140b50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.045+0000 7f18345e2640 1 -- 172.21.15.134:0/304202267 >> 172.21.15.134:0/304202267 conn(0x7f182c0ba420 msgr2=0x7f182c0ba830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:00.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.045+0000 7f18345e2640 1 -- 172.21.15.134:0/304202267 shutdown_connections 2024-02-17T14:28:00.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.045+0000 7f18345e2640 1 -- 172.21.15.134:0/304202267 wait complete. 2024-02-17T14:28:00.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.046+0000 7f18345e2640 1 Processor -- start 2024-02-17T14:28:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.046+0000 7f18345e2640 1 -- start start 2024-02-17T14:28:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f18345e2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f182c0acb20 0x7f182c0b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f18345e2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f182c0ada50 0x7f182c0b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f18345e2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f182c141090 0x7f182c1dcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f18345e2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0b2850 con 0x7f182c141090 2024-02-17T14:28:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f18345e2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c1dc5e0 con 0x7f182c0acb20 2024-02-17T14:28:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f18345e2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c14ab70 con 0x7f182c0ada50 2024-02-17T14:28:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f1832b7f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f182c141090 0x7f182c1dcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f1832b7f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f182c141090 0x7f182c1dcae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47796/0 (socket says 172.21.15.134:47796) 2024-02-17T14:28:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f1832b7f640 1 -- 172.21.15.134:0/3034268347 learned_addr learned my addr 172.21.15.134:0/3034268347 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f1831b7d640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f182c0ada50 0x7f182c0b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f183237e640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f182c0acb20 0x7f182c0b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f1832b7f640 1 -- 172.21.15.134:0/3034268347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f182c0ada50 msgr2=0x7f182c0b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f1832b7f640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f182c0ada50 0x7f182c0b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f1832b7f640 1 -- 172.21.15.134:0/3034268347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f182c0acb20 msgr2=0x7f182c0b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f1832b7f640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f182c0acb20 0x7f182c0b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f1832b7f640 1 -- 172.21.15.134:0/3034268347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c0094d0 con 0x7f182c141090 2024-02-17T14:28:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.047+0000 7f1832b7f640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f182c141090 0x7f182c1dcae0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1824007e60 tx=0x7f182400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.048+0000 7f1822ffd640 1 -- 172.21.15.134:0/3034268347 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824014420 con 0x7f182c141090 2024-02-17T14:28:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.048+0000 7f1822ffd640 1 -- 172.21.15.134:0/3034268347 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18240145a0 con 0x7f182c141090 2024-02-17T14:28:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.048+0000 7f18345e2640 1 -- 172.21.15.134:0/3034268347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182c0b3b30 con 0x7f182c141090 2024-02-17T14:28:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.048+0000 7f1822ffd640 1 -- 172.21.15.134:0/3034268347 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824014950 con 0x7f182c141090 2024-02-17T14:28:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.048+0000 7f18345e2640 1 -- 172.21.15.134:0/3034268347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182c0b11c0 con 0x7f182c141090 2024-02-17T14:28:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.049+0000 7f18345e2640 1 -- 172.21.15.134:0/3034268347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182c068280 con 0x7f182c141090 2024-02-17T14:28:00.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.049+0000 7f1822ffd640 1 -- 172.21.15.134:0/3034268347 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7f1824014ab0 con 0x7f182c141090 2024-02-17T14:28:00.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.049+0000 7f1822ffd640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f181006b7b0 0x7f181006dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.050+0000 7f183237e640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f181006b7b0 0x7f181006dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.050+0000 7f1822ffd640 1 -- 172.21.15.134:0/3034268347 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f182408a440 con 0x7f182c141090 2024-02-17T14:28:00.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.050+0000 7f183237e640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f181006b7b0 0x7f181006dc70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1828007fd0 tx=0x7f1828009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:00.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.054+0000 7f1822ffd640 1 -- 172.21.15.134:0/3034268347 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f18240553d0 con 0x7f182c141090 2024-02-17T14:28:00.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.226+0000 7f18345e2640 1 -- 172.21.15.134:0/3034268347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f182c0b5f80 con 0x7f182c141090 2024-02-17T14:28:00.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.227+0000 7f1822ffd640 1 -- 172.21.15.134:0/3034268347 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12933 (secure 0 0 0) 0x7f1824058a90 con 0x7f182c141090 2024-02-17T14:28:00.227 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:00.227 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":16,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:00.041198+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:00.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.229+0000 7f18345e2640 1 -- 172.21.15.134:0/3034268347 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f181006b7b0 msgr2=0x7f181006dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.229+0000 7f18345e2640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f181006b7b0 0x7f181006dc70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1828007fd0 tx=0x7f1828009040 comp rx=0 tx=0).stop 2024-02-17T14:28:00.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.229+0000 7f18345e2640 1 -- 172.21.15.134:0/3034268347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f182c141090 msgr2=0x7f182c1dcae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.229+0000 7f18345e2640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f182c141090 0x7f182c1dcae0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1824007e60 tx=0x7f182400e4b0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.229+0000 7f18345e2640 1 -- 172.21.15.134:0/3034268347 shutdown_connections 2024-02-17T14:28:00.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.229+0000 7f18345e2640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f181006b7b0 0x7f181006dc70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.229+0000 7f18345e2640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f182c141090 0x7f182c1dcae0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.229+0000 7f18345e2640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f182c0ada50 0x7f182c0b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.229+0000 7f18345e2640 1 --2- 172.21.15.134:0/3034268347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f182c0acb20 0x7f182c0b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.229+0000 7f18345e2640 1 -- 172.21.15.134:0/3034268347 >> 172.21.15.134:0/3034268347 conn(0x7f182c0ba420 msgr2=0x7f182c13f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:00.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.229+0000 7f18345e2640 1 -- 172.21.15.134:0/3034268347 shutdown_connections 2024-02-17T14:28:00.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.229+0000 7f18345e2640 1 -- 172.21.15.134:0/3034268347 wait complete. 2024-02-17T14:28:00.239 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T14:27:58.602268+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T14:28:00.240 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T14:28:00.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.352+0000 7f5e54a88640 1 Processor -- start 2024-02-17T14:28:00.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.352+0000 7f5e54a88640 1 -- start start 2024-02-17T14:28:00.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e54a88640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5e500b32b0 0x7f5e50148100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e54a88640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e50148640 0x7f5e5013e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e54a88640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5e500b59b0 0x7f5e5013ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e54a88640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e50072e90 con 0x7f5e500b32b0 2024-02-17T14:28:00.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e54a88640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5013f240 con 0x7f5e500b59b0 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e54a88640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500b3690 con 0x7f5e50148640 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e4e59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5e500b32b0 0x7f5e50148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e4e59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5e500b32b0 0x7f5e50148100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47810/0 (socket says 172.21.15.134:47810) 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e4e59c640 1 -- 172.21.15.134:0/1381839775 learned_addr learned my addr 172.21.15.134:0/1381839775 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e4dd9b640 1 --2- 172.21.15.134:0/1381839775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e50148640 0x7f5e5013e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e4ed9d640 1 --2- 172.21.15.134:0/1381839775 >> v2:172.21.15.142:3300/0 conn(0x7f5e500b59b0 0x7f5e5013ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e4e59c640 1 -- 172.21.15.134:0/1381839775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e50148640 msgr2=0x7f5e5013e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e4e59c640 1 --2- 172.21.15.134:0/1381839775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e50148640 0x7f5e5013e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e4e59c640 1 -- 172.21.15.134:0/1381839775 >> v2:172.21.15.142:3300/0 conn(0x7f5e500b59b0 msgr2=0x7f5e5013ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e4e59c640 1 --2- 172.21.15.134:0/1381839775 >> v2:172.21.15.142:3300/0 conn(0x7f5e500b59b0 0x7f5e5013ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.353+0000 7f5e4e59c640 1 -- 172.21.15.134:0/1381839775 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e500b2120 con 0x7f5e500b32b0 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.354+0000 7f5e4e59c640 1 --2- 172.21.15.134:0/1381839775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e500b32b0 0x7f5e50148100 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e500b3e10 tx=0x7f5e4002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfecd7484cac30a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.354+0000 7f5e4d59a640 1 -- 172.21.15.134:0/1381839775 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e400317e0 con 0x7f5e500b32b0 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.354+0000 7f5e4d59a640 1 -- 172.21.15.134:0/1381839775 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e40031940 con 0x7f5e500b32b0 2024-02-17T14:28:00.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.354+0000 7f5e4d59a640 1 -- 172.21.15.134:0/1381839775 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40031cd0 con 0x7f5e500b32b0 2024-02-17T14:28:00.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.355+0000 7f5e54a88640 1 -- 172.21.15.134:0/1381839775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e500b32b0 msgr2=0x7f5e50148100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.355+0000 7f5e54a88640 1 --2- 172.21.15.134:0/1381839775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e500b32b0 0x7f5e50148100 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e500b3e10 tx=0x7f5e4002b880 comp rx=0 tx=0).stop 2024-02-17T14:28:00.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.355+0000 7f5e54a88640 1 -- 172.21.15.134:0/1381839775 shutdown_connections 2024-02-17T14:28:00.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.355+0000 7f5e54a88640 1 --2- 172.21.15.134:0/1381839775 >> v2:172.21.15.142:3300/0 conn(0x7f5e500b59b0 0x7f5e5013ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.355+0000 7f5e54a88640 1 --2- 172.21.15.134:0/1381839775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e50148640 0x7f5e5013e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.355+0000 7f5e54a88640 1 --2- 172.21.15.134:0/1381839775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e500b32b0 0x7f5e50148100 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.355+0000 7f5e54a88640 1 -- 172.21.15.134:0/1381839775 >> 172.21.15.134:0/1381839775 conn(0x7f5e500b9350 msgr2=0x7f5e500b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:00.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.355+0000 7f5e54a88640 1 -- 172.21.15.134:0/1381839775 shutdown_connections 2024-02-17T14:28:00.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.355+0000 7f5e54a88640 1 -- 172.21.15.134:0/1381839775 wait complete. 2024-02-17T14:28:00.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.356+0000 7f5e54a88640 1 Processor -- start 2024-02-17T14:28:00.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.356+0000 7f5e54a88640 1 -- start start 2024-02-17T14:28:00.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e54a88640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e500b32b0 0x7f5e501dde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e54a88640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e500b59b0 0x7f5e501de360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e54a88640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e501de8a0 0x7f5e50136270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e54a88640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e50140060 con 0x7f5e501de8a0 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e54a88640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5013fdc0 con 0x7f5e500b32b0 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e54a88640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e501420d0 con 0x7f5e500b59b0 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e4ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e501de8a0 0x7f5e50136270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e4e59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e500b32b0 0x7f5e501dde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e4ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e501de8a0 0x7f5e50136270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47814/0 (socket says 172.21.15.134:47814) 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e4dd9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e500b59b0 0x7f5e501de360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e4ed9d640 1 -- 172.21.15.134:0/1835527292 learned_addr learned my addr 172.21.15.134:0/1835527292 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e4ed9d640 1 -- 172.21.15.134:0/1835527292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e500b59b0 msgr2=0x7f5e501de360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e4ed9d640 1 --2- 172.21.15.134:0/1835527292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e500b59b0 0x7f5e501de360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e4ed9d640 1 -- 172.21.15.134:0/1835527292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e500b32b0 msgr2=0x7f5e501dde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e4ed9d640 1 --2- 172.21.15.134:0/1835527292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e500b32b0 0x7f5e501dde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e4ed9d640 1 -- 172.21.15.134:0/1835527292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e400094d0 con 0x7f5e501de8a0 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.357+0000 7f5e4ed9d640 1 --2- 172.21.15.134:0/1835527292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e501de8a0 0x7f5e50136270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800efc0 tx=0x7f5e4800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:00.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.358+0000 7f5e3effd640 1 -- 172.21.15.134:0/1835527292 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e48009b10 con 0x7f5e501de8a0 2024-02-17T14:28:00.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.358+0000 7f5e3effd640 1 -- 172.21.15.134:0/1835527292 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4800f040 con 0x7f5e501de8a0 2024-02-17T14:28:00.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.358+0000 7f5e3effd640 1 -- 172.21.15.134:0/1835527292 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e480146c0 con 0x7f5e501de8a0 2024-02-17T14:28:00.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.358+0000 7f5e54a88640 1 -- 172.21.15.134:0/1835527292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e501407c0 con 0x7f5e501de8a0 2024-02-17T14:28:00.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.358+0000 7f5e54a88640 1 -- 172.21.15.134:0/1835527292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e50147f50 con 0x7f5e501de8a0 2024-02-17T14:28:00.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.359+0000 7f5e54a88640 1 -- 172.21.15.134:0/1835527292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e50068280 con 0x7f5e501de8a0 2024-02-17T14:28:00.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.359+0000 7f5e3effd640 1 -- 172.21.15.134:0/1835527292 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7f5e48014820 con 0x7f5e501de8a0 2024-02-17T14:28:00.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.359+0000 7f5e3effd640 1 --2- 172.21.15.134:0/1835527292 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f5e3006b780 0x7f5e3006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.360+0000 7f5e3effd640 1 -- 172.21.15.134:0/1835527292 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5e4808a710 con 0x7f5e501de8a0 2024-02-17T14:28:00.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.360+0000 7f5e4e59c640 1 --2- 172.21.15.134:0/1835527292 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f5e3006b780 0x7f5e3006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.360+0000 7f5e4e59c640 1 --2- 172.21.15.134:0/1835527292 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f5e3006b780 0x7f5e3006dc40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e40036000 tx=0x7f5e4003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:00.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.364+0000 7f5e3effd640 1 -- 172.21.15.134:0/1835527292 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5e48055620 con 0x7f5e501de8a0 2024-02-17T14:28:00.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.548+0000 7f5e54a88640 1 -- 172.21.15.134:0/1835527292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e50142530 con 0x7f5e501de8a0 2024-02-17T14:28:00.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.549+0000 7f5e3effd640 1 -- 172.21.15.134:0/1835527292 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e48058ce0 con 0x7f5e501de8a0 2024-02-17T14:28:00.548 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-02-17T14:28:00.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.551+0000 7f5e54a88640 1 -- 172.21.15.134:0/1835527292 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f5e3006b780 msgr2=0x7f5e3006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.551+0000 7f5e54a88640 1 --2- 172.21.15.134:0/1835527292 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f5e3006b780 0x7f5e3006dc40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e40036000 tx=0x7f5e4003d040 comp rx=0 tx=0).stop 2024-02-17T14:28:00.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.551+0000 7f5e54a88640 1 -- 172.21.15.134:0/1835527292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e501de8a0 msgr2=0x7f5e50136270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.551+0000 7f5e54a88640 1 --2- 172.21.15.134:0/1835527292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e501de8a0 0x7f5e50136270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800efc0 tx=0x7f5e4800c490 comp rx=0 tx=0).stop 2024-02-17T14:28:00.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.551+0000 7f5e54a88640 1 -- 172.21.15.134:0/1835527292 shutdown_connections 2024-02-17T14:28:00.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.551+0000 7f5e54a88640 1 --2- 172.21.15.134:0/1835527292 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f5e3006b780 0x7f5e3006dc40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.551+0000 7f5e54a88640 1 --2- 172.21.15.134:0/1835527292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e501de8a0 0x7f5e50136270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.551+0000 7f5e54a88640 1 --2- 172.21.15.134:0/1835527292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e500b59b0 0x7f5e501de360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.551+0000 7f5e54a88640 1 --2- 172.21.15.134:0/1835527292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e500b32b0 0x7f5e501dde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.551+0000 7f5e54a88640 1 -- 172.21.15.134:0/1835527292 >> 172.21.15.134:0/1835527292 conn(0x7f5e500b9350 msgr2=0x7f5e500b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:00.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.551+0000 7f5e54a88640 1 -- 172.21.15.134:0/1835527292 shutdown_connections 2024-02-17T14:28:00.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.551+0000 7f5e54a88640 1 -- 172.21.15.134:0/1835527292 wait complete. 2024-02-17T14:28:00.561 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-17T14:28:00.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.664+0000 7f0e46fc7640 1 Processor -- start 2024-02-17T14:28:00.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.664+0000 7f0e46fc7640 1 -- start start 2024-02-17T14:28:00.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e46fc7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4006ae10 0x7f0e400b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e46fc7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e40140a90 0x7f0e40140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e46fc7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e40071330 con 0x7f0e40070ef0 2024-02-17T14:28:00.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e46fc7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e40071850 con 0x7f0e40140a90 2024-02-17T14:28:00.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e46fc7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e40073240 con 0x7f0e4006ae10 2024-02-17T14:28:00.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e3ffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0e40070ef0 0x7f0e400afe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45986/0 (socket says 172.21.15.134:45986) 2024-02-17T14:28:00.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e3ffff640 1 -- 172.21.15.134:0/2649318824 learned_addr learned my addr 172.21.15.134:0/2649318824 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:00.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e44d63640 1 --2- 172.21.15.134:0/2649318824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4006ae10 0x7f0e400b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e45564640 1 --2- 172.21.15.134:0/2649318824 >> v2:172.21.15.142:3300/0 conn(0x7f0e40140a90 0x7f0e40140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e3f7fe640 1 -- 172.21.15.134:0/2649318824 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163945224 0 0) 0x7f0e40071330 con 0x7f0e40070ef0 2024-02-17T14:28:00.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e3f7fe640 1 -- 172.21.15.134:0/2649318824 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e30003520 con 0x7f0e40070ef0 2024-02-17T14:28:00.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e3f7fe640 1 -- 172.21.15.134:0/2649318824 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2998841788 0 0) 0x7f0e30003520 con 0x7f0e40070ef0 2024-02-17T14:28:00.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e45564640 1 -- 172.21.15.134:0/2649318824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4006ae10 msgr2=0x7f0e400b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:00.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e45564640 1 --2- 172.21.15.134:0/2649318824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4006ae10 0x7f0e400b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e45564640 1 -- 172.21.15.134:0/2649318824 >> v1:172.21.15.134:6789/0 conn(0x7f0e40070ef0 legacy=0x7f0e400afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e45564640 1 -- 172.21.15.134:0/2649318824 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4006b1f0 con 0x7f0e40140a90 2024-02-17T14:28:00.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.665+0000 7f0e44d63640 1 --2- 172.21.15.134:0/2649318824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4006ae10 0x7f0e400b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:00.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.666+0000 7f0e45564640 1 --2- 172.21.15.134:0/2649318824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e40140a90 0x7f0e40140ee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009d90 tx=0x7f0e3802bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9acd738c6186b672 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:00.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.666+0000 7f0e3f7fe640 1 -- 172.21.15.134:0/2649318824 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c001670 con 0x7f0e40140a90 2024-02-17T14:28:00.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.666+0000 7f0e3f7fe640 1 -- 172.21.15.134:0/2649318824 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3802c8a0 con 0x7f0e40140a90 2024-02-17T14:28:00.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.666+0000 7f0e3f7fe640 1 -- 172.21.15.134:0/2649318824 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3802cc30 con 0x7f0e40140a90 2024-02-17T14:28:00.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.667+0000 7f0e46fc7640 1 -- 172.21.15.134:0/2649318824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e40140a90 msgr2=0x7f0e40140ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.667+0000 7f0e46fc7640 1 --2- 172.21.15.134:0/2649318824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e40140a90 0x7f0e40140ee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009d90 tx=0x7f0e3802bd70 comp rx=0 tx=0).stop 2024-02-17T14:28:00.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.667+0000 7f0e46fc7640 1 -- 172.21.15.134:0/2649318824 shutdown_connections 2024-02-17T14:28:00.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.667+0000 7f0e46fc7640 1 --2- 172.21.15.134:0/2649318824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e40140a90 0x7f0e40140ee0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.667+0000 7f0e46fc7640 1 --2- 172.21.15.134:0/2649318824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4006ae10 0x7f0e400b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.667+0000 7f0e46fc7640 1 -- 172.21.15.134:0/2649318824 >> 172.21.15.134:0/2649318824 conn(0x7f0e400b9350 msgr2=0x7f0e400b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:00.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.667+0000 7f0e46fc7640 1 -- 172.21.15.134:0/2649318824 shutdown_connections 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.667+0000 7f0e46fc7640 1 -- 172.21.15.134:0/2649318824 wait complete. 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.668+0000 7f0e46fc7640 1 Processor -- start 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.668+0000 7f0e46fc7640 1 -- start start 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e46fc7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e4006ae10 0x7f0e400ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e46fc7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e40070ef0 0x7f0e401e00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e46fc7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e40140a90 0x7f0e401e0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e46fc7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400ae490 con 0x7f0e40070ef0 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e46fc7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400af450 con 0x7f0e4006ae10 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e46fc7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400ade40 con 0x7f0e40140a90 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e3ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e40070ef0 0x7f0e401e00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e3ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e40070ef0 0x7f0e401e00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47846/0 (socket says 172.21.15.134:47846) 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e3ffff640 1 -- 172.21.15.134:0/1156683373 learned_addr learned my addr 172.21.15.134:0/1156683373 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e45564640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e40140a90 0x7f0e401e0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e44d63640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e4006ae10 0x7f0e400ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e3ffff640 1 -- 172.21.15.134:0/1156683373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e40140a90 msgr2=0x7f0e401e0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e3ffff640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e40140a90 0x7f0e401e0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e3ffff640 1 -- 172.21.15.134:0/1156683373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e4006ae10 msgr2=0x7f0e400ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e3ffff640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e4006ae10 0x7f0e400ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e3ffff640 1 -- 172.21.15.134:0/1156683373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e34009400 con 0x7f0e40070ef0 2024-02-17T14:28:00.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.669+0000 7f0e3ffff640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e40070ef0 0x7f0e401e00d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c00c750 tx=0x7f0e2c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:00.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.670+0000 7f0e3d7fa640 1 -- 172.21.15.134:0/1156683373 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c005ad0 con 0x7f0e40070ef0 2024-02-17T14:28:00.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.670+0000 7f0e3d7fa640 1 -- 172.21.15.134:0/1156683373 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c005c50 con 0x7f0e40070ef0 2024-02-17T14:28:00.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.670+0000 7f0e46fc7640 1 -- 172.21.15.134:0/1156683373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e38009a70 con 0x7f0e40070ef0 2024-02-17T14:28:00.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.670+0000 7f0e3d7fa640 1 -- 172.21.15.134:0/1156683373 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c007070 con 0x7f0e40070ef0 2024-02-17T14:28:00.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.670+0000 7f0e46fc7640 1 -- 172.21.15.134:0/1156683373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e400af170 con 0x7f0e40070ef0 2024-02-17T14:28:00.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.671+0000 7f0e46fc7640 1 -- 172.21.15.134:0/1156683373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e400b55c0 con 0x7f0e40070ef0 2024-02-17T14:28:00.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.671+0000 7f0e3d7fa640 1 -- 172.21.15.134:0/1156683373 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7f0e2c0071d0 con 0x7f0e40070ef0 2024-02-17T14:28:00.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.671+0000 7f0e3d7fa640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0e2406b780 0x7f0e2406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.672+0000 7f0e3d7fa640 1 -- 172.21.15.134:0/1156683373 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0e2c089900 con 0x7f0e40070ef0 2024-02-17T14:28:00.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.672+0000 7f0e44d63640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0e2406b780 0x7f0e2406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.672+0000 7f0e44d63640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0e2406b780 0x7f0e2406dc40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0e40147cb0 tx=0x7f0e34009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:00.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.676+0000 7f0e3d7fa640 1 -- 172.21.15.134:0/1156683373 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0e2c054890 con 0x7f0e40070ef0 2024-02-17T14:28:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.856+0000 7f0e46fc7640 1 -- 172.21.15.134:0/1156683373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0e40068280 con 0x7f0e40070ef0 2024-02-17T14:28:00.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.857+0000 7f0e3d7fa640 1 -- 172.21.15.134:0/1156683373 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0e2c057f50 con 0x7f0e40070ef0 2024-02-17T14:28:00.856 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:00.856 INFO:teuthology.orchestra.run.smithi134.stdout:[ 2024-02-17T14:28:00.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-02-17T14:28:00.856 INFO:teuthology.orchestra.run.smithi134.stdout: "poolnum": 1, 2024-02-17T14:28:00.856 INFO:teuthology.orchestra.run.smithi134.stdout: "poolname": ".mgr" 2024-02-17T14:28:00.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-17T14:28:00.856 INFO:teuthology.orchestra.run.smithi134.stdout:] 2024-02-17T14:28:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.859+0000 7f0e46fc7640 1 -- 172.21.15.134:0/1156683373 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0e2406b780 msgr2=0x7f0e2406dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.859+0000 7f0e46fc7640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0e2406b780 0x7f0e2406dc40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0e40147cb0 tx=0x7f0e34009190 comp rx=0 tx=0).stop 2024-02-17T14:28:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.859+0000 7f0e46fc7640 1 -- 172.21.15.134:0/1156683373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e40070ef0 msgr2=0x7f0e401e00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.859+0000 7f0e46fc7640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e40070ef0 0x7f0e401e00d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c00c750 tx=0x7f0e2c00cc10 comp rx=0 tx=0).stop 2024-02-17T14:28:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.859+0000 7f0e46fc7640 1 -- 172.21.15.134:0/1156683373 shutdown_connections 2024-02-17T14:28:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.859+0000 7f0e46fc7640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e40140a90 0x7f0e401e0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.859+0000 7f0e46fc7640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0e2406b780 0x7f0e2406dc40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.859+0000 7f0e46fc7640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e40070ef0 0x7f0e401e00d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.859+0000 7f0e46fc7640 1 --2- 172.21.15.134:0/1156683373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e4006ae10 0x7f0e400ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.859+0000 7f0e46fc7640 1 -- 172.21.15.134:0/1156683373 >> 172.21.15.134:0/1156683373 conn(0x7f0e400b9350 msgr2=0x7f0e400b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.859+0000 7f0e46fc7640 1 -- 172.21.15.134:0/1156683373 shutdown_connections 2024-02-17T14:28:00.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.859+0000 7f0e46fc7640 1 -- 172.21.15.134:0/1156683373 wait complete. 2024-02-17T14:28:00.868 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-17T14:28:00.869 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-17T14:28:00.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.977+0000 7f479228d640 1 Processor -- start 2024-02-17T14:28:00.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.977+0000 7f479228d640 1 -- start start 2024-02-17T14:28:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.977+0000 7f479228d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f478c06e4e0 0x7f478c0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.977+0000 7f479228d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f478c071c50 0x7f478c151b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.977+0000 7f479228d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478c06bfe0 con 0x7f478c06c400 2024-02-17T14:28:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.977+0000 7f479228d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478c06f690 con 0x7f478c06e4e0 2024-02-17T14:28:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.977+0000 7f479228d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478c0b5620 con 0x7f478c071c50 2024-02-17T14:28:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.977+0000 7f478bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f478c06e4e0 0x7f478c0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.977+0000 7f478bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f478c06e4e0 0x7f478c0b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47858/0 (socket says 172.21.15.134:47858) 2024-02-17T14:28:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.977+0000 7f478bfff640 1 -- 172.21.15.134:0/3153812921 learned_addr learned my addr 172.21.15.134:0/3153812921 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.977+0000 7f478b7fe640 1 --1- 172.21.15.134:0/3153812921 >> v1:172.21.15.134:6789/0 conn(0x7f478c06c400 0x7f478c071540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45998/0 (socket says 172.21.15.134:45998) 2024-02-17T14:28:00.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.978+0000 7f479082a640 1 --2- 172.21.15.134:0/3153812921 >> v2:172.21.15.142:3300/0 conn(0x7f478c071c50 0x7f478c151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.978+0000 7f478bfff640 1 -- 172.21.15.134:0/3153812921 >> v2:172.21.15.142:3300/0 conn(0x7f478c071c50 msgr2=0x7f478c151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:00.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.978+0000 7f478bfff640 1 --2- 172.21.15.134:0/3153812921 >> v2:172.21.15.142:3300/0 conn(0x7f478c071c50 0x7f478c151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.978+0000 7f478bfff640 1 -- 172.21.15.134:0/3153812921 >> v1:172.21.15.134:6789/0 conn(0x7f478c06c400 legacy=0x7f478c071540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.978+0000 7f478bfff640 1 -- 172.21.15.134:0/3153812921 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c0b5900 con 0x7f478c06e4e0 2024-02-17T14:28:00.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.978+0000 7f478affd640 1 -- 172.21.15.134:0/3153812921 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677582873 0 0) 0x7f478c06bfe0 con 0x7f478c06c400 2024-02-17T14:28:00.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.978+0000 7f478bfff640 1 --2- 172.21.15.134:0/3153812921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c06e4e0 0x7f478c0b5e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f477c009870 tx=0x7f477c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9562c20abb95dd server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:00.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.979+0000 7f478affd640 1 -- 172.21.15.134:0/3153812921 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c030860 con 0x7f478c06e4e0 2024-02-17T14:28:00.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.979+0000 7f478affd640 1 -- 172.21.15.134:0/3153812921 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c0309c0 con 0x7f478c06e4e0 2024-02-17T14:28:00.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.979+0000 7f478affd640 1 -- 172.21.15.134:0/3153812921 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c030d50 con 0x7f478c06e4e0 2024-02-17T14:28:00.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.979+0000 7f479228d640 1 -- 172.21.15.134:0/3153812921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c06e4e0 msgr2=0x7f478c0b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.979+0000 7f479228d640 1 --2- 172.21.15.134:0/3153812921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c06e4e0 0x7f478c0b5e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f477c009870 tx=0x7f477c02b9a0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.979+0000 7f479228d640 1 -- 172.21.15.134:0/3153812921 shutdown_connections 2024-02-17T14:28:00.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.979+0000 7f479228d640 1 --2- 172.21.15.134:0/3153812921 >> v2:172.21.15.142:3300/0 conn(0x7f478c071c50 0x7f478c151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.979+0000 7f479228d640 1 --2- 172.21.15.134:0/3153812921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c06e4e0 0x7f478c0b5e20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.979+0000 7f479228d640 1 -- 172.21.15.134:0/3153812921 >> 172.21.15.134:0/3153812921 conn(0x7f478c0ba4c0 msgr2=0x7f478c0ba8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:00.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.979+0000 7f479228d640 1 -- 172.21.15.134:0/3153812921 shutdown_connections 2024-02-17T14:28:00.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.979+0000 7f479228d640 1 -- 172.21.15.134:0/3153812921 wait complete. 2024-02-17T14:28:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.980+0000 7f479228d640 1 Processor -- start 2024-02-17T14:28:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.980+0000 7f479228d640 1 -- start start 2024-02-17T14:28:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f479228d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c06c400 0x7f478c0b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f479228d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f478c06e4e0 0x7f478c1dc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f479228d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f478c071c50 0x7f478c1cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f479228d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0b4250 con 0x7f478c06c400 2024-02-17T14:28:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f479228d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0b2bd0 con 0x7f478c06e4e0 2024-02-17T14:28:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f479228d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c09c2a0 con 0x7f478c071c50 2024-02-17T14:28:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f478bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c06c400 0x7f478c0b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f478bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c06c400 0x7f478c0b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47868/0 (socket says 172.21.15.134:47868) 2024-02-17T14:28:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f478bfff640 1 -- 172.21.15.134:0/532146474 learned_addr learned my addr 172.21.15.134:0/532146474 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f478b7fe640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f478c06e4e0 0x7f478c1dc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f479082a640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f478c071c50 0x7f478c1cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f478bfff640 1 -- 172.21.15.134:0/532146474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f478c071c50 msgr2=0x7f478c1cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f478bfff640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f478c071c50 0x7f478c1cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f478bfff640 1 -- 172.21.15.134:0/532146474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f478c06e4e0 msgr2=0x7f478c1dc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f478bfff640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f478c06e4e0 0x7f478c1dc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f478bfff640 1 -- 172.21.15.134:0/532146474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0094d0 con 0x7f478c06c400 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f478b7fe640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f478c06e4e0 0x7f478c1dc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f478bfff640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c06c400 0x7f478c0b3d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f477c02b9e0 tx=0x7f477c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f4788ff9640 1 -- 172.21.15.134:0/532146474 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c039c90 con 0x7f478c06c400 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f4788ff9640 1 -- 172.21.15.134:0/532146474 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c039df0 con 0x7f478c06c400 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f479228d640 1 -- 172.21.15.134:0/532146474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478c06ca10 con 0x7f478c06c400 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f4788ff9640 1 -- 172.21.15.134:0/532146474 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c0446c0 con 0x7f478c06c400 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.981+0000 7f479228d640 1 -- 172.21.15.134:0/532146474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478c1dcf60 con 0x7f478c06c400 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.982+0000 7f479228d640 1 -- 172.21.15.134:0/532146474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478c067b70 con 0x7f478c06c400 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.983+0000 7f4788ff9640 1 -- 172.21.15.134:0/532146474 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 89732+0+0 (secure 0 0 0) 0x7f477c04d3b0 con 0x7f478c06c400 2024-02-17T14:28:00.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.983+0000 7f4788ff9640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f477806b780 0x7f477806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:00.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.983+0000 7f4788ff9640 1 -- 172.21.15.134:0/532146474 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f477c03e070 con 0x7f478c06c400 2024-02-17T14:28:00.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.983+0000 7f478b7fe640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f477806b780 0x7f477806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:00.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.984+0000 7f478b7fe640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f477806b780 0x7f477806dc40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f478c1da0e0 tx=0x7f4780007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:00.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:00.988+0000 7f4788ff9640 1 -- 172.21.15.134:0/532146474 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f477c077710 con 0x7f478c06c400 2024-02-17T14:28:01.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:01.160+0000 7f479228d640 1 -- 172.21.15.134:0/532146474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f478c0af540 con 0x7f478c06c400 2024-02-17T14:28:01.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:01.617+0000 7f4788ff9640 1 -- 172.21.15.134:0/532146474 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f477c077ae0 con 0x7f478c06c400 2024-02-17T14:28:02.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.045+0000 7f4788ff9640 1 -- 172.21.15.134:0/532146474 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f477c08f430 con 0x7f478c06c400 2024-02-17T14:28:02.045 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' created 2024-02-17T14:28:02.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.048+0000 7f479228d640 1 -- 172.21.15.134:0/532146474 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f477806b780 msgr2=0x7f477806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:02.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.048+0000 7f479228d640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f477806b780 0x7f477806dc40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f478c1da0e0 tx=0x7f4780007c10 comp rx=0 tx=0).stop 2024-02-17T14:28:02.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.048+0000 7f479228d640 1 -- 172.21.15.134:0/532146474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c06c400 msgr2=0x7f478c0b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:02.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.048+0000 7f479228d640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c06c400 0x7f478c0b3d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f477c02b9e0 tx=0x7f477c004730 comp rx=0 tx=0).stop 2024-02-17T14:28:02.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.049+0000 7f479228d640 1 -- 172.21.15.134:0/532146474 shutdown_connections 2024-02-17T14:28:02.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.049+0000 7f479228d640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f478c071c50 0x7f478c1cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:02.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.049+0000 7f479228d640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f478c06e4e0 0x7f478c1dc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:02.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.049+0000 7f479228d640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f477806b780 0x7f477806dc40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:02.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.049+0000 7f479228d640 1 --2- 172.21.15.134:0/532146474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c06c400 0x7f478c0b3d10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:02.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.049+0000 7f479228d640 1 -- 172.21.15.134:0/532146474 >> 172.21.15.134:0/532146474 conn(0x7f478c0ba4c0 msgr2=0x7f478c1cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:02.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.050+0000 7f479228d640 1 -- 172.21.15.134:0/532146474 shutdown_connections 2024-02-17T14:28:02.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.050+0000 7f479228d640 1 -- 172.21.15.134:0/532146474 wait complete. 2024-02-17T14:28:02.063 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-02-17T14:28:02.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.172+0000 7fda7c5bc640 1 Processor -- start 2024-02-17T14:28:02.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.172+0000 7fda7c5bc640 1 -- start start 2024-02-17T14:28:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda7c5bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7406d800 0x7fda740b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda7c5bc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fda7414b150 0x7fda74151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda7c5bc640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda740b6500 con 0x7fda7414a5e0 2024-02-17T14:28:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda7c5bc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda740b61d0 con 0x7fda7414b150 2024-02-17T14:28:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda7c5bc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7406dbe0 con 0x7fda7406d800 2024-02-17T14:28:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda79b57640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fda7414a5e0 0x7fda7414aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:46004/0 (socket says 172.21.15.134:46004) 2024-02-17T14:28:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda79b57640 1 -- 172.21.15.134:0/1938362629 learned_addr learned my addr 172.21.15.134:0/1938362629 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda7ab59640 1 --2- 172.21.15.134:0/1938362629 >> v2:172.21.15.142:3300/0 conn(0x7fda7414b150 0x7fda74151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda7a358640 1 --2- 172.21.15.134:0/1938362629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7406d800 0x7fda740b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:02.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350166704 0 0) 0x7fda740b6500 con 0x7fda7414a5e0 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda60003520 con 0x7fda7414a5e0 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 280380544 0 0) 0x7fda60003520 con 0x7fda7414a5e0 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7406d800 msgr2=0x7fda740b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda79356640 1 --2- 172.21.15.134:0/1938362629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7406d800 0x7fda740b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 >> v2:172.21.15.142:3300/0 conn(0x7fda7414b150 msgr2=0x7fda74151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda79356640 1 --2- 172.21.15.134:0/1938362629 >> v2:172.21.15.142:3300/0 conn(0x7fda7414b150 0x7fda74151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7406cd90 con 0x7fda7414a5e0 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7fda64001670 con 0x7fda7414a5e0 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.173+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 >> v1:172.21.15.134:6789/0 conn(0x7fda7414a5e0 legacy=0x7fda7414aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda79356640 1 --2- 172.21.15.134:0/1938362629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7406d800 0x7fda60003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda79356640 1 --2- 172.21.15.134:0/1938362629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda60003ef0 0x7fda600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda79356640 1 --2- 172.21.15.134:0/1938362629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda60004d00 0x7fda60005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda740b61d0 con 0x7fda60003ef0 2024-02-17T14:28:02.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7406dbe0 con 0x7fda60004d00 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6000b9d0 con 0x7fda7406d800 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda79b57640 1 --2- 172.21.15.134:0/1938362629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda60003ef0 0x7fda600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda7a358640 1 --2- 172.21.15.134:0/1938362629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7406d800 0x7fda60003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda7ab59640 1 --2- 172.21.15.134:0/1938362629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda60004d00 0x7fda60005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda79b57640 1 -- 172.21.15.134:0/1938362629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7406d800 msgr2=0x7fda60003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda79b57640 1 --2- 172.21.15.134:0/1938362629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7406d800 0x7fda60003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda79b57640 1 -- 172.21.15.134:0/1938362629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda60004d00 msgr2=0x7fda60005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda79b57640 1 --2- 172.21.15.134:0/1938362629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda60004d00 0x7fda60005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.174+0000 7fda79b57640 1 -- 172.21.15.134:0/1938362629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60003520 con 0x7fda60003ef0 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.175+0000 7fda79b57640 1 --2- 172.21.15.134:0/1938362629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda60003ef0 0x7fda600047c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fda6400c2c0 tx=0x7fda600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2116626904d4d297 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.175+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64005ad0 con 0x7fda60003ef0 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.175+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda64005c30 con 0x7fda60003ef0 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.175+0000 7fda79356640 1 -- 172.21.15.134:0/1938362629 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6402c8b0 con 0x7fda60003ef0 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.175+0000 7fda7c5bc640 1 -- 172.21.15.134:0/1938362629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda60003ef0 msgr2=0x7fda600047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:02.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.175+0000 7fda7c5bc640 1 --2- 172.21.15.134:0/1938362629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda60003ef0 0x7fda600047c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fda6400c2c0 tx=0x7fda600057f0 comp rx=0 tx=0).stop 2024-02-17T14:28:02.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.175+0000 7fda7ab59640 1 -- 172.21.15.134:0/1938362629 reap_dead start 2024-02-17T14:28:02.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.175+0000 7fda7c5bc640 1 -- 172.21.15.134:0/1938362629 shutdown_connections 2024-02-17T14:28:02.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.175+0000 7fda7c5bc640 1 -- 172.21.15.134:0/1938362629 >> 172.21.15.134:0/1938362629 conn(0x7fda740b6f40 msgr2=0x7fda740b7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:02.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.175+0000 7fda7c5bc640 1 -- 172.21.15.134:0/1938362629 shutdown_connections 2024-02-17T14:28:02.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.175+0000 7fda7c5bc640 1 -- 172.21.15.134:0/1938362629 wait complete. 2024-02-17T14:28:02.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.176+0000 7fda7c5bc640 1 Processor -- start 2024-02-17T14:28:02.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.176+0000 7fda7c5bc640 1 -- start start 2024-02-17T14:28:02.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7c5bc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda60003ef0 0x7fda741dfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:02.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7c5bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda741e0120 0x7fda741438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7c5bc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda74143e30 0x7fda740ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7c5bc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda740b0650 con 0x7fda60003ef0 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7c5bc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda74122a70 con 0x7fda74143e30 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7c5bc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda740af9b0 con 0x7fda741e0120 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7a358640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda60003ef0 0x7fda741dfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7a358640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda60003ef0 0x7fda741dfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47896/0 (socket says 172.21.15.134:47896) 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7a358640 1 -- 172.21.15.134:0/2802779735 learned_addr learned my addr 172.21.15.134:0/2802779735 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7ab59640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda74143e30 0x7fda740ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7a358640 1 -- 172.21.15.134:0/2802779735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda741e0120 msgr2=0x7fda741438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda79b57640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda741e0120 0x7fda741438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7a358640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda741e0120 0x7fda741438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7a358640 1 -- 172.21.15.134:0/2802779735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda74143e30 msgr2=0x7fda740ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7a358640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda74143e30 0x7fda740ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7a358640 1 -- 172.21.15.134:0/2802779735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda740afc90 con 0x7fda60003ef0 2024-02-17T14:28:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7ab59640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda74143e30 0x7fda740ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.177+0000 7fda7a358640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda60003ef0 0x7fda741dfbe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda700118e0 tx=0x7fda70011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.178+0000 7fda6affd640 1 -- 172.21.15.134:0/2802779735 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000faf0 con 0x7fda60003ef0 2024-02-17T14:28:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.178+0000 7fda6affd640 1 -- 172.21.15.134:0/2802779735 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7000fc50 con 0x7fda60003ef0 2024-02-17T14:28:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.178+0000 7fda7c5bc640 1 -- 172.21.15.134:0/2802779735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda74122cc0 con 0x7fda60003ef0 2024-02-17T14:28:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.178+0000 7fda6affd640 1 -- 172.21.15.134:0/2802779735 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70014440 con 0x7fda60003ef0 2024-02-17T14:28:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.178+0000 7fda7c5bc640 1 -- 172.21.15.134:0/2802779735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda740b0a70 con 0x7fda60003ef0 2024-02-17T14:28:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.179+0000 7fda7c5bc640 1 -- 172.21.15.134:0/2802779735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda740b08c0 con 0x7fda60003ef0 2024-02-17T14:28:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.179+0000 7fda6affd640 1 -- 172.21.15.134:0/2802779735 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fda7001d400 con 0x7fda60003ef0 2024-02-17T14:28:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.179+0000 7fda6affd640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fda5806b840 0x7fda5806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.179+0000 7fda79b57640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fda5806b840 0x7fda5806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.179+0000 7fda6affd640 1 -- 172.21.15.134:0/2802779735 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fda7008a760 con 0x7fda60003ef0 2024-02-17T14:28:02.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.180+0000 7fda79b57640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fda5806b840 0x7fda5806dd00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fda64034000 tx=0x7fda64007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:02.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.184+0000 7fda6affd640 1 -- 172.21.15.134:0/2802779735 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda700553f0 con 0x7fda60003ef0 2024-02-17T14:28:02.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:02.353+0000 7fda7c5bc640 1 -- 172.21.15.134:0/2802779735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fda740af810 con 0x7fda60003ef0 2024-02-17T14:28:03.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.051+0000 7fda6affd640 1 -- 172.21.15.134:0/2802779735 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fda740af810 con 0x7fda60003ef0 2024-02-17T14:28:03.188 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' created 2024-02-17T14:28:03.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.054+0000 7fda7c5bc640 1 -- 172.21.15.134:0/2802779735 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fda5806b840 msgr2=0x7fda5806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:03.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.054+0000 7fda7c5bc640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fda5806b840 0x7fda5806dd00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fda64034000 tx=0x7fda64007000 comp rx=0 tx=0).stop 2024-02-17T14:28:03.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.054+0000 7fda7c5bc640 1 -- 172.21.15.134:0/2802779735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda60003ef0 msgr2=0x7fda741dfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:03.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.054+0000 7fda7c5bc640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda60003ef0 0x7fda741dfbe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda700118e0 tx=0x7fda70011da0 comp rx=0 tx=0).stop 2024-02-17T14:28:03.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.055+0000 7fda7c5bc640 1 -- 172.21.15.134:0/2802779735 shutdown_connections 2024-02-17T14:28:03.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.055+0000 7fda7c5bc640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda74143e30 0x7fda740ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:03.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.055+0000 7fda7c5bc640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda741e0120 0x7fda741438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:03.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.055+0000 7fda7c5bc640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fda5806b840 0x7fda5806dd00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:03.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.055+0000 7fda7c5bc640 1 --2- 172.21.15.134:0/2802779735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda60003ef0 0x7fda741dfbe0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:03.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.055+0000 7fda7c5bc640 1 -- 172.21.15.134:0/2802779735 >> 172.21.15.134:0/2802779735 conn(0x7fda740b6f40 msgr2=0x7fda740b7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:03.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.057+0000 7fda7c5bc640 1 -- 172.21.15.134:0/2802779735 shutdown_connections 2024-02-17T14:28:03.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.062+0000 7fda7c5bc640 1 -- 172.21.15.134:0/2802779735 wait complete. 2024-02-17T14:28:03.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-17T14:28:03.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.302+0000 7f73afed4640 1 Processor -- start 2024-02-17T14:28:03.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.302+0000 7f73afed4640 1 -- start start 2024-02-17T14:28:03.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73afed4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f73a80b5610 0x7f73a806e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:03.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73afed4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f73a809bd10 0x7f73a80b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:03.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73afed4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a8146f40 0x7f73a806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:03.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73afed4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a80b6190 con 0x7f73a80b5610 2024-02-17T14:28:03.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73afed4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a806de70 con 0x7f73a809bd10 2024-02-17T14:28:03.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73afed4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a806e270 con 0x7f73a8146f40 2024-02-17T14:28:03.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73adc70640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f73a80b5610 0x7f73a806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:03.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73adc70640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f73a80b5610 0x7f73a806e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47908/0 (socket says 172.21.15.134:47908) 2024-02-17T14:28:03.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73adc70640 1 -- 172.21.15.134:0/2153492488 learned_addr learned my addr 172.21.15.134:0/2153492488 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:03.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73ae471640 1 --2- 172.21.15.134:0/2153492488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a8146f40 0x7f73a806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:03.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73adc70640 1 -- 172.21.15.134:0/2153492488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a8146f40 msgr2=0x7f73a806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:03.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73adc70640 1 --2- 172.21.15.134:0/2153492488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a8146f40 0x7f73a806cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:03.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73adc70640 1 -- 172.21.15.134:0/2153492488 >> v2:172.21.15.142:3300/0 conn(0x7f73a809bd10 msgr2=0x7f73a80b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:03.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73ad46f640 1 --2- 172.21.15.134:0/2153492488 >> v2:172.21.15.142:3300/0 conn(0x7f73a809bd10 0x7f73a80b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:03.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73adc70640 1 --2- 172.21.15.134:0/2153492488 >> v2:172.21.15.142:3300/0 conn(0x7f73a809bd10 0x7f73a80b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:03.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73adc70640 1 -- 172.21.15.134:0/2153492488 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a81473f0 con 0x7f73a80b5610 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.303+0000 7f73ae471640 1 --2- 172.21.15.134:0/2153492488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a8146f40 0x7f73a806cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.304+0000 7f73adc70640 1 --2- 172.21.15.134:0/2153492488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a80b5610 0x7f73a806e700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f73a80b1760 tx=0x7f73a402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cb99249439af05 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.304+0000 7f73acc6e640 1 -- 172.21.15.134:0/2153492488 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a402c950 con 0x7f73a80b5610 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.304+0000 7f73acc6e640 1 -- 172.21.15.134:0/2153492488 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a402cab0 con 0x7f73a80b5610 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.304+0000 7f73acc6e640 1 -- 172.21.15.134:0/2153492488 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a402ce40 con 0x7f73a80b5610 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.305+0000 7f73afed4640 1 -- 172.21.15.134:0/2153492488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a80b5610 msgr2=0x7f73a806e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.305+0000 7f73afed4640 1 --2- 172.21.15.134:0/2153492488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a80b5610 0x7f73a806e700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f73a80b1760 tx=0x7f73a402bdb0 comp rx=0 tx=0).stop 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.305+0000 7f73afed4640 1 -- 172.21.15.134:0/2153492488 shutdown_connections 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.305+0000 7f73afed4640 1 --2- 172.21.15.134:0/2153492488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a8146f40 0x7f73a806cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.305+0000 7f73afed4640 1 --2- 172.21.15.134:0/2153492488 >> v2:172.21.15.142:3300/0 conn(0x7f73a809bd10 0x7f73a80b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.305+0000 7f73afed4640 1 --2- 172.21.15.134:0/2153492488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a80b5610 0x7f73a806e700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.305+0000 7f73afed4640 1 -- 172.21.15.134:0/2153492488 >> 172.21.15.134:0/2153492488 conn(0x7f73a80ba430 msgr2=0x7f73a80ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.305+0000 7f73afed4640 1 -- 172.21.15.134:0/2153492488 shutdown_connections 2024-02-17T14:28:03.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.305+0000 7f73afed4640 1 -- 172.21.15.134:0/2153492488 wait complete. 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.306+0000 7f73afed4640 1 Processor -- start 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.306+0000 7f73afed4640 1 -- start start 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.306+0000 7f73afed4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a809bd10 0x7f73a809fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.306+0000 7f73afed4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a80b5610 0x7f73a81dc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.306+0000 7f73afed4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a8146f40 0x7f73a8140a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.306+0000 7f73afed4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a80b1300 con 0x7f73a809bd10 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.306+0000 7f73afed4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a80af5f0 con 0x7f73a8146f40 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.306+0000 7f73afed4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a80b00a0 con 0x7f73a80b5610 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73adc70640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a809bd10 0x7f73a809fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73adc70640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a809bd10 0x7f73a809fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47914/0 (socket says 172.21.15.134:47914) 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73adc70640 1 -- 172.21.15.134:0/3664018985 learned_addr learned my addr 172.21.15.134:0/3664018985 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73ad46f640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a80b5610 0x7f73a81dc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73ae471640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a8146f40 0x7f73a8140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:03.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73adc70640 1 -- 172.21.15.134:0/3664018985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a80b5610 msgr2=0x7f73a81dc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:03.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73adc70640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a80b5610 0x7f73a81dc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:03.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73adc70640 1 -- 172.21.15.134:0/3664018985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a8146f40 msgr2=0x7f73a8140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:03.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73adc70640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a8146f40 0x7f73a8140a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:03.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73adc70640 1 -- 172.21.15.134:0/3664018985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a4009b30 con 0x7f73a809bd10 2024-02-17T14:28:03.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73ae471640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a8146f40 0x7f73a8140a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:03.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73adc70640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a809bd10 0x7f73a809fe20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f73a4000f80 tx=0x7f73a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:03.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f739e7fc640 1 -- 172.21.15.134:0/3664018985 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a403e450 con 0x7f73a809bd10 2024-02-17T14:28:03.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f739e7fc640 1 -- 172.21.15.134:0/3664018985 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a403e5d0 con 0x7f73a809bd10 2024-02-17T14:28:03.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73afed4640 1 -- 172.21.15.134:0/3664018985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a80b17e0 con 0x7f73a809bd10 2024-02-17T14:28:03.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f739e7fc640 1 -- 172.21.15.134:0/3664018985 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a403e980 con 0x7f73a809bd10 2024-02-17T14:28:03.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.307+0000 7f73afed4640 1 -- 172.21.15.134:0/3664018985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a80afd30 con 0x7f73a809bd10 2024-02-17T14:28:03.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.308+0000 7f73afed4640 1 -- 172.21.15.134:0/3664018985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a80af7a0 con 0x7f73a809bd10 2024-02-17T14:28:03.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.309+0000 7f739e7fc640 1 -- 172.21.15.134:0/3664018985 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f73a403eae0 con 0x7f73a809bd10 2024-02-17T14:28:03.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.309+0000 7f739e7fc640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f738c06b810 0x7f738c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:03.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.309+0000 7f739e7fc640 1 -- 172.21.15.134:0/3664018985 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f73a40ad430 con 0x7f73a809bd10 2024-02-17T14:28:03.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.309+0000 7f73ad46f640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f738c06b810 0x7f738c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:03.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.309+0000 7f73ad46f640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f738c06b810 0x7f738c06dcd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f73a80b4a00 tx=0x7f7398008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:03.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.313+0000 7f739e7fc640 1 -- 172.21.15.134:0/3664018985 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f73a80af7a0 con 0x7f73a809bd10 2024-02-17T14:28:03.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:03.521+0000 7f73afed4640 1 -- 172.21.15.134:0/3664018985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f73a80af760 con 0x7f73a809bd10 2024-02-17T14:28:04.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.053+0000 7f739e7fc640 1 -- 172.21.15.134:0/3664018985 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f73a4077eb0 con 0x7f73a809bd10 2024-02-17T14:28:04.052 INFO:teuthology.orchestra.run.smithi134.stderr:new fs with metadata pool 2 and data pool 3 2024-02-17T14:28:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.055+0000 7f73afed4640 1 -- 172.21.15.134:0/3664018985 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f738c06b810 msgr2=0x7f738c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.055+0000 7f73afed4640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f738c06b810 0x7f738c06dcd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f73a80b4a00 tx=0x7f7398008040 comp rx=0 tx=0).stop 2024-02-17T14:28:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.055+0000 7f73afed4640 1 -- 172.21.15.134:0/3664018985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a809bd10 msgr2=0x7f73a809fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.055+0000 7f73afed4640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a809bd10 0x7f73a809fe20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f73a4000f80 tx=0x7f73a4004a40 comp rx=0 tx=0).stop 2024-02-17T14:28:04.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.055+0000 7f73afed4640 1 -- 172.21.15.134:0/3664018985 shutdown_connections 2024-02-17T14:28:04.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.055+0000 7f73afed4640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a8146f40 0x7f73a8140a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.055+0000 7f73afed4640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a80b5610 0x7f73a81dc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.055+0000 7f73afed4640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f738c06b810 0x7f738c06dcd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.055+0000 7f73afed4640 1 --2- 172.21.15.134:0/3664018985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a809bd10 0x7f73a809fe20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.055+0000 7f73afed4640 1 -- 172.21.15.134:0/3664018985 >> 172.21.15.134:0/3664018985 conn(0x7f73a80ba430 msgr2=0x7f73a8071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:04.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.055+0000 7f73afed4640 1 -- 172.21.15.134:0/3664018985 shutdown_connections 2024-02-17T14:28:04.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.055+0000 7f73afed4640 1 -- 172.21.15.134:0/3664018985 wait complete. 2024-02-17T14:28:04.068 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-02-17T14:28:04.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-02-17T14:28:04.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.174+0000 7f13a43f4640 1 Processor -- start 2024-02-17T14:28:04.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.174+0000 7f13a43f4640 1 -- start start 2024-02-17T14:28:04.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.175+0000 7f13a43f4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f139c0b54d0 0x7f139c147670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:04.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.175+0000 7f13a43f4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f139c14a810 0x7f139c1408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:04.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.175+0000 7f13a43f4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139c0b6910 con 0x7f139c14ac90 2024-02-17T14:28:04.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.175+0000 7f13a43f4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139c0b58b0 con 0x7f139c14a810 2024-02-17T14:28:04.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.175+0000 7f13a43f4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139c14b230 con 0x7f139c0b54d0 2024-02-17T14:28:04.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.175+0000 7f13a198f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f139c14a810 0x7f139c1408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:04.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.175+0000 7f13a198f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f139c14a810 0x7f139c1408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45034/0 (socket says 172.21.15.134:45034) 2024-02-17T14:28:04.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.175+0000 7f13a198f640 1 -- 172.21.15.134:0/2505813365 learned_addr learned my addr 172.21.15.134:0/2505813365 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:04.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.175+0000 7f13a198f640 1 -- 172.21.15.134:0/2505813365 >> v2:172.21.15.142:3300/0 conn(0x7f139c0b54d0 msgr2=0x7f139c147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:04.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.175+0000 7f13a198f640 1 --2- 172.21.15.134:0/2505813365 >> v2:172.21.15.142:3300/0 conn(0x7f139c0b54d0 0x7f139c147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.175+0000 7f13a198f640 1 -- 172.21.15.134:0/2505813365 >> v1:172.21.15.142:6789/0 conn(0x7f139c14ac90 legacy=0x7f139c0b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:04.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.175+0000 7f13a198f640 1 -- 172.21.15.134:0/2505813365 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c146e70 con 0x7f139c14a810 2024-02-17T14:28:04.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.176+0000 7f13a198f640 1 --2- 172.21.15.134:0/2505813365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139c14a810 0x7f139c1408b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f139c0ba1d0 tx=0x7f138c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb9c39e66d07db6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:04.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.176+0000 7f13a118e640 1 -- 172.21.15.134:0/2505813365 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c031750 con 0x7f139c14a810 2024-02-17T14:28:04.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.176+0000 7f13a118e640 1 -- 172.21.15.134:0/2505813365 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c0318b0 con 0x7f139c14a810 2024-02-17T14:28:04.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.176+0000 7f13a118e640 1 -- 172.21.15.134:0/2505813365 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c031c40 con 0x7f139c14a810 2024-02-17T14:28:04.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.177+0000 7f13a43f4640 1 -- 172.21.15.134:0/2505813365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139c14a810 msgr2=0x7f139c1408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:04.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.177+0000 7f13a43f4640 1 --2- 172.21.15.134:0/2505813365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139c14a810 0x7f139c1408b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f139c0ba1d0 tx=0x7f138c02b7f0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.177+0000 7f13a43f4640 1 -- 172.21.15.134:0/2505813365 shutdown_connections 2024-02-17T14:28:04.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.177+0000 7f13a43f4640 1 --2- 172.21.15.134:0/2505813365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139c14a810 0x7f139c1408b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.177+0000 7f13a43f4640 1 --2- 172.21.15.134:0/2505813365 >> v2:172.21.15.142:3300/0 conn(0x7f139c0b54d0 0x7f139c147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.177+0000 7f13a43f4640 1 -- 172.21.15.134:0/2505813365 >> 172.21.15.134:0/2505813365 conn(0x7f139c067260 msgr2=0x7f139c0bc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:04.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.177+0000 7f13a43f4640 1 -- 172.21.15.134:0/2505813365 shutdown_connections 2024-02-17T14:28:04.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.177+0000 7f13a43f4640 1 -- 172.21.15.134:0/2505813365 wait complete. 2024-02-17T14:28:04.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.178+0000 7f13a43f4640 1 Processor -- start 2024-02-17T14:28:04.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.178+0000 7f13a43f4640 1 -- start start 2024-02-17T14:28:04.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.178+0000 7f13a43f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139c0b54d0 0x7f139c1d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:04.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.178+0000 7f13a43f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139c14a810 0x7f139c1e41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.178+0000 7f13a43f4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f139c14ac90 0x7f139c1e46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.178+0000 7f13a43f4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c1d0e60 con 0x7f139c0b54d0 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.178+0000 7f13a43f4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c1d1410 con 0x7f139c14ac90 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.178+0000 7f13a43f4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c1d3810 con 0x7f139c14a810 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.178+0000 7f13a2190640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139c0b54d0 0x7f139c1d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f13a2190640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139c0b54d0 0x7f139c1d22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45040/0 (socket says 172.21.15.134:45040) 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f13a2190640 1 -- 172.21.15.134:0/3243204443 learned_addr learned my addr 172.21.15.134:0/3243204443 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f13a2991640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f139c14ac90 0x7f139c1e46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f13a198f640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139c14a810 0x7f139c1e41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f13a2190640 1 -- 172.21.15.134:0/3243204443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139c14a810 msgr2=0x7f139c1e41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f13a2190640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139c14a810 0x7f139c1e41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f13a2190640 1 -- 172.21.15.134:0/3243204443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f139c14ac90 msgr2=0x7f139c1e46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f13a2190640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f139c14ac90 0x7f139c1e46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f13a2190640 1 -- 172.21.15.134:0/3243204443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c0094d0 con 0x7f139c0b54d0 2024-02-17T14:28:04.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f13a198f640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139c14a810 0x7f139c1e41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:04.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f13a2190640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139c0b54d0 0x7f139c1d22d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f139800b4a0 tx=0x7f139800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:04.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f1392ffd640 1 -- 172.21.15.134:0/3243204443 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398010610 con 0x7f139c0b54d0 2024-02-17T14:28:04.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f1392ffd640 1 -- 172.21.15.134:0/3243204443 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1398010770 con 0x7f139c0b54d0 2024-02-17T14:28:04.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f13a43f4640 1 -- 172.21.15.134:0/3243204443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c0b7160 con 0x7f139c0b54d0 2024-02-17T14:28:04.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f1392ffd640 1 -- 172.21.15.134:0/3243204443 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398010b20 con 0x7f139c0b54d0 2024-02-17T14:28:04.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.179+0000 7f13a43f4640 1 -- 172.21.15.134:0/3243204443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139c1d10a0 con 0x7f139c0b54d0 2024-02-17T14:28:04.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.180+0000 7f13a43f4640 1 -- 172.21.15.134:0/3243204443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139c067b70 con 0x7f139c0b54d0 2024-02-17T14:28:04.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.181+0000 7f1392ffd640 1 -- 172.21.15.134:0/3243204443 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1398010c80 con 0x7f139c0b54d0 2024-02-17T14:28:04.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.181+0000 7f1392ffd640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f138006b810 0x7f138006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:04.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.181+0000 7f13a198f640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f138006b810 0x7f138006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:04.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.181+0000 7f1392ffd640 1 -- 172.21.15.134:0/3243204443 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1398089e00 con 0x7f139c0b54d0 2024-02-17T14:28:04.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.181+0000 7f13a198f640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f138006b810 0x7f138006dcd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f138c035000 tx=0x7f138c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:04.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.185+0000 7f1392ffd640 1 -- 172.21.15.134:0/3243204443 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1398054820 con 0x7f139c0b54d0 2024-02-17T14:28:04.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.363+0000 7f13a43f4640 1 -- 172.21.15.134:0/3243204443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f139c0b6350 con 0x7f139c0b54d0 2024-02-17T14:28:04.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.622+0000 7f1392ffd640 1 -- 172.21.15.134:0/3243204443 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f139801e0e0 con 0x7f139c0b54d0 2024-02-17T14:28:04.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.624+0000 7f13a43f4640 1 -- 172.21.15.134:0/3243204443 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f138006b810 msgr2=0x7f138006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:04.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.624+0000 7f13a43f4640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f138006b810 0x7f138006dcd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f138c035000 tx=0x7f138c008030 comp rx=0 tx=0).stop 2024-02-17T14:28:04.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.624+0000 7f13a43f4640 1 -- 172.21.15.134:0/3243204443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139c0b54d0 msgr2=0x7f139c1d22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:04.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.624+0000 7f13a43f4640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139c0b54d0 0x7f139c1d22d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f139800b4a0 tx=0x7f139800b960 comp rx=0 tx=0).stop 2024-02-17T14:28:04.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.624+0000 7f13a43f4640 1 -- 172.21.15.134:0/3243204443 shutdown_connections 2024-02-17T14:28:04.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.624+0000 7f13a43f4640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f139c14ac90 0x7f139c1e46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.624+0000 7f13a43f4640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f139c14a810 0x7f139c1e41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.624+0000 7f13a43f4640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f138006b810 0x7f138006dcd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.624+0000 7f13a43f4640 1 --2- 172.21.15.134:0/3243204443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139c0b54d0 0x7f139c1d22d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.624+0000 7f13a43f4640 1 -- 172.21.15.134:0/3243204443 >> 172.21.15.134:0/3243204443 conn(0x7f139c067260 msgr2=0x7f139c0b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:04.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.624+0000 7f13a43f4640 1 -- 172.21.15.134:0/3243204443 shutdown_connections 2024-02-17T14:28:04.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.624+0000 7f13a43f4640 1 -- 172.21.15.134:0/3243204443 wait complete. 2024-02-17T14:28:04.635 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-02-17T14:28:04.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.745+0000 7fbb0cfa0640 1 Processor -- start 2024-02-17T14:28:04.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.746+0000 7fbb0cfa0640 1 -- start start 2024-02-17T14:28:04.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.746+0000 7fbb0cfa0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0806ae10 0x7fbb08070c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:04.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.746+0000 7fbb0cfa0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbb080b4ff0 0x7fbb08140a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:04.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.746+0000 7fbb0cfa0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb08072070 con 0x7fbb08140f90 2024-02-17T14:28:04.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.746+0000 7fbb0cfa0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb080707a0 con 0x7fbb080b4ff0 2024-02-17T14:28:04.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.746+0000 7fbb0cfa0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb081413e0 con 0x7fbb0806ae10 2024-02-17T14:28:04.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.747+0000 7fbb06ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbb080b4ff0 0x7fbb08140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:04.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.747+0000 7fbb06ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbb080b4ff0 0x7fbb08140a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:56558/0 (socket says 172.21.15.134:56558) 2024-02-17T14:28:04.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.747+0000 7fbb06ffd640 1 -- 172.21.15.134:0/1371690824 learned_addr learned my addr 172.21.15.134:0/1371690824 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:04.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.747+0000 7fbb077fe640 1 --2- 172.21.15.134:0/1371690824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0806ae10 0x7fbb08070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:04.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.747+0000 7fbb06ffd640 1 -- 172.21.15.134:0/1371690824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0806ae10 msgr2=0x7fbb08070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:04.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.747+0000 7fbb06ffd640 1 --2- 172.21.15.134:0/1371690824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0806ae10 0x7fbb08070c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.747+0000 7fbb06ffd640 1 -- 172.21.15.134:0/1371690824 >> v1:172.21.15.142:6789/0 conn(0x7fbb08140f90 legacy=0x7fbb080b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:04.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.747+0000 7fbb06ffd640 1 -- 172.21.15.134:0/1371690824 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0806b1f0 con 0x7fbb080b4ff0 2024-02-17T14:28:04.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.748+0000 7fbb06ffd640 1 --2- 172.21.15.134:0/1371690824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb080b4ff0 0x7fbb08140a50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009870 tx=0x7fbafc02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f73444393408f4d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:04.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.748+0000 7fbb067fc640 1 -- 172.21.15.134:0/1371690824 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc030840 con 0x7fbb080b4ff0 2024-02-17T14:28:04.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.748+0000 7fbb067fc640 1 -- 172.21.15.134:0/1371690824 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc0309a0 con 0x7fbb080b4ff0 2024-02-17T14:28:04.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.748+0000 7fbb067fc640 1 -- 172.21.15.134:0/1371690824 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc030d30 con 0x7fbb080b4ff0 2024-02-17T14:28:04.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.748+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1371690824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb080b4ff0 msgr2=0x7fbb08140a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.748+0000 7fbb0cfa0640 1 --2- 172.21.15.134:0/1371690824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb080b4ff0 0x7fbb08140a50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009870 tx=0x7fbafc02b980 comp rx=0 tx=0).stop 2024-02-17T14:28:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.748+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1371690824 shutdown_connections 2024-02-17T14:28:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.748+0000 7fbb0cfa0640 1 --2- 172.21.15.134:0/1371690824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb080b4ff0 0x7fbb08140a50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.748+0000 7fbb0cfa0640 1 --2- 172.21.15.134:0/1371690824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb0806ae10 0x7fbb08070c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.748+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1371690824 >> 172.21.15.134:0/1371690824 conn(0x7fbb080b91f0 msgr2=0x7fbb080b9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.749+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1371690824 shutdown_connections 2024-02-17T14:28:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.749+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1371690824 wait complete. 2024-02-17T14:28:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.749+0000 7fbb0cfa0640 1 Processor -- start 2024-02-17T14:28:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.750+0000 7fbb0cfa0640 1 -- start start 2024-02-17T14:28:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.750+0000 7fbb0cfa0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb0806ae10 0x7fbb080ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.750+0000 7fbb0cfa0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb080b4ff0 0x7fbb08144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.750+0000 7fbb0cfa0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb08140f90 0x7fbb081df870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:04.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.750+0000 7fbb0cfa0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08146300 con 0x7fbb080b4ff0 2024-02-17T14:28:04.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.750+0000 7fbb0cfa0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08147b30 con 0x7fbb0806ae10 2024-02-17T14:28:04.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.750+0000 7fbb0cfa0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08142610 con 0x7fbb08140f90 2024-02-17T14:28:04.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.750+0000 7fbb06ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb080b4ff0 0x7fbb08144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:04.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.750+0000 7fbb06ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb080b4ff0 0x7fbb08144aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45050/0 (socket says 172.21.15.134:45050) 2024-02-17T14:28:04.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.750+0000 7fbb06ffd640 1 -- 172.21.15.134:0/1045521066 learned_addr learned my addr 172.21.15.134:0/1045521066 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:04.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.750+0000 7fbb077fe640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb0806ae10 0x7fbb080ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:04.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.750+0000 7fbb07fff640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb08140f90 0x7fbb081df870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:04.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.751+0000 7fbb06ffd640 1 -- 172.21.15.134:0/1045521066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb08140f90 msgr2=0x7fbb081df870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:04.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.751+0000 7fbb06ffd640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb08140f90 0x7fbb081df870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.751+0000 7fbb06ffd640 1 -- 172.21.15.134:0/1045521066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb0806ae10 msgr2=0x7fbb080ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:04.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.751+0000 7fbb06ffd640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb0806ae10 0x7fbb080ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:04.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.751+0000 7fbb06ffd640 1 -- 172.21.15.134:0/1045521066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc0094d0 con 0x7fbb080b4ff0 2024-02-17T14:28:04.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.751+0000 7fbb06ffd640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb080b4ff0 0x7fbb08144aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbafc000c00 tx=0x7fbafc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:04.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.751+0000 7fbaeffff640 1 -- 172.21.15.134:0/1045521066 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc039c90 con 0x7fbb080b4ff0 2024-02-17T14:28:04.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.751+0000 7fbaeffff640 1 -- 172.21.15.134:0/1045521066 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc039df0 con 0x7fbb080b4ff0 2024-02-17T14:28:04.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.751+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1045521066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb080af3d0 con 0x7fbb080b4ff0 2024-02-17T14:28:04.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.751+0000 7fbaeffff640 1 -- 172.21.15.134:0/1045521066 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc043640 con 0x7fbb080b4ff0 2024-02-17T14:28:04.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.751+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1045521066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb08141740 con 0x7fbb080b4ff0 2024-02-17T14:28:04.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.752+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1045521066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb081415a0 con 0x7fbb080b4ff0 2024-02-17T14:28:04.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.752+0000 7fbaeffff640 1 -- 172.21.15.134:0/1045521066 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbafc0437a0 con 0x7fbb080b4ff0 2024-02-17T14:28:04.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.753+0000 7fbaeffff640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbaf406b840 0x7fbaf406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:04.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.753+0000 7fbaeffff640 1 -- 172.21.15.134:0/1045521066 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6007+0+0 (secure 0 0 0) 0x7fbafc03e070 con 0x7fbb080b4ff0 2024-02-17T14:28:04.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.753+0000 7fbb077fe640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbaf406b840 0x7fbaf406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:04.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.753+0000 7fbb077fe640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbaf406b840 0x7fbaf406dd00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009b30 tx=0x7fbaf8009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:04.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.757+0000 7fbaeffff640 1 -- 172.21.15.134:0/1045521066 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbb081415a0 con 0x7fbb080b4ff0 2024-02-17T14:28:04.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:04.930+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1045521066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbb081415a0 con 0x7fbb080b4ff0 2024-02-17T14:28:06.009 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:28:06.011 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:28:06.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.625+0000 7fbaeffff640 1 -- 172.21.15.134:0/1045521066 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7fbb081415a0 con 0x7fbb080b4ff0 2024-02-17T14:28:06.625 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data_ec' created 2024-02-17T14:28:06.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.629+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1045521066 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbaf406b840 msgr2=0x7fbaf406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:06.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.629+0000 7fbb0cfa0640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbaf406b840 0x7fbaf406dd00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009b30 tx=0x7fbaf8009110 comp rx=0 tx=0).stop 2024-02-17T14:28:06.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.629+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1045521066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb080b4ff0 msgr2=0x7fbb08144aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:06.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.629+0000 7fbb0cfa0640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb080b4ff0 0x7fbb08144aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbafc000c00 tx=0x7fbafc004730 comp rx=0 tx=0).stop 2024-02-17T14:28:06.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.629+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1045521066 shutdown_connections 2024-02-17T14:28:06.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.629+0000 7fbb0cfa0640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb08140f90 0x7fbb081df870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:06.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.629+0000 7fbb0cfa0640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbaf406b840 0x7fbaf406dd00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:06.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.629+0000 7fbb0cfa0640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb080b4ff0 0x7fbb08144aa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:06.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.629+0000 7fbb0cfa0640 1 --2- 172.21.15.134:0/1045521066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb0806ae10 0x7fbb080ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:06.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.629+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1045521066 >> 172.21.15.134:0/1045521066 conn(0x7fbb080b91f0 msgr2=0x7fbb08073a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:06.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.631+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1045521066 shutdown_connections 2024-02-17T14:28:06.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.631+0000 7fbb0cfa0640 1 -- 172.21.15.134:0/1045521066 wait complete. 2024-02-17T14:28:06.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-02-17T14:28:06.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.758+0000 7f748542e640 1 Processor -- start 2024-02-17T14:28:06.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.758+0000 7f748542e640 1 -- start start 2024-02-17T14:28:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f748542e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7480150810 0x7f7480152c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f748542e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7480147350 con 0x7f748009a8e0 2024-02-17T14:28:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f748542e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7480147ef0 con 0x7f748009af30 2024-02-17T14:28:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f748542e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748009acc0 con 0x7f7480150810 2024-02-17T14:28:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747effd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f748009a8e0 0x7f74801477e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57774/0 (socket says 172.21.15.134:57774) 2024-02-17T14:28:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747effd640 1 -- 172.21.15.134:0/1871688404 learned_addr learned my addr 172.21.15.134:0/1871688404 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747f7fe640 1 --2- 172.21.15.134:0/1871688404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7480150810 0x7f7480152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796882260 0 0) 0x7f7480147350 con 0x7f748009a8e0 2024-02-17T14:28:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7468003520 con 0x7f748009a8e0 2024-02-17T14:28:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4171980038 0 0) 0x7f7468003520 con 0x7f748009a8e0 2024-02-17T14:28:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7480150810 msgr2=0x7f7480152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 --2- 172.21.15.134:0/1871688404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7480150810 0x7f7480152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 >> v1:172.21.15.142:6789/0 conn(0x7f748009af30 legacy=0x7f748009e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748009b450 con 0x7f748009a8e0 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f7470001670 con 0x7f748009a8e0 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 >> v1:172.21.15.134:6789/0 conn(0x7f748009a8e0 legacy=0x7f74801477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 --2- 172.21.15.134:0/1871688404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74680039a0 0x7f7468003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 --2- 172.21.15.134:0/1871688404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7468004350 0x7f7468004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 --2- 172.21.15.134:0/1871688404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7480150810 0x7f7468005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748009acc0 con 0x7f7468004350 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746800ba30 con 0x7f74680039a0 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.759+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746800bbf0 con 0x7f7480150810 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.760+0000 7f747e7fc640 1 --2- 172.21.15.134:0/1871688404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7468004350 0x7f7468004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.760+0000 7f747f7fe640 1 --2- 172.21.15.134:0/1871688404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7480150810 0x7f7468005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.760+0000 7f747effd640 1 --2- 172.21.15.134:0/1871688404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74680039a0 0x7f7468003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.760+0000 7f747e7fc640 1 -- 172.21.15.134:0/1871688404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7480150810 msgr2=0x7f7468005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.760+0000 7f747e7fc640 1 --2- 172.21.15.134:0/1871688404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7480150810 0x7f7468005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.760+0000 7f747e7fc640 1 -- 172.21.15.134:0/1871688404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74680039a0 msgr2=0x7f7468003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:06.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.760+0000 7f747e7fc640 1 --2- 172.21.15.134:0/1871688404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74680039a0 0x7f7468003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:06.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.760+0000 7f747e7fc640 1 -- 172.21.15.134:0/1871688404 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7468003520 con 0x7f7468004350 2024-02-17T14:28:06.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.761+0000 7f747e7fc640 1 --2- 172.21.15.134:0/1871688404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7468004350 0x7f7468004820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7474001830 tx=0x7f74680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36998547d7951a1e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:06.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.761+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747402f050 con 0x7f7468004350 2024-02-17T14:28:06.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.761+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7474033610 con 0x7f7468004350 2024-02-17T14:28:06.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.761+0000 7f747dffb640 1 -- 172.21.15.134:0/1871688404 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740339c0 con 0x7f7468004350 2024-02-17T14:28:06.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.761+0000 7f748542e640 1 -- 172.21.15.134:0/1871688404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7468004350 msgr2=0x7f7468004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:06.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.761+0000 7f748542e640 1 --2- 172.21.15.134:0/1871688404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7468004350 0x7f7468004820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7474001830 tx=0x7f74680057f0 comp rx=0 tx=0).stop 2024-02-17T14:28:06.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.761+0000 7f747f7fe640 1 -- 172.21.15.134:0/1871688404 reap_dead start 2024-02-17T14:28:06.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.761+0000 7f748542e640 1 -- 172.21.15.134:0/1871688404 shutdown_connections 2024-02-17T14:28:06.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.761+0000 7f748542e640 1 -- 172.21.15.134:0/1871688404 >> 172.21.15.134:0/1871688404 conn(0x7f74800b9090 msgr2=0x7f74800b94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:06.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.761+0000 7f748542e640 1 -- 172.21.15.134:0/1871688404 shutdown_connections 2024-02-17T14:28:06.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.761+0000 7f748542e640 1 -- 172.21.15.134:0/1871688404 wait complete. 2024-02-17T14:28:06.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.762+0000 7f748542e640 1 Processor -- start 2024-02-17T14:28:06.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f748542e640 1 -- start start 2024-02-17T14:28:06.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f748542e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7468004350 0x7f74800a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:06.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f748542e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748009ef60 0x7f74801dca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:06.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f748542e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74800b2160 0x7f74800b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:06.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f748542e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74800a11e0 con 0x7f7468004350 2024-02-17T14:28:06.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f748542e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748009f3e0 con 0x7f74800b2160 2024-02-17T14:28:06.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f748542e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74800b2b50 con 0x7f748009ef60 2024-02-17T14:28:06.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f747effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7468004350 0x7f74800a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:06.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f747effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7468004350 0x7f74800a02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45072/0 (socket says 172.21.15.134:45072) 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f747effd640 1 -- 172.21.15.134:0/41866455 learned_addr learned my addr 172.21.15.134:0/41866455 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f747f7fe640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74800b2160 0x7f74800b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f747e7fc640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748009ef60 0x7f74801dca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f747effd640 1 -- 172.21.15.134:0/41866455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748009ef60 msgr2=0x7f74801dca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f747effd640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748009ef60 0x7f74801dca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f747effd640 1 -- 172.21.15.134:0/41866455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74800b2160 msgr2=0x7f74800b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f747effd640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74800b2160 0x7f74800b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.763+0000 7f747effd640 1 -- 172.21.15.134:0/41866455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74800b2d30 con 0x7f7468004350 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.764+0000 7f747effd640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7468004350 0x7f74800a02f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74700072c0 tx=0x7f7470007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.764+0000 7f74677fe640 1 -- 172.21.15.134:0/41866455 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74700015e0 con 0x7f7468004350 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.764+0000 7f74677fe640 1 -- 172.21.15.134:0/41866455 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747000f960 con 0x7f7468004350 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.764+0000 7f748542e640 1 -- 172.21.15.134:0/41866455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74801dcfb0 con 0x7f7468004350 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.764+0000 7f74677fe640 1 -- 172.21.15.134:0/41866455 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747000fd10 con 0x7f7468004350 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.764+0000 7f748542e640 1 -- 172.21.15.134:0/41866455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74800b5a00 con 0x7f7468004350 2024-02-17T14:28:06.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.765+0000 7f748542e640 1 -- 172.21.15.134:0/41866455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74800a0140 con 0x7f7468004350 2024-02-17T14:28:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.765+0000 7f74677fe640 1 -- 172.21.15.134:0/41866455 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f747001d460 con 0x7f7468004350 2024-02-17T14:28:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.765+0000 7f74677fe640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f746c06b810 0x7f746c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.766+0000 7f747e7fc640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f746c06b810 0x7f746c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.766+0000 7f74677fe640 1 -- 172.21.15.134:0/41866455 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f747008a540 con 0x7f7468004350 2024-02-17T14:28:06.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.766+0000 7f747e7fc640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f746c06b810 0x7f746c06dcd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7474036000 tx=0x7f7474031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:06.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.770+0000 7f74677fe640 1 -- 172.21.15.134:0/41866455 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7470054d80 con 0x7f7468004350 2024-02-17T14:28:06.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:06.941+0000 7f748542e640 1 -- 172.21.15.134:0/41866455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f7480067b70 con 0x7f7468004350 2024-02-17T14:28:07.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.627+0000 7f74677fe640 1 -- 172.21.15.134:0/41866455 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7470058440 con 0x7f7468004350 2024-02-17T14:28:07.627 INFO:teuthology.orchestra.run.smithi134.stderr:set pool 4 allow_ec_overwrites to true 2024-02-17T14:28:07.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.632+0000 7f748542e640 1 -- 172.21.15.134:0/41866455 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f746c06b810 msgr2=0x7f746c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:07.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.632+0000 7f748542e640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f746c06b810 0x7f746c06dcd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7474036000 tx=0x7f7474031000 comp rx=0 tx=0).stop 2024-02-17T14:28:07.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.632+0000 7f748542e640 1 -- 172.21.15.134:0/41866455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7468004350 msgr2=0x7f74800a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:07.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.632+0000 7f748542e640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7468004350 0x7f74800a02f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74700072c0 tx=0x7f7470007780 comp rx=0 tx=0).stop 2024-02-17T14:28:07.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.633+0000 7f748542e640 1 -- 172.21.15.134:0/41866455 shutdown_connections 2024-02-17T14:28:07.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.633+0000 7f748542e640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74800b2160 0x7f74800b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:07.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.633+0000 7f748542e640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f748009ef60 0x7f74801dca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:07.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.633+0000 7f748542e640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f746c06b810 0x7f746c06dcd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:07.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.633+0000 7f748542e640 1 --2- 172.21.15.134:0/41866455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7468004350 0x7f74800a02f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:07.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.633+0000 7f748542e640 1 -- 172.21.15.134:0/41866455 >> 172.21.15.134:0/41866455 conn(0x7f74800b9090 msgr2=0x7f74800b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:07.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.640+0000 7f748542e640 1 -- 172.21.15.134:0/41866455 shutdown_connections 2024-02-17T14:28:07.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.640+0000 7f748542e640 1 -- 172.21.15.134:0/41866455 wait complete. 2024-02-17T14:28:07.659 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-02-17T14:28:07.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.764+0000 7f6543a9d640 1 Processor -- start 2024-02-17T14:28:07.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.764+0000 7f6543a9d640 1 -- start start 2024-02-17T14:28:07.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f6543a9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f653c09b3f0 0x7f653c0b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:07.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f6543a9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f653c146f20 0x7f653c147380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:07.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f6543a9d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653c06b530 con 0x7f653c14a490 2024-02-17T14:28:07.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f6543a9d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653c0b85e0 con 0x7f653c146f20 2024-02-17T14:28:07.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f6543a9d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653c1478c0 con 0x7f653c09b3f0 2024-02-17T14:28:07.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f6541038640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f653c146f20 0x7f653c147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:07.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f6541038640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f653c146f20 0x7f653c147380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45082/0 (socket says 172.21.15.134:45082) 2024-02-17T14:28:07.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f6541038640 1 -- 172.21.15.134:0/343004767 learned_addr learned my addr 172.21.15.134:0/343004767 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:07.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f654203a640 1 --1- 172.21.15.134:0/343004767 >> v1:172.21.15.134:6789/0 conn(0x7f653c14a490 0x7f653c14a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57780/0 (socket says 172.21.15.134:57780) 2024-02-17T14:28:07.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f6541038640 1 -- 172.21.15.134:0/343004767 >> v2:172.21.15.142:3300/0 conn(0x7f653c09b3f0 msgr2=0x7f653c0b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:07.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f6541038640 1 --2- 172.21.15.134:0/343004767 >> v2:172.21.15.142:3300/0 conn(0x7f653c09b3f0 0x7f653c0b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:07.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f6541038640 1 -- 172.21.15.134:0/343004767 >> v1:172.21.15.134:6789/0 conn(0x7f653c14a490 legacy=0x7f653c14a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:07.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f6541038640 1 -- 172.21.15.134:0/343004767 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c09b7d0 con 0x7f653c146f20 2024-02-17T14:28:07.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.765+0000 7f6540837640 1 -- 172.21.15.134:0/343004767 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844723349 0 0) 0x7f653c06b530 con 0x7f653c14a490 2024-02-17T14:28:07.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.766+0000 7f6541038640 1 --2- 172.21.15.134:0/343004767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f653c146f20 0x7f653c147380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f653c148050 tx=0x7f652c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9c5890e6847df9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:07.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.766+0000 7f6540837640 1 -- 172.21.15.134:0/343004767 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c030860 con 0x7f653c146f20 2024-02-17T14:28:07.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.766+0000 7f6540837640 1 -- 172.21.15.134:0/343004767 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c0309c0 con 0x7f653c146f20 2024-02-17T14:28:07.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.766+0000 7f6540837640 1 -- 172.21.15.134:0/343004767 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c030d50 con 0x7f653c146f20 2024-02-17T14:28:07.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.767+0000 7f6543a9d640 1 -- 172.21.15.134:0/343004767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f653c146f20 msgr2=0x7f653c147380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:07.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.767+0000 7f6543a9d640 1 --2- 172.21.15.134:0/343004767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f653c146f20 0x7f653c147380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f653c148050 tx=0x7f652c02b9a0 comp rx=0 tx=0).stop 2024-02-17T14:28:07.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.767+0000 7f6543a9d640 1 -- 172.21.15.134:0/343004767 shutdown_connections 2024-02-17T14:28:07.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.767+0000 7f6543a9d640 1 --2- 172.21.15.134:0/343004767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f653c146f20 0x7f653c147380 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:07.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.767+0000 7f6543a9d640 1 --2- 172.21.15.134:0/343004767 >> v2:172.21.15.142:3300/0 conn(0x7f653c09b3f0 0x7f653c0b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:07.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.767+0000 7f6543a9d640 1 -- 172.21.15.134:0/343004767 >> 172.21.15.134:0/343004767 conn(0x7f653c0bc630 msgr2=0x7f653c0bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:07.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.767+0000 7f6543a9d640 1 -- 172.21.15.134:0/343004767 shutdown_connections 2024-02-17T14:28:07.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.767+0000 7f6543a9d640 1 -- 172.21.15.134:0/343004767 wait complete. 2024-02-17T14:28:07.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.768+0000 7f6543a9d640 1 Processor -- start 2024-02-17T14:28:07.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.768+0000 7f6543a9d640 1 -- start start 2024-02-17T14:28:07.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.768+0000 7f6543a9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f653c09b3f0 0x7f653c1d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:07.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.768+0000 7f6543a9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f653c146f20 0x7f653c143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:07.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.768+0000 7f6543a9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f653c14a490 0x7f653c1e0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:07.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.768+0000 7f6543a9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c1df9e0 con 0x7f653c09b3f0 2024-02-17T14:28:07.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.768+0000 7f6543a9d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0b29b0 con 0x7f653c14a490 2024-02-17T14:28:07.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.768+0000 7f6543a9d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c1dfc30 con 0x7f653c146f20 2024-02-17T14:28:07.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.768+0000 7f6541839640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f653c09b3f0 0x7f653c1d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:07.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.768+0000 7f6541839640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f653c09b3f0 0x7f653c1d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45096/0 (socket says 172.21.15.134:45096) 2024-02-17T14:28:07.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.768+0000 7f6541839640 1 -- 172.21.15.134:0/1563071701 learned_addr learned my addr 172.21.15.134:0/1563071701 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:07.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.768+0000 7f6541038640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f653c146f20 0x7f653c143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:07.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.768+0000 7f654203a640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f653c14a490 0x7f653c1e0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:07.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.769+0000 7f6541839640 1 -- 172.21.15.134:0/1563071701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f653c146f20 msgr2=0x7f653c143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:07.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.769+0000 7f6541839640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f653c146f20 0x7f653c143260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:07.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.769+0000 7f6541839640 1 -- 172.21.15.134:0/1563071701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f653c14a490 msgr2=0x7f653c1e0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:07.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.769+0000 7f6541839640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f653c14a490 0x7f653c1e0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:07.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.769+0000 7f6541839640 1 -- 172.21.15.134:0/1563071701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c0094d0 con 0x7f653c09b3f0 2024-02-17T14:28:07.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.769+0000 7f6541839640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f653c09b3f0 0x7f653c1d08c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f653800b4a0 tx=0x7f653800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:07.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.769+0000 7f65327fc640 1 -- 172.21.15.134:0/1563071701 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538010610 con 0x7f653c09b3f0 2024-02-17T14:28:07.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.769+0000 7f65327fc640 1 -- 172.21.15.134:0/1563071701 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6538010770 con 0x7f653c09b3f0 2024-02-17T14:28:07.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.769+0000 7f65327fc640 1 -- 172.21.15.134:0/1563071701 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538010b20 con 0x7f653c09b3f0 2024-02-17T14:28:07.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.769+0000 7f6543a9d640 1 -- 172.21.15.134:0/1563071701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c1dff10 con 0x7f653c09b3f0 2024-02-17T14:28:07.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.769+0000 7f6543a9d640 1 -- 172.21.15.134:0/1563071701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c0b0160 con 0x7f653c09b3f0 2024-02-17T14:28:07.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.770+0000 7f6543a9d640 1 -- 172.21.15.134:0/1563071701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653c0b0410 con 0x7f653c09b3f0 2024-02-17T14:28:07.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.770+0000 7f65327fc640 1 -- 172.21.15.134:0/1563071701 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6538010c80 con 0x7f653c09b3f0 2024-02-17T14:28:07.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.771+0000 7f65327fc640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f652006b810 0x7f652006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:07.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.771+0000 7f6541038640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f652006b810 0x7f652006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:07.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.771+0000 7f65327fc640 1 -- 172.21.15.134:0/1563071701 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f653808a060 con 0x7f653c09b3f0 2024-02-17T14:28:07.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.771+0000 7f6541038640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f652006b810 0x7f652006dcd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f652c036000 tx=0x7f652c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:07.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.775+0000 7f65327fc640 1 -- 172.21.15.134:0/1563071701 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f653c0b0410 con 0x7f653c09b3f0 2024-02-17T14:28:07.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:07.989+0000 7f6543a9d640 1 -- 172.21.15.134:0/1563071701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f653c0b0410 con 0x7f653c09b3f0 2024-02-17T14:28:08.041 INFO:tasks.ceph.mds.b.smithi142.stderr:2024-02-17T14:28:08.042+0000 7f5cfce9b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T14:28:08.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.666+0000 7f65327fc640 1 -- 172.21.15.134:0/1563071701 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f653c0b0410 con 0x7f653c09b3f0 2024-02-17T14:28:08.665 INFO:teuthology.orchestra.run.smithi134.stderr:added data pool 4 to fsmap 2024-02-17T14:28:08.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.668+0000 7f6543a9d640 1 -- 172.21.15.134:0/1563071701 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f652006b810 msgr2=0x7f652006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:08.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.668+0000 7f6543a9d640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f652006b810 0x7f652006dcd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f652c036000 tx=0x7f652c008030 comp rx=0 tx=0).stop 2024-02-17T14:28:08.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.668+0000 7f6543a9d640 1 -- 172.21.15.134:0/1563071701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f653c09b3f0 msgr2=0x7f653c1d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:08.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.668+0000 7f6543a9d640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f653c09b3f0 0x7f653c1d08c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f653800b4a0 tx=0x7f653800b960 comp rx=0 tx=0).stop 2024-02-17T14:28:08.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.668+0000 7f6543a9d640 1 -- 172.21.15.134:0/1563071701 shutdown_connections 2024-02-17T14:28:08.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.668+0000 7f6543a9d640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f653c14a490 0x7f653c1e0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:08.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.668+0000 7f6543a9d640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f653c146f20 0x7f653c143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:08.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.668+0000 7f6543a9d640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f652006b810 0x7f652006dcd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:08.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.668+0000 7f6543a9d640 1 --2- 172.21.15.134:0/1563071701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f653c09b3f0 0x7f653c1d08c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:08.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.668+0000 7f6543a9d640 1 -- 172.21.15.134:0/1563071701 >> 172.21.15.134:0/1563071701 conn(0x7f653c0bc630 msgr2=0x7f653c1443c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:08.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.668+0000 7f6543a9d640 1 -- 172.21.15.134:0/1563071701 shutdown_connections 2024-02-17T14:28:08.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.668+0000 7f6543a9d640 1 -- 172.21.15.134:0/1563071701 wait complete. 2024-02-17T14:28:08.679 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T14:28:08.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.784+0000 7f91fe5a1640 1 Processor -- start 2024-02-17T14:28:08.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.784+0000 7f91fe5a1640 1 -- start start 2024-02-17T14:28:08.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.784+0000 7f91fe5a1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91f80b5610 0x7f91f8071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:08.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.784+0000 7f91fe5a1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91f8071fb0 0x7f91f806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:08.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.784+0000 7f91fe5a1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f806d8d0 con 0x7f91f806d440 2024-02-17T14:28:08.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.784+0000 7f91fe5a1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f8072410 con 0x7f91f80b5610 2024-02-17T14:28:08.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.784+0000 7f91fe5a1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f8147e80 con 0x7f91f8071fb0 2024-02-17T14:28:08.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.785+0000 7f91f77fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91f8071fb0 0x7f91f806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:08.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.785+0000 7f91f7fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91f80b5610 0x7f91f8071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:08.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.785+0000 7f91f7fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91f80b5610 0x7f91f8071a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:56620/0 (socket says 172.21.15.134:56620) 2024-02-17T14:28:08.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.785+0000 7f91f7fff640 1 -- 172.21.15.134:0/3052845786 learned_addr learned my addr 172.21.15.134:0/3052845786 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:08.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.785+0000 7f91f77fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91f8071fb0 0x7f91f806cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:34180/0 (socket says 172.21.15.134:34180) 2024-02-17T14:28:08.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.785+0000 7f91fcb3e640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f91f806d440 0x7f91f8146f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:57062/0 (socket says 172.21.15.134:57062) 2024-02-17T14:28:08.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.785+0000 7f91f7fff640 1 -- 172.21.15.134:0/3052845786 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91f8071fb0 msgr2=0x7f91f806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:08.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.785+0000 7f91f7fff640 1 --2- 172.21.15.134:0/3052845786 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91f8071fb0 0x7f91f806cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:08.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.785+0000 7f91f7fff640 1 -- 172.21.15.134:0/3052845786 >> v1:172.21.15.142:6789/0 conn(0x7f91f806d440 legacy=0x7f91f8146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:08.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.785+0000 7f91f7fff640 1 -- 172.21.15.134:0/3052845786 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f8147ba0 con 0x7f91f80b5610 2024-02-17T14:28:08.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.785+0000 7f91f77fe640 1 --2- 172.21.15.134:0/3052845786 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91f8071fb0 0x7f91f806cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:08.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.786+0000 7f91f7fff640 1 --2- 172.21.15.134:0/3052845786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f80b5610 0x7f91f8071a70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f91e8009870 tx=0x7f91e802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab43165855d67bf2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:08.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.786+0000 7f91f6ffd640 1 -- 172.21.15.134:0/3052845786 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8031640 con 0x7f91f80b5610 2024-02-17T14:28:08.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.786+0000 7f91f6ffd640 1 -- 172.21.15.134:0/3052845786 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e80317a0 con 0x7f91f80b5610 2024-02-17T14:28:08.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.786+0000 7f91f6ffd640 1 -- 172.21.15.134:0/3052845786 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8031b30 con 0x7f91f80b5610 2024-02-17T14:28:08.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.786+0000 7f91fe5a1640 1 -- 172.21.15.134:0/3052845786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f80b5610 msgr2=0x7f91f8071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:08.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.787+0000 7f91fe5a1640 1 --2- 172.21.15.134:0/3052845786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f80b5610 0x7f91f8071a70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f91e8009870 tx=0x7f91e802b8f0 comp rx=0 tx=0).stop 2024-02-17T14:28:08.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.787+0000 7f91fe5a1640 1 -- 172.21.15.134:0/3052845786 shutdown_connections 2024-02-17T14:28:08.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.787+0000 7f91fe5a1640 1 --2- 172.21.15.134:0/3052845786 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91f8071fb0 0x7f91f806cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:08.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.787+0000 7f91fe5a1640 1 --2- 172.21.15.134:0/3052845786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f80b5610 0x7f91f8071a70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:08.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.787+0000 7f91fe5a1640 1 -- 172.21.15.134:0/3052845786 >> 172.21.15.134:0/3052845786 conn(0x7f91f80ba430 msgr2=0x7f91f80ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:08.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.787+0000 7f91fe5a1640 1 -- 172.21.15.134:0/3052845786 shutdown_connections 2024-02-17T14:28:08.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.787+0000 7f91fe5a1640 1 -- 172.21.15.134:0/3052845786 wait complete. 2024-02-17T14:28:08.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.788+0000 7f91fe5a1640 1 Processor -- start 2024-02-17T14:28:08.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.788+0000 7f91fe5a1640 1 -- start start 2024-02-17T14:28:08.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.788+0000 7f91fe5a1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f806d440 0x7f91f809fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:08.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.788+0000 7f91fe5a1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91f8071fb0 0x7f91f81dc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:08.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.788+0000 7f91fe5a1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f80b5610 0x7f91f80b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:08.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.788+0000 7f91fe5a1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f8140740 con 0x7f91f806d440 2024-02-17T14:28:08.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.788+0000 7f91fe5a1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f80b0d60 con 0x7f91f80b5610 2024-02-17T14:28:08.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.788+0000 7f91fe5a1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f80afaa0 con 0x7f91f8071fb0 2024-02-17T14:28:08.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.788+0000 7f91f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f806d440 0x7f91f809fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:08.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f806d440 0x7f91f809fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45100/0 (socket says 172.21.15.134:45100) 2024-02-17T14:28:08.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91f7fff640 1 -- 172.21.15.134:0/2499252103 learned_addr learned my addr 172.21.15.134:0/2499252103 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:08.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91fcb3e640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f80b5610 0x7f91f80b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:08.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91f77fe640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91f8071fb0 0x7f91f81dc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:08.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91f7fff640 1 -- 172.21.15.134:0/2499252103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91f8071fb0 msgr2=0x7f91f81dc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:08.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91f7fff640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91f8071fb0 0x7f91f81dc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:08.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91f7fff640 1 -- 172.21.15.134:0/2499252103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f80b5610 msgr2=0x7f91f80b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:08.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91f7fff640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f80b5610 0x7f91f80b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:08.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91f7fff640 1 -- 172.21.15.134:0/2499252103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec009400 con 0x7f91f806d440 2024-02-17T14:28:08.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91f7fff640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f806d440 0x7f91f809fbb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f91e8000c00 tx=0x7f91e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:08.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91f4ff9640 1 -- 172.21.15.134:0/2499252103 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e803a930 con 0x7f91f806d440 2024-02-17T14:28:08.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91f4ff9640 1 -- 172.21.15.134:0/2499252103 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e803aa90 con 0x7f91f806d440 2024-02-17T14:28:08.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91fe5a1640 1 -- 172.21.15.134:0/2499252103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e80094d0 con 0x7f91f806d440 2024-02-17T14:28:08.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91f4ff9640 1 -- 172.21.15.134:0/2499252103 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e803ae40 con 0x7f91f806d440 2024-02-17T14:28:08.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.789+0000 7f91fe5a1640 1 -- 172.21.15.134:0/2499252103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f80b0140 con 0x7f91f806d440 2024-02-17T14:28:08.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.790+0000 7f91fe5a1640 1 -- 172.21.15.134:0/2499252103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f80a0120 con 0x7f91f806d440 2024-02-17T14:28:08.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.791+0000 7f91f4ff9640 1 -- 172.21.15.134:0/2499252103 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f91e802f050 con 0x7f91f806d440 2024-02-17T14:28:08.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.791+0000 7f91f4ff9640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f91e406b810 0x7f91e406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:08.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.791+0000 7f91f4ff9640 1 -- 172.21.15.134:0/2499252103 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f91e80ac250 con 0x7f91f806d440 2024-02-17T14:28:08.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.791+0000 7f91f77fe640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f91e406b810 0x7f91e406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:08.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.791+0000 7f91f77fe640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f91e406b810 0x7f91e406dcd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f91f81e0960 tx=0x7f91ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:08.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:08.795+0000 7f91f4ff9640 1 -- 172.21.15.134:0/2499252103 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f91e80769c0 con 0x7f91f806d440 2024-02-17T14:28:09.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.003+0000 7f91fe5a1640 1 -- 172.21.15.134:0/2499252103 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91f8067b70 con 0x7f91f806d440 2024-02-17T14:28:09.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.003+0000 7f91f4ff9640 1 -- 172.21.15.134:0/2499252103 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3354 (secure 0 0 0) 0x7f91e8035d30 con 0x7f91f806d440 2024-02-17T14:28:09.003 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:09.003 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/137239145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":137239145},{"type":"v1","addr":"172.21.15.134:6835","nonce":137239145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T14:28:03.523163+0000","modified":"2024-02-17T14:28:07.990440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/177127534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":177127534},{"type":"v1","addr":"172.21.15.142:6833","nonce":177127534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-17T14:28:09.003 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 7 2024-02-17T14:28:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.005+0000 7f91fe5a1640 1 -- 172.21.15.134:0/2499252103 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f91e406b810 msgr2=0x7f91e406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.005+0000 7f91fe5a1640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f91e406b810 0x7f91e406dcd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f91f81e0960 tx=0x7f91ec008040 comp rx=0 tx=0).stop 2024-02-17T14:28:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.005+0000 7f91fe5a1640 1 -- 172.21.15.134:0/2499252103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f806d440 msgr2=0x7f91f809fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.005+0000 7f91fe5a1640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f806d440 0x7f91f809fbb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f91e8000c00 tx=0x7f91e80046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.005+0000 7f91fe5a1640 1 -- 172.21.15.134:0/2499252103 shutdown_connections 2024-02-17T14:28:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.005+0000 7f91fe5a1640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91f80b5610 0x7f91f80b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.005+0000 7f91fe5a1640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91f8071fb0 0x7f91f81dc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.005+0000 7f91fe5a1640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f91e406b810 0x7f91e406dcd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.005+0000 7f91fe5a1640 1 --2- 172.21.15.134:0/2499252103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f806d440 0x7f91f809fbb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.005+0000 7f91fe5a1640 1 -- 172.21.15.134:0/2499252103 >> 172.21.15.134:0/2499252103 conn(0x7f91f80ba430 msgr2=0x7f91f806c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:09.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.005+0000 7f91fe5a1640 1 -- 172.21.15.134:0/2499252103 shutdown_connections 2024-02-17T14:28:09.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.005+0000 7f91fe5a1640 1 -- 172.21.15.134:0/2499252103 wait complete. 2024-02-17T14:28:09.017 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:09.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.118+0000 7f331994f640 1 Processor -- start 2024-02-17T14:28:09.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.118+0000 7f331994f640 1 -- start start 2024-02-17T14:28:09.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f331994f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f331409bd10 0x7f331406e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f331994f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f331406d610 0x7f33140b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f331994f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331406e270 con 0x7f33140b5610 2024-02-17T14:28:09.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f331994f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33140b6190 con 0x7f331409bd10 2024-02-17T14:28:09.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f331994f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331406de70 con 0x7f331406d610 2024-02-17T14:28:09.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f33127fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f331409bd10 0x7f331406e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f3312ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f33140b5610 0x7f331406cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:57068/0 (socket says 172.21.15.134:57068) 2024-02-17T14:28:09.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f3312ffd640 1 -- 172.21.15.134:0/2264266017 learned_addr learned my addr 172.21.15.134:0/2264266017 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:09.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f33137fe640 1 --2- 172.21.15.134:0/2264266017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f331406d610 0x7f33140b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f33137fe640 1 -- 172.21.15.134:0/2264266017 >> v2:172.21.15.142:3300/0 conn(0x7f331409bd10 msgr2=0x7f331406e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:09.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f33137fe640 1 --2- 172.21.15.134:0/2264266017 >> v2:172.21.15.142:3300/0 conn(0x7f331409bd10 0x7f331406e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f33137fe640 1 -- 172.21.15.134:0/2264266017 >> v1:172.21.15.142:6789/0 conn(0x7f33140b5610 legacy=0x7f331406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f33137fe640 1 -- 172.21.15.134:0/2264266017 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331406f350 con 0x7f331406d610 2024-02-17T14:28:09.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.119+0000 7f33127fc640 1 --2- 172.21.15.134:0/2264266017 >> v2:172.21.15.142:3300/0 conn(0x7f331409bd10 0x7f331406e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:09.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.120+0000 7f33137fe640 1 --2- 172.21.15.134:0/2264266017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f331406d610 0x7f33140b4db0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f330c009d90 tx=0x7f330c02bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e70f9630445fb905 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:09.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.120+0000 7f3311ffb640 1 -- 172.21.15.134:0/2264266017 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c02cb30 con 0x7f331406d610 2024-02-17T14:28:09.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.120+0000 7f3311ffb640 1 -- 172.21.15.134:0/2264266017 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c02cc90 con 0x7f331406d610 2024-02-17T14:28:09.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.120+0000 7f3311ffb640 1 -- 172.21.15.134:0/2264266017 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c034440 con 0x7f331406d610 2024-02-17T14:28:09.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.121+0000 7f331994f640 1 -- 172.21.15.134:0/2264266017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f331406d610 msgr2=0x7f33140b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.121+0000 7f331994f640 1 --2- 172.21.15.134:0/2264266017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f331406d610 0x7f33140b4db0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f330c009d90 tx=0x7f330c02bd80 comp rx=0 tx=0).stop 2024-02-17T14:28:09.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.121+0000 7f331994f640 1 -- 172.21.15.134:0/2264266017 shutdown_connections 2024-02-17T14:28:09.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.121+0000 7f331994f640 1 --2- 172.21.15.134:0/2264266017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f331406d610 0x7f33140b4db0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.121+0000 7f331994f640 1 --2- 172.21.15.134:0/2264266017 >> v2:172.21.15.142:3300/0 conn(0x7f331409bd10 0x7f331406e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.121+0000 7f331994f640 1 -- 172.21.15.134:0/2264266017 >> 172.21.15.134:0/2264266017 conn(0x7f33140ba430 msgr2=0x7f33140ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:09.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.121+0000 7f331994f640 1 -- 172.21.15.134:0/2264266017 shutdown_connections 2024-02-17T14:28:09.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.121+0000 7f331994f640 1 -- 172.21.15.134:0/2264266017 wait complete. 2024-02-17T14:28:09.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.122+0000 7f331994f640 1 Processor -- start 2024-02-17T14:28:09.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.122+0000 7f331994f640 1 -- start start 2024-02-17T14:28:09.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f331994f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f331406d610 0x7f33141447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f331994f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f331409bd10 0x7f33140afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f331994f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33140b5610 0x7f33141dc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f331994f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3314144390 con 0x7f331406d610 2024-02-17T14:28:09.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f331994f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33141407b0 con 0x7f33140b5610 2024-02-17T14:28:09.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f331994f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33140af3b0 con 0x7f331409bd10 2024-02-17T14:28:09.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f3312ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f331406d610 0x7f33141447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f3312ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f331406d610 0x7f33141447b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45104/0 (socket says 172.21.15.134:45104) 2024-02-17T14:28:09.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f3312ffd640 1 -- 172.21.15.134:0/1716567313 learned_addr learned my addr 172.21.15.134:0/1716567313 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:09.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f33137fe640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33140b5610 0x7f33141dc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f33127fc640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f331409bd10 0x7f33140afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f3312ffd640 1 -- 172.21.15.134:0/1716567313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f331409bd10 msgr2=0x7f33140afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f3312ffd640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f331409bd10 0x7f33140afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f3312ffd640 1 -- 172.21.15.134:0/1716567313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33140b5610 msgr2=0x7f33141dc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f3312ffd640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33140b5610 0x7f33141dc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f3312ffd640 1 -- 172.21.15.134:0/1716567313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3308009400 con 0x7f331406d610 2024-02-17T14:28:09.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f33137fe640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33140b5610 0x7f33141dc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:09.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f33127fc640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f331409bd10 0x7f33140afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:09.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f3312ffd640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f331406d610 0x7f33141447b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f330400c3c0 tx=0x7f330400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:09.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f32fbfff640 1 -- 172.21.15.134:0/1716567313 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304005ce0 con 0x7f331406d610 2024-02-17T14:28:09.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f32fbfff640 1 -- 172.21.15.134:0/1716567313 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3304005e40 con 0x7f331406d610 2024-02-17T14:28:09.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f331994f640 1 -- 172.21.15.134:0/1716567313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c009a70 con 0x7f331406d610 2024-02-17T14:28:09.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f32fbfff640 1 -- 172.21.15.134:0/1716567313 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33040072f0 con 0x7f331406d610 2024-02-17T14:28:09.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.123+0000 7f331994f640 1 -- 172.21.15.134:0/1716567313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33140b12d0 con 0x7f331406d610 2024-02-17T14:28:09.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.124+0000 7f331994f640 1 -- 172.21.15.134:0/1716567313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33140af560 con 0x7f331406d610 2024-02-17T14:28:09.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.125+0000 7f32fbfff640 1 -- 172.21.15.134:0/1716567313 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3304007510 con 0x7f331406d610 2024-02-17T14:28:09.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.125+0000 7f32fbfff640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f330006b810 0x7f330006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.125+0000 7f33127fc640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f330006b810 0x7f330006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.126+0000 7f32fbfff640 1 -- 172.21.15.134:0/1716567313 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3304089a20 con 0x7f331406d610 2024-02-17T14:28:09.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.126+0000 7f33127fc640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f330006b810 0x7f330006dcd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3314144e80 tx=0x7f3308008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:09.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.130+0000 7f32fbfff640 1 -- 172.21.15.134:0/1716567313 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f33140af560 con 0x7f331406d610 2024-02-17T14:28:09.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.300+0000 7f331994f640 1 -- 172.21.15.134:0/1716567313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3314144600 con 0x7f331406d610 2024-02-17T14:28:09.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.301+0000 7f32fbfff640 1 -- 172.21.15.134:0/1716567313 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f3304017090 con 0x7f331406d610 2024-02-17T14:28:09.301 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:09.302 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:07.990271+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:09.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.303+0000 7f331994f640 1 -- 172.21.15.134:0/1716567313 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f330006b810 msgr2=0x7f330006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.303+0000 7f331994f640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f330006b810 0x7f330006dcd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3314144e80 tx=0x7f3308008040 comp rx=0 tx=0).stop 2024-02-17T14:28:09.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.303+0000 7f331994f640 1 -- 172.21.15.134:0/1716567313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f331406d610 msgr2=0x7f33141447b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.303+0000 7f331994f640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f331406d610 0x7f33141447b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f330400c3c0 tx=0x7f330400c880 comp rx=0 tx=0).stop 2024-02-17T14:28:09.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.303+0000 7f331994f640 1 -- 172.21.15.134:0/1716567313 shutdown_connections 2024-02-17T14:28:09.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.303+0000 7f331994f640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33140b5610 0x7f33141dc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.303+0000 7f331994f640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f331409bd10 0x7f33140afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.303+0000 7f331994f640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f330006b810 0x7f330006dcd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.303+0000 7f331994f640 1 --2- 172.21.15.134:0/1716567313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f331406d610 0x7f33141447b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.303+0000 7f331994f640 1 -- 172.21.15.134:0/1716567313 >> 172.21.15.134:0/1716567313 conn(0x7f33140ba430 msgr2=0x7f33140b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:09.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.303+0000 7f331994f640 1 -- 172.21.15.134:0/1716567313 shutdown_connections 2024-02-17T14:28:09.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.303+0000 7f331994f640 1 -- 172.21.15.134:0/1716567313 wait complete. 2024-02-17T14:28:09.314 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.420+0000 7fbddb13a640 1 Processor -- start 2024-02-17T14:28:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.420+0000 7fbddb13a640 1 -- start start 2024-02-17T14:28:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.420+0000 7fbddb13a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbdd40b0bb0 0x7fbdd4140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.420+0000 7fbddb13a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdd409cc70 0x7fbdd4141110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.420+0000 7fbddb13a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd4141650 con 0x7fbdd40b56c0 2024-02-17T14:28:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.420+0000 7fbddb13a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd40afc10 con 0x7fbdd40b0bb0 2024-02-17T14:28:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.420+0000 7fbddb13a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40b5aa0 con 0x7fbdd409cc70 2024-02-17T14:28:09.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.421+0000 7fbdd3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbdd40b0bb0 0x7fbdd4140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.421+0000 7fbdd96d7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdd409cc70 0x7fbdd4141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.421+0000 7fbdd8ed6640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbdd40b56c0 0x7fbdd40b04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:57080/0 (socket says 172.21.15.134:57080) 2024-02-17T14:28:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.421+0000 7fbdd3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbdd40b0bb0 0x7fbdd4140bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:56660/0 (socket says 172.21.15.134:56660) 2024-02-17T14:28:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.421+0000 7fbdd96d7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdd409cc70 0x7fbdd4141110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:34220/0 (socket says 172.21.15.134:34220) 2024-02-17T14:28:09.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.421+0000 7fbdd8ed6640 1 -- 172.21.15.134:0/2706992497 learned_addr learned my addr 172.21.15.134:0/2706992497 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.421+0000 7fbdd3fff640 1 -- 172.21.15.134:0/2706992497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdd409cc70 msgr2=0x7fbdd4141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.421+0000 7fbdd3fff640 1 --2- 172.21.15.134:0/2706992497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdd409cc70 0x7fbdd4141110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.421+0000 7fbdd3fff640 1 -- 172.21.15.134:0/2706992497 >> v1:172.21.15.142:6789/0 conn(0x7fbdd40b56c0 legacy=0x7fbdd40b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.421+0000 7fbdd3fff640 1 -- 172.21.15.134:0/2706992497 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd40b6010 con 0x7fbdd40b0bb0 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.421+0000 7fbdd96d7640 1 --2- 172.21.15.134:0/2706992497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdd409cc70 0x7fbdd4141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.421+0000 7fbdd37fe640 1 -- 172.21.15.134:0/2706992497 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367022512 0 0) 0x7fbdd4141650 con 0x7fbdd40b56c0 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.422+0000 7fbdd3fff640 1 --2- 172.21.15.134:0/2706992497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdd40b0bb0 0x7fbdd4140bd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0097a0 tx=0x7fbdbc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f806abbe9bd3f11d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.422+0000 7fbdd37fe640 1 -- 172.21.15.134:0/2706992497 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc031830 con 0x7fbdd40b0bb0 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.422+0000 7fbdd37fe640 1 -- 172.21.15.134:0/2706992497 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc031990 con 0x7fbdd40b0bb0 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.422+0000 7fbdd37fe640 1 -- 172.21.15.134:0/2706992497 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc031d20 con 0x7fbdd40b0bb0 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.422+0000 7fbddb13a640 1 -- 172.21.15.134:0/2706992497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdd40b0bb0 msgr2=0x7fbdd4140bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.423+0000 7fbddb13a640 1 --2- 172.21.15.134:0/2706992497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdd40b0bb0 0x7fbdd4140bd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0097a0 tx=0x7fbdbc02b8d0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.423+0000 7fbddb13a640 1 -- 172.21.15.134:0/2706992497 shutdown_connections 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.423+0000 7fbddb13a640 1 --2- 172.21.15.134:0/2706992497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdd409cc70 0x7fbdd4141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.423+0000 7fbddb13a640 1 --2- 172.21.15.134:0/2706992497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdd40b0bb0 0x7fbdd4140bd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.423+0000 7fbddb13a640 1 -- 172.21.15.134:0/2706992497 >> 172.21.15.134:0/2706992497 conn(0x7fbdd40b6e70 msgr2=0x7fbdd40b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.423+0000 7fbddb13a640 1 -- 172.21.15.134:0/2706992497 shutdown_connections 2024-02-17T14:28:09.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.423+0000 7fbddb13a640 1 -- 172.21.15.134:0/2706992497 wait complete. 2024-02-17T14:28:09.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.424+0000 7fbddb13a640 1 Processor -- start 2024-02-17T14:28:09.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.424+0000 7fbddb13a640 1 -- start start 2024-02-17T14:28:09.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.424+0000 7fbddb13a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdd409cc70 0x7fbdd40b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.424+0000 7fbddb13a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdd40b0bb0 0x7fbdd41dc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.424+0000 7fbddb13a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd40b56c0 0x7fbdd41df8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.424+0000 7fbddb13a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd409b5b0 con 0x7fbdd40b56c0 2024-02-17T14:28:09.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.424+0000 7fbddb13a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd4144d00 con 0x7fbdd40b0bb0 2024-02-17T14:28:09.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.424+0000 7fbddb13a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd4146060 con 0x7fbdd409cc70 2024-02-17T14:28:09.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.424+0000 7fbdd96d7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd40b56c0 0x7fbdd41df8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.424+0000 7fbdd96d7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd40b56c0 0x7fbdd41df8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45118/0 (socket says 172.21.15.134:45118) 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.424+0000 7fbdd96d7640 1 -- 172.21.15.134:0/3309578717 learned_addr learned my addr 172.21.15.134:0/3309578717 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.424+0000 7fbdd3fff640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdd40b0bb0 0x7fbdd41dc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.424+0000 7fbdd8ed6640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdd409cc70 0x7fbdd40b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.425+0000 7fbdd96d7640 1 -- 172.21.15.134:0/3309578717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdd409cc70 msgr2=0x7fbdd40b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.425+0000 7fbdd96d7640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdd409cc70 0x7fbdd40b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.425+0000 7fbdd96d7640 1 -- 172.21.15.134:0/3309578717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdd40b0bb0 msgr2=0x7fbdd41dc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.425+0000 7fbdd96d7640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdd40b0bb0 0x7fbdd41dc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.425+0000 7fbdd96d7640 1 -- 172.21.15.134:0/3309578717 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc4009400 con 0x7fbdd40b56c0 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.425+0000 7fbdd8ed6640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdd409cc70 0x7fbdd40b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.425+0000 7fbdd96d7640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd40b56c0 0x7fbdd41df8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400e900 tx=0x7fbdc400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.425+0000 7fbdd17fa640 1 -- 172.21.15.134:0/3309578717 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40096e0 con 0x7fbdd40b56c0 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.425+0000 7fbdd17fa640 1 -- 172.21.15.134:0/3309578717 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc400ca00 con 0x7fbdd40b56c0 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.425+0000 7fbdd17fa640 1 -- 172.21.15.134:0/3309578717 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc400cd70 con 0x7fbdd40b56c0 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.425+0000 7fbddb13a640 1 -- 172.21.15.134:0/3309578717 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc009400 con 0x7fbdd40b56c0 2024-02-17T14:28:09.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.425+0000 7fbddb13a640 1 -- 172.21.15.134:0/3309578717 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd409c6d0 con 0x7fbdd40b56c0 2024-02-17T14:28:09.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.426+0000 7fbddb13a640 1 -- 172.21.15.134:0/3309578717 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd4144e70 con 0x7fbdd40b56c0 2024-02-17T14:28:09.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.426+0000 7fbdd17fa640 1 -- 172.21.15.134:0/3309578717 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbdc4013470 con 0x7fbdd40b56c0 2024-02-17T14:28:09.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.427+0000 7fbdd17fa640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbdb406b860 0x7fbdb406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.427+0000 7fbdd17fa640 1 -- 172.21.15.134:0/3309578717 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbdc408a5c0 con 0x7fbdd40b56c0 2024-02-17T14:28:09.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.427+0000 7fbdd8ed6640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbdb406b860 0x7fbdb406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.427+0000 7fbdd8ed6640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbdb406b860 0x7fbdb406dd20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0012e0 tx=0x7fbdcc005b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:09.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.431+0000 7fbdd17fa640 1 -- 172.21.15.134:0/3309578717 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbdd4144e70 con 0x7fbdd40b56c0 2024-02-17T14:28:09.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.602+0000 7fbddb13a640 1 -- 172.21.15.134:0/3309578717 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdd4144e70 con 0x7fbdd40b56c0 2024-02-17T14:28:09.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.604+0000 7fbdd17fa640 1 -- 172.21.15.134:0/3309578717 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7fbdd4144e70 con 0x7fbdd40b56c0 2024-02-17T14:28:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:09.603 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:07.990271+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:09.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.606+0000 7fbddb13a640 1 -- 172.21.15.134:0/3309578717 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbdb406b860 msgr2=0x7fbdb406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.606+0000 7fbddb13a640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbdb406b860 0x7fbdb406dd20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0012e0 tx=0x7fbdcc005b90 comp rx=0 tx=0).stop 2024-02-17T14:28:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.606+0000 7fbddb13a640 1 -- 172.21.15.134:0/3309578717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd40b56c0 msgr2=0x7fbdd41df8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.606+0000 7fbddb13a640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd40b56c0 0x7fbdd41df8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400e900 tx=0x7fbdc400edc0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.606+0000 7fbddb13a640 1 -- 172.21.15.134:0/3309578717 shutdown_connections 2024-02-17T14:28:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.606+0000 7fbddb13a640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbdb406b860 0x7fbdb406dd20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.606+0000 7fbddb13a640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd40b56c0 0x7fbdd41df8f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.606+0000 7fbddb13a640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdd40b0bb0 0x7fbdd41dc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.606+0000 7fbddb13a640 1 --2- 172.21.15.134:0/3309578717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdd409cc70 0x7fbdd40b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.606+0000 7fbddb13a640 1 -- 172.21.15.134:0/3309578717 >> 172.21.15.134:0/3309578717 conn(0x7fbdd40b6e70 msgr2=0x7fbdd40b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.606+0000 7fbddb13a640 1 -- 172.21.15.134:0/3309578717 shutdown_connections 2024-02-17T14:28:09.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.606+0000 7fbddb13a640 1 -- 172.21.15.134:0/3309578717 wait complete. 2024-02-17T14:28:09.635 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T14:28:09.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.738+0000 7f02b5eeb640 1 Processor -- start 2024-02-17T14:28:09.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.738+0000 7f02b5eeb640 1 -- start start 2024-02-17T14:28:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02b5eeb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f02b014a710 0x7f02b00b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02b5eeb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b009b190 0x7f02b0144250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02b5eeb640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b014aaf0 con 0x7f02b0144790 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02b5eeb640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b009c280 con 0x7f02b014a710 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02b5eeb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b009b5f0 con 0x7f02b009b190 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02af7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f02b014a710 0x7f02b00b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02affff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f02b0144790 0x7f02b0146f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57794/0 (socket says 172.21.15.134:57794) 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02affff640 1 -- 172.21.15.134:0/1225426 learned_addr learned my addr 172.21.15.134:0/1225426 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02aeffd640 1 --2- 172.21.15.134:0/1225426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b009b190 0x7f02b0144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02af7fe640 1 -- 172.21.15.134:0/1225426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b009b190 msgr2=0x7f02b0144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02af7fe640 1 --2- 172.21.15.134:0/1225426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b009b190 0x7f02b0144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02af7fe640 1 -- 172.21.15.134:0/1225426 >> v1:172.21.15.134:6789/0 conn(0x7f02b0144790 legacy=0x7f02b0146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02af7fe640 1 -- 172.21.15.134:0/1225426 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b0144be0 con 0x7f02b014a710 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.739+0000 7f02ae7fc640 1 -- 172.21.15.134:0/1225426 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771054556 0 0) 0x7f02b014aaf0 con 0x7f02b0144790 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.740+0000 7f02af7fe640 1 --2- 172.21.15.134:0/1225426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02b014a710 0x7f02b00b6fc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f02a00097a0 tx=0x7f02a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e966548ed73844 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:09.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.740+0000 7f02ae7fc640 1 -- 172.21.15.134:0/1225426 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a002e070 con 0x7f02b014a710 2024-02-17T14:28:09.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.740+0000 7f02ae7fc640 1 -- 172.21.15.134:0/1225426 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a00315a0 con 0x7f02b014a710 2024-02-17T14:28:09.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.740+0000 7f02ae7fc640 1 -- 172.21.15.134:0/1225426 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a0031930 con 0x7f02b014a710 2024-02-17T14:28:09.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.741+0000 7f02b5eeb640 1 -- 172.21.15.134:0/1225426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02b014a710 msgr2=0x7f02b00b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.741+0000 7f02b5eeb640 1 --2- 172.21.15.134:0/1225426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02b014a710 0x7f02b00b6fc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f02a00097a0 tx=0x7f02a002b840 comp rx=0 tx=0).stop 2024-02-17T14:28:09.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.741+0000 7f02b5eeb640 1 -- 172.21.15.134:0/1225426 shutdown_connections 2024-02-17T14:28:09.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.741+0000 7f02b5eeb640 1 --2- 172.21.15.134:0/1225426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b009b190 0x7f02b0144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.741+0000 7f02b5eeb640 1 --2- 172.21.15.134:0/1225426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02b014a710 0x7f02b00b6fc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.741+0000 7f02b5eeb640 1 -- 172.21.15.134:0/1225426 >> 172.21.15.134:0/1225426 conn(0x7f02b00b90c0 msgr2=0x7f02b00b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:09.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.741+0000 7f02b5eeb640 1 -- 172.21.15.134:0/1225426 shutdown_connections 2024-02-17T14:28:09.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.741+0000 7f02b5eeb640 1 -- 172.21.15.134:0/1225426 wait complete. 2024-02-17T14:28:09.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.742+0000 7f02b5eeb640 1 Processor -- start 2024-02-17T14:28:09.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.742+0000 7f02b5eeb640 1 -- start start 2024-02-17T14:28:09.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02b5eeb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b009b190 0x7f02b00b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02b5eeb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b0144790 0x7f02b0144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02b5eeb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02b014a710 0x7f02b01df920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02b5eeb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b0147c10 con 0x7f02b014a710 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02b5eeb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00a20b0 con 0x7f02b009b190 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02b5eeb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b01480a0 con 0x7f02b0144790 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02affff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02b014a710 0x7f02b01df920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02affff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02b014a710 0x7f02b01df920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45136/0 (socket says 172.21.15.134:45136) 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02affff640 1 -- 172.21.15.134:0/2774346601 learned_addr learned my addr 172.21.15.134:0/2774346601 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02aeffd640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b0144790 0x7f02b0144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02affff640 1 -- 172.21.15.134:0/2774346601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b0144790 msgr2=0x7f02b0144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02affff640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b0144790 0x7f02b0144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02affff640 1 -- 172.21.15.134:0/2774346601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b009b190 msgr2=0x7f02b00b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02af7fe640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b009b190 0x7f02b00b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02affff640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b009b190 0x7f02b00b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02affff640 1 -- 172.21.15.134:0/2774346601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a0009400 con 0x7f02b014a710 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02affff640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02b014a710 0x7f02b01df920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f02a800c7e0 tx=0x7f02a800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f0297fff640 1 -- 172.21.15.134:0/2774346601 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800a640 con 0x7f02b014a710 2024-02-17T14:28:09.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f0297fff640 1 -- 172.21.15.134:0/2774346601 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a800a7c0 con 0x7f02b014a710 2024-02-17T14:28:09.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02b5eeb640 1 -- 172.21.15.134:0/2774346601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b00b4500 con 0x7f02b014a710 2024-02-17T14:28:09.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f0297fff640 1 -- 172.21.15.134:0/2774346601 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800ab70 con 0x7f02b014a710 2024-02-17T14:28:09.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.743+0000 7f02b5eeb640 1 -- 172.21.15.134:0/2774346601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b01464b0 con 0x7f02b014a710 2024-02-17T14:28:09.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.744+0000 7f02b5eeb640 1 -- 172.21.15.134:0/2774346601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b0147dc0 con 0x7f02b014a710 2024-02-17T14:28:09.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.745+0000 7f0297fff640 1 -- 172.21.15.134:0/2774346601 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f02a800acd0 con 0x7f02b014a710 2024-02-17T14:28:09.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.745+0000 7f0297fff640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f029c06b810 0x7f029c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:09.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.745+0000 7f0297fff640 1 -- 172.21.15.134:0/2774346601 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f02a8089d10 con 0x7f02b014a710 2024-02-17T14:28:09.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.745+0000 7f02af7fe640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f029c06b810 0x7f029c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:09.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.745+0000 7f02af7fe640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f029c06b810 0x7f029c06dcd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f02a0036000 tx=0x7f02a003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:09.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.749+0000 7f0297fff640 1 -- 172.21.15.134:0/2774346601 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f02b0147dc0 con 0x7f02b014a710 2024-02-17T14:28:09.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.954+0000 7f02b5eeb640 1 -- 172.21.15.134:0/2774346601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02b00a1f10 con 0x7f02b014a710 2024-02-17T14:28:09.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.954+0000 7f0297fff640 1 -- 172.21.15.134:0/2774346601 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3354 (secure 0 0 0) 0x7f02b00a1f10 con 0x7f02b014a710 2024-02-17T14:28:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:09.954 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/137239145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":137239145},{"type":"v1","addr":"172.21.15.134:6835","nonce":137239145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T14:28:03.523163+0000","modified":"2024-02-17T14:28:07.990440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/177127534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":177127534},{"type":"v1","addr":"172.21.15.142:6833","nonce":177127534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-17T14:28:09.954 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 7 2024-02-17T14:28:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.957+0000 7f02b5eeb640 1 -- 172.21.15.134:0/2774346601 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f029c06b810 msgr2=0x7f029c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.957+0000 7f02b5eeb640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f029c06b810 0x7f029c06dcd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f02a0036000 tx=0x7f02a003d040 comp rx=0 tx=0).stop 2024-02-17T14:28:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.957+0000 7f02b5eeb640 1 -- 172.21.15.134:0/2774346601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02b014a710 msgr2=0x7f02b01df920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.957+0000 7f02b5eeb640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02b014a710 0x7f02b01df920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f02a800c7e0 tx=0x7f02a800cca0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.957+0000 7f02b5eeb640 1 -- 172.21.15.134:0/2774346601 shutdown_connections 2024-02-17T14:28:09.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.957+0000 7f02b5eeb640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f029c06b810 0x7f029c06dcd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.957+0000 7f02b5eeb640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02b014a710 0x7f02b01df920 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.957+0000 7f02b5eeb640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b0144790 0x7f02b0144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.957+0000 7f02b5eeb640 1 --2- 172.21.15.134:0/2774346601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b009b190 0x7f02b00b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:09.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.957+0000 7f02b5eeb640 1 -- 172.21.15.134:0/2774346601 >> 172.21.15.134:0/2774346601 conn(0x7f02b00b90c0 msgr2=0x7f02b0141fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:09.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.957+0000 7f02b5eeb640 1 -- 172.21.15.134:0/2774346601 shutdown_connections 2024-02-17T14:28:09.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:09.957+0000 7f02b5eeb640 1 -- 172.21.15.134:0/2774346601 wait complete. 2024-02-17T14:28:09.967 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:10.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.069+0000 7fed9d9eb640 1 Processor -- start 2024-02-17T14:28:10.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.069+0000 7fed9d9eb640 1 -- start start 2024-02-17T14:28:10.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed9d9eb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fed9814a710 0x7fed980b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed9d9eb640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9814aaf0 con 0x7fed9809b190 2024-02-17T14:28:10.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed9d9eb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9809c4f0 con 0x7fed98144960 2024-02-17T14:28:10.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed9d9eb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9809c280 con 0x7fed9814a710 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed8ffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fed9809b190 0x7fed98144250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57798/0 (socket says 172.21.15.134:57798) 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed8ffff640 1 -- 172.21.15.134:0/2977427658 learned_addr learned my addr 172.21.15.134:0/2977427658 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed96ffd640 1 --2- 172.21.15.134:0/2977427658 >> v2:172.21.15.142:3300/0 conn(0x7fed9814a710 0x7fed980b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110915100 0 0) 0x7fed9814aaf0 con 0x7fed9809b190 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed84003520 con 0x7fed9809b190 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245575820 0 0) 0x7fed84003520 con 0x7fed9809b190 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 >> v2:172.21.15.142:3300/0 conn(0x7fed9814a710 msgr2=0x7fed980b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 --2- 172.21.15.134:0/2977427658 >> v2:172.21.15.142:3300/0 conn(0x7fed9814a710 0x7fed980b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 >> v1:172.21.15.142:6789/0 conn(0x7fed98144960 legacy=0x7fed981517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9809a6b0 con 0x7fed9809b190 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7fed80001670 con 0x7fed9809b190 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 >> v1:172.21.15.134:6789/0 conn(0x7fed9809b190 legacy=0x7fed98144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 --2- 172.21.15.134:0/2977427658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed84003970 0x7fed84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 --2- 172.21.15.134:0/2977427658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed840047c0 0x7fed84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 --2- 172.21.15.134:0/2977427658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed84005180 0x7fed8400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8400c0f0 con 0x7fed840047c0 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8400c260 con 0x7fed84003970 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8400c420 con 0x7fed84005180 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.070+0000 7fed8ffff640 1 --2- 172.21.15.134:0/2977427658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed840047c0 0x7fed84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.071+0000 7fed96ffd640 1 --2- 172.21.15.134:0/2977427658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed84003970 0x7fed84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.071+0000 7fed977fe640 1 --2- 172.21.15.134:0/2977427658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed84005180 0x7fed8400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.071+0000 7fed8ffff640 1 -- 172.21.15.134:0/2977427658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed84005180 msgr2=0x7fed8400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.071+0000 7fed8ffff640 1 --2- 172.21.15.134:0/2977427658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed84005180 0x7fed8400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.071+0000 7fed8ffff640 1 -- 172.21.15.134:0/2977427658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed84003970 msgr2=0x7fed84003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.071+0000 7fed8ffff640 1 --2- 172.21.15.134:0/2977427658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed84003970 0x7fed84003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.071+0000 7fed8ffff640 1 -- 172.21.15.134:0/2977427658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed84003520 con 0x7fed840047c0 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.071+0000 7fed977fe640 1 -- 172.21.15.134:0/2977427658 reap_dead start 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.071+0000 7fed8ffff640 1 --2- 172.21.15.134:0/2977427658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed840047c0 0x7fed84004c40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed80001050 tx=0x7fed840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12685126b3ae7d29 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.071+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80005ad0 con 0x7fed840047c0 2024-02-17T14:28:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.072+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed80005c30 con 0x7fed840047c0 2024-02-17T14:28:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.072+0000 7fed967fc640 1 -- 172.21.15.134:0/2977427658 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8002ca90 con 0x7fed840047c0 2024-02-17T14:28:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.072+0000 7fed9d9eb640 1 -- 172.21.15.134:0/2977427658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed840047c0 msgr2=0x7fed84004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.072+0000 7fed9d9eb640 1 --2- 172.21.15.134:0/2977427658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed840047c0 0x7fed84004c40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed80001050 tx=0x7fed840057f0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.072+0000 7fed9d9eb640 1 -- 172.21.15.134:0/2977427658 shutdown_connections 2024-02-17T14:28:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.072+0000 7fed9d9eb640 1 --2- 172.21.15.134:0/2977427658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed840047c0 0x7fed84004c40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.072+0000 7fed9d9eb640 1 -- 172.21.15.134:0/2977427658 >> 172.21.15.134:0/2977427658 conn(0x7fed980b90c0 msgr2=0x7fed980b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.072+0000 7fed9d9eb640 1 -- 172.21.15.134:0/2977427658 shutdown_connections 2024-02-17T14:28:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.072+0000 7fed9d9eb640 1 -- 172.21.15.134:0/2977427658 wait complete. 2024-02-17T14:28:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.073+0000 7fed9d9eb640 1 Processor -- start 2024-02-17T14:28:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.073+0000 7fed9d9eb640 1 -- start start 2024-02-17T14:28:10.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed9d9eb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed840047c0 0x7fed980b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed9d9eb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed981477f0 0x7fed98140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed9d9eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed980b3940 0x7fed980aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed9d9eb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed980b66d0 con 0x7fed981477f0 2024-02-17T14:28:10.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed9d9eb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed980b3dc0 con 0x7fed840047c0 2024-02-17T14:28:10.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed9d9eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed980b68d0 con 0x7fed980b3940 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed8ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed981477f0 0x7fed98140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed8ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed981477f0 0x7fed98140820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45158/0 (socket says 172.21.15.134:45158) 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed8ffff640 1 -- 172.21.15.134:0/696391496 learned_addr learned my addr 172.21.15.134:0/696391496 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed96ffd640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed840047c0 0x7fed980b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed977fe640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed980b3940 0x7fed980aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed8ffff640 1 -- 172.21.15.134:0/696391496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed980b3940 msgr2=0x7fed980aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed8ffff640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed980b3940 0x7fed980aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed8ffff640 1 -- 172.21.15.134:0/696391496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed840047c0 msgr2=0x7fed980b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed8ffff640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed840047c0 0x7fed980b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed8ffff640 1 -- 172.21.15.134:0/696391496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed98146ff0 con 0x7fed981477f0 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed8ffff640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed981477f0 0x7fed98140820 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed80001050 tx=0x7fed80000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed94ff9640 1 -- 172.21.15.134:0/696391496 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8003c070 con 0x7fed981477f0 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed94ff9640 1 -- 172.21.15.134:0/696391496 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8002ca60 con 0x7fed981477f0 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed9d9eb640 1 -- 172.21.15.134:0/696391496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed981472d0 con 0x7fed981477f0 2024-02-17T14:28:10.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed94ff9640 1 -- 172.21.15.134:0/696391496 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8002cdf0 con 0x7fed981477f0 2024-02-17T14:28:10.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.074+0000 7fed9d9eb640 1 -- 172.21.15.134:0/696391496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed980a2310 con 0x7fed981477f0 2024-02-17T14:28:10.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.075+0000 7fed9d9eb640 1 -- 172.21.15.134:0/696391496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed98146e50 con 0x7fed981477f0 2024-02-17T14:28:10.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.076+0000 7fed94ff9640 1 -- 172.21.15.134:0/696391496 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fed80032070 con 0x7fed981477f0 2024-02-17T14:28:10.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.076+0000 7fed94ff9640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fed7806b840 0x7fed7806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.076+0000 7fed96ffd640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fed7806b840 0x7fed7806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.076+0000 7fed94ff9640 1 -- 172.21.15.134:0/696391496 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fed800ab3a0 con 0x7fed981477f0 2024-02-17T14:28:10.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.077+0000 7fed96ffd640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fed7806b840 0x7fed7806dd00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed88009b00 tx=0x7fed88008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:10.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.081+0000 7fed94ff9640 1 -- 172.21.15.134:0/696391496 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fed98146e50 con 0x7fed981477f0 2024-02-17T14:28:10.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.255+0000 7fed9d9eb640 1 -- 172.21.15.134:0/696391496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed98146e50 con 0x7fed981477f0 2024-02-17T14:28:10.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.256+0000 7fed94ff9640 1 -- 172.21.15.134:0/696391496 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7fed98146e50 con 0x7fed981477f0 2024-02-17T14:28:10.256 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:10.256 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:07.990271+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:10.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.258+0000 7fed9d9eb640 1 -- 172.21.15.134:0/696391496 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fed7806b840 msgr2=0x7fed7806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.258+0000 7fed9d9eb640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fed7806b840 0x7fed7806dd00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed88009b00 tx=0x7fed88008040 comp rx=0 tx=0).stop 2024-02-17T14:28:10.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.258+0000 7fed9d9eb640 1 -- 172.21.15.134:0/696391496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed981477f0 msgr2=0x7fed98140820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.258+0000 7fed9d9eb640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed981477f0 0x7fed98140820 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed80001050 tx=0x7fed80000fe0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.258+0000 7fed9d9eb640 1 -- 172.21.15.134:0/696391496 shutdown_connections 2024-02-17T14:28:10.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.258+0000 7fed9d9eb640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed980b3940 0x7fed980aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.258+0000 7fed9d9eb640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fed7806b840 0x7fed7806dd00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.258+0000 7fed9d9eb640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed981477f0 0x7fed98140820 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.258+0000 7fed9d9eb640 1 --2- 172.21.15.134:0/696391496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed840047c0 0x7fed980b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.258+0000 7fed9d9eb640 1 -- 172.21.15.134:0/696391496 >> 172.21.15.134:0/696391496 conn(0x7fed980b90c0 msgr2=0x7fed980b94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:10.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.258+0000 7fed9d9eb640 1 -- 172.21.15.134:0/696391496 shutdown_connections 2024-02-17T14:28:10.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.258+0000 7fed9d9eb640 1 -- 172.21.15.134:0/696391496 wait complete. 2024-02-17T14:28:10.470 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-17T14:28:03.523163+0000', 'modified': '2024-02-17T14:28:07.990440+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6833/177127534', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 177127534}, {'type': 'v1', 'addr': '172.21.15.142:6833', 'nonce': 177127534}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-02-17T14:28:10.470 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-17T14:28:10.470 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-02-17T14:28:10.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.574+0000 7fa4c6e64640 1 Processor -- start 2024-02-17T14:28:10.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.574+0000 7fa4c6e64640 1 -- start start 2024-02-17T14:28:10.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4c6e64640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4c009b3f0 0x7fa4c00b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4c6e64640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa4c014f7b0 0x7fa4c0151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4c6e64640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c006b530 con 0x7fa4c0146f20 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4c6e64640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c00b85e0 con 0x7fa4c014f7b0 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4c6e64640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c009b7d0 con 0x7fa4c009b3f0 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4bffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa4c0146f20 0x7fa4c0147380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57810/0 (socket says 172.21.15.134:57810) 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4bffff640 1 -- 172.21.15.134:0/2801673984 learned_addr learned my addr 172.21.15.134:0/2801673984 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4c5401640 1 --2- 172.21.15.134:0/2801673984 >> v2:172.21.15.134:3300/0 conn(0x7fa4c014f7b0 0x7fa4c0151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/2801673984 >> v2:172.21.15.142:3300/0 conn(0x7fa4c009b3f0 0x7fa4c00b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4bf7fe640 1 -- 172.21.15.134:0/2801673984 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261557751 0 0) 0x7fa4c006b530 con 0x7fa4c0146f20 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4bf7fe640 1 -- 172.21.15.134:0/2801673984 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a8003520 con 0x7fa4c0146f20 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4c5401640 1 -- 172.21.15.134:0/2801673984 >> v2:172.21.15.142:3300/0 conn(0x7fa4c009b3f0 msgr2=0x7fa4c00b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4c5401640 1 --2- 172.21.15.134:0/2801673984 >> v2:172.21.15.142:3300/0 conn(0x7fa4c009b3f0 0x7fa4c00b6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4c5401640 1 -- 172.21.15.134:0/2801673984 >> v1:172.21.15.134:6789/0 conn(0x7fa4c0146f20 legacy=0x7fa4c0147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.575+0000 7fa4c5401640 1 -- 172.21.15.134:0/2801673984 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c006af00 con 0x7fa4c014f7b0 2024-02-17T14:28:10.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.576+0000 7fa4c5401640 1 --2- 172.21.15.134:0/2801673984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c014f7b0 0x7fa4c0151ba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0148050 tx=0x7fa4b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3252b93ae29fd0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:10.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.576+0000 7fa4bf7fe640 1 -- 172.21.15.134:0/2801673984 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8031830 con 0x7fa4c014f7b0 2024-02-17T14:28:10.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.576+0000 7fa4bf7fe640 1 -- 172.21.15.134:0/2801673984 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b8031990 con 0x7fa4c014f7b0 2024-02-17T14:28:10.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.576+0000 7fa4bf7fe640 1 -- 172.21.15.134:0/2801673984 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8031d20 con 0x7fa4c014f7b0 2024-02-17T14:28:10.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.577+0000 7fa4c6e64640 1 -- 172.21.15.134:0/2801673984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c014f7b0 msgr2=0x7fa4c0151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.577+0000 7fa4c6e64640 1 --2- 172.21.15.134:0/2801673984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c014f7b0 0x7fa4c0151ba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0148050 tx=0x7fa4b802b8d0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.577+0000 7fa4c6e64640 1 -- 172.21.15.134:0/2801673984 shutdown_connections 2024-02-17T14:28:10.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.577+0000 7fa4c6e64640 1 --2- 172.21.15.134:0/2801673984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c014f7b0 0x7fa4c0151ba0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.577+0000 7fa4c6e64640 1 --2- 172.21.15.134:0/2801673984 >> v2:172.21.15.142:3300/0 conn(0x7fa4c009b3f0 0x7fa4c00b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.577+0000 7fa4c6e64640 1 -- 172.21.15.134:0/2801673984 >> 172.21.15.134:0/2801673984 conn(0x7fa4c00bc630 msgr2=0x7fa4c00bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:10.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.577+0000 7fa4c6e64640 1 -- 172.21.15.134:0/2801673984 shutdown_connections 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.577+0000 7fa4c6e64640 1 -- 172.21.15.134:0/2801673984 wait complete. 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.578+0000 7fa4c6e64640 1 Processor -- start 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.578+0000 7fa4c6e64640 1 -- start start 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4c6e64640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c009b3f0 0x7fa4c00a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4c6e64640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c0146f20 0x7fa4c00b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4c6e64640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4c014f7b0 0x7fa4c0140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4c6e64640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c01dd7a0 con 0x7fa4c0146f20 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4c6e64640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c01dd0e0 con 0x7fa4c009b3f0 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4c6e64640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c01dd3c0 con 0x7fa4c014f7b0 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c0146f20 0x7fa4c00b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c0146f20 0x7fa4c00b2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45174/0 (socket says 172.21.15.134:45174) 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4bffff640 1 -- 172.21.15.134:0/1786986513 learned_addr learned my addr 172.21.15.134:0/1786986513 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c009b3f0 0x7fa4c00a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4c5401640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4c014f7b0 0x7fa4c0140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4bffff640 1 -- 172.21.15.134:0/1786986513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4c014f7b0 msgr2=0x7fa4c0140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4bffff640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4c014f7b0 0x7fa4c0140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4bffff640 1 -- 172.21.15.134:0/1786986513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c009b3f0 msgr2=0x7fa4c00a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4bffff640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c009b3f0 0x7fa4c00a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4bffff640 1 -- 172.21.15.134:0/1786986513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8009400 con 0x7fa4c0146f20 2024-02-17T14:28:10.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c009b3f0 0x7fa4c00a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:10.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4bffff640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c0146f20 0x7fa4c00b2840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400c500 tx=0x7fa4b400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:10.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4bd7fa640 1 -- 172.21.15.134:0/1786986513 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4005ce0 con 0x7fa4c0146f20 2024-02-17T14:28:10.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4bd7fa640 1 -- 172.21.15.134:0/1786986513 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4005e40 con 0x7fa4c0146f20 2024-02-17T14:28:10.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4c6e64640 1 -- 172.21.15.134:0/1786986513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c00a1530 con 0x7fa4c0146f20 2024-02-17T14:28:10.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4bd7fa640 1 -- 172.21.15.134:0/1786986513 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4007330 con 0x7fa4c0146f20 2024-02-17T14:28:10.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.579+0000 7fa4c6e64640 1 -- 172.21.15.134:0/1786986513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c0141300 con 0x7fa4c0146f20 2024-02-17T14:28:10.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.581+0000 7fa4bd7fa640 1 -- 172.21.15.134:0/1786986513 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa4b4007550 con 0x7fa4c0146f20 2024-02-17T14:28:10.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.581+0000 7fa4bd7fa640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa4ac06b810 0x7fa4ac06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.581+0000 7fa4bd7fa640 1 -- 172.21.15.134:0/1786986513 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa4b4089b30 con 0x7fa4c0146f20 2024-02-17T14:28:10.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.581+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa4ac06b810 0x7fa4ac06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.582+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa4ac06b810 0x7fa4ac06dcd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0007520 tx=0x7fa4b000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:10.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.582+0000 7fa4c9a35740 1 Processor -- start 2024-02-17T14:28:10.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.582+0000 7fa4c9a35740 1 -- start start 2024-02-17T14:28:10.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c9a35740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816e919a0 0x55b816ec0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c9a35740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816ec1400 0x55b816eb9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c9a35740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eba3a0 0x55b816eba820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c9a35740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b816e4dcd0 con 0x55b816e919a0 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c9a35740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b816e00f20 con 0x55b816eba3a0 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c9a35740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b816dfe450 con 0x55b816ec1400 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c4c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816e919a0 0x55b816ec0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c4c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816e919a0 0x55b816ec0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45176/0 (socket says 172.21.15.134:45176) 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c4c00640 1 -- 172.21.15.134:0/429550051 learned_addr learned my addr 172.21.15.134:0/429550051 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c4c00640 1 -- 172.21.15.134:0/429550051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816ec1400 msgr2=0x55b816eb9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c5401640 1 --2- 172.21.15.134:0/429550051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eba3a0 0x55b816eba820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4bffff640 1 --2- 172.21.15.134:0/429550051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816ec1400 0x55b816eb9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/429550051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816ec1400 0x55b816eb9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c4c00640 1 -- 172.21.15.134:0/429550051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eba3a0 msgr2=0x55b816eba820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/429550051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eba3a0 0x55b816eba820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c4c00640 1 -- 172.21.15.134:0/429550051 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b816daef20 con 0x55b816e919a0 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c5401640 1 --2- 172.21.15.134:0/429550051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eba3a0 0x55b816eba820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4bffff640 1 --2- 172.21.15.134:0/429550051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816ec1400 0x55b816eb9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:10.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/429550051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816e919a0 0x55b816ec0ec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0016730 tx=0x7fa4b0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f1ee0972c06df0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4a67fc640 1 -- 172.21.15.134:0/429550051 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0014a50 con 0x55b816e919a0 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4a67fc640 1 -- 172.21.15.134:0/429550051 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b0014bb0 con 0x55b816e919a0 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.583+0000 7fa4a67fc640 1 -- 172.21.15.134:0/429550051 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0021400 con 0x55b816e919a0 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.584+0000 7fa4c9a35740 1 -- 172.21.15.134:0/429550051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816e919a0 msgr2=0x55b816ec0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.584+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/429550051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816e919a0 0x55b816ec0ec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0016730 tx=0x7fa4b0012000 comp rx=0 tx=0).stop 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.584+0000 7fa4c9a35740 1 -- 172.21.15.134:0/429550051 shutdown_connections 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.584+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/429550051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eba3a0 0x55b816eba820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.584+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/429550051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816ec1400 0x55b816eb9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.584+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/429550051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816e919a0 0x55b816ec0ec0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.584+0000 7fa4c9a35740 1 -- 172.21.15.134:0/429550051 >> 172.21.15.134:0/429550051 conn(0x55b816e8ef70 msgr2=0x55b816e90ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.584+0000 7fa4c9a35740 1 -- 172.21.15.134:0/429550051 shutdown_connections 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.584+0000 7fa4c9a35740 1 -- 172.21.15.134:0/429550051 wait complete. 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.584+0000 7fa4c9a35740 1 -- start start 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.585+0000 7fa4c9a35740 1 Processor -- start 2024-02-17T14:28:10.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.585+0000 7fa4c9a35740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eba3a0 0x55b816eb6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.585+0000 7fa4c9a35740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816eb9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.585+0000 7fa4c9a35740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eb2190 0x55b816eb2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.585+0000 7fa4c9a35740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b816df9c30 con 0x55b816ec1400 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.585+0000 7fa4c9a35740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b816d9ed30 con 0x55b816eba3a0 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.585+0000 7fa4c9a35740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b816acd310 con 0x55b816eb2190 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.585+0000 7fa4c9a35740 10 client.0 _ll_register_callbacks cb 0x55b816da6d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.585+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816eb9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.585+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816eb9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45180/0 (socket says 172.21.15.134:45180) 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.585+0000 7fa4bffff640 1 -- 172.21.15.134:0/1165622082 learned_addr learned my addr 172.21.15.134:0/1165622082 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.585+0000 7fa4c5401640 1 --2- 172.21.15.134:0/1165622082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eb2190 0x55b816eb2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.585+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/1165622082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eba3a0 0x55b816eb6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4bffff640 1 -- 172.21.15.134:0/1165622082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eb2190 msgr2=0x55b816eb2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4bffff640 1 --2- 172.21.15.134:0/1165622082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eb2190 0x55b816eb2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4bffff640 1 -- 172.21.15.134:0/1165622082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eba3a0 msgr2=0x55b816eb6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4bffff640 1 --2- 172.21.15.134:0/1165622082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eba3a0 0x55b816eb6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4bffff640 1 -- 172.21.15.134:0/1165622082 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b00164a0 con 0x55b816ec1400 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4bffff640 1 --2- 172.21.15.134:0/1165622082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816eb9130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4087d50 tx=0x7fa4b4058200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05810d56a1594d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa49f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa49f7fe640 1 -- 172.21.15.134:0/1165622082 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b405e040 con 0x55b816ec1400 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa49f7fe640 1 -- 172.21.15.134:0/1165622082 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa4b4060540 con 0x55b816ec1400 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1165622082 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b816af96c0 con 0x55b816ec1400 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa49f7fe640 1 -- 172.21.15.134:0/1165622082 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4b4057510 con 0x55b816ec1400 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4c9a35740 10 client.4392 fetch_fsmap learned FSMap version 7 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1165622082 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55b816df82b0 con 0x55b816ec1400 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa49f7fe640 1 -- 172.21.15.134:0/1165622082 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b816af96c0 con 0x55b816ec1400 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa49f7fe640 1 -- 172.21.15.134:0/1165622082 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 7) v1 ==== 2152+0+0 (secure 0 0 0) 0x7fa4b4057670 con 0x55b816ec1400 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4c9a35740 10 client.4392 fetch_fsmap finished waiting for FSMap version 7 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4c9a35740 10 client.4392 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-17T14:28:10.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4c9a35740 20 client.4392 populate_metadata read hostname 'smithi134' 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/1165622082 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x55b816ed1380 0x55b816ed1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4c9a35740 4 client.4392 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1165622082 --> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b816b4a270 con 0x55b816ed1380 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.586+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/1165622082 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x55b816ed1380 0x55b816ed1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.587+0000 7fa49f7fe640 10 client.4392 ms_handle_connect on v2:172.21.15.142:6832/177127534 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.587+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/1165622082 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x55b816ed1380 0x55b816ed1760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76c8df63a0623f59 server_cookie=f3d030de8333c80b in_seq=0 out_seq=0 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.587+0000 7fa49f7fe640 1 -- 172.21.15.134:0/1165622082 <== mds.0 v2:172.21.15.142:6832/177127534 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b816b4a270 con 0x55b816ed1380 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.587+0000 7fa49f7fe640 10 client.4392 handle_command_reply: tid=0 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.587+0000 7fa4c9a35740 1 client.4392 shutdown 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.588+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1165622082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 msgr2=0x55b816eb9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.588+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/1165622082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816eb9130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4087d50 tx=0x7fa4b4058200 comp rx=0 tx=0).stop 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.588+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1165622082 shutdown_connections 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.588+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/1165622082 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x55b816ed1380 0x55b816ed1760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.588+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/1165622082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eb2190 0x55b816eb2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.588+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/1165622082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816eb9130 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.588+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/1165622082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eba3a0 0x55b816eb6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.588+0000 7fa49f7fe640 0 client.4392 ms_handle_reset on v2:172.21.15.142:6832/177127534 2024-02-17T14:28:10.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.588+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1165622082 >> 172.21.15.134:0/1165622082 conn(0x55b816e919a0 msgr2=0x55b816e8bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:10.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.588+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1165622082 shutdown_connections 2024-02-17T14:28:10.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.588+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1165622082 wait complete. 2024-02-17T14:28:10.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.588+0000 7fa4c9a35740 20 client.4392 trim_cache size 0 max 16384 2024-02-17T14:28:10.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.603+0000 7fa4c9a35740 1 Processor -- start 2024-02-17T14:28:10.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.603+0000 7fa4c9a35740 1 -- start start 2024-02-17T14:28:10.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c9a35740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eb2190 0x55b816e88660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c9a35740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eba3a0 0x55b816e8bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c9a35740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816e8c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c9a35740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b816d7f490 con 0x55b816ec1400 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c9a35740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b816ebf000 con 0x55b816eb2190 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c9a35740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b816ebdb80 con 0x55b816eba3a0 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c5401640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816e8c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c5401640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816e8c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45188/0 (socket says 172.21.15.134:45188) 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c5401640 1 -- 172.21.15.134:0/2681736629 learned_addr learned my addr 172.21.15.134:0/2681736629 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c5401640 1 -- 172.21.15.134:0/2681736629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eba3a0 msgr2=0x55b816e8bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c5401640 1 --2- 172.21.15.134:0/2681736629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eba3a0 0x55b816e8bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c5401640 1 -- 172.21.15.134:0/2681736629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eb2190 msgr2=0x55b816e88660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c5401640 1 --2- 172.21.15.134:0/2681736629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eb2190 0x55b816e88660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c5401640 1 -- 172.21.15.134:0/2681736629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b816d94a20 con 0x55b816ec1400 2024-02-17T14:28:10.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4c5401640 1 --2- 172.21.15.134:0/2681736629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816e8c480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009890 tx=0x7fa4b8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578e4a619f32c517 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4a5ffb640 1 -- 172.21.15.134:0/2681736629 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8031b00 con 0x55b816ec1400 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4a5ffb640 1 -- 172.21.15.134:0/2681736629 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b8031c60 con 0x55b816ec1400 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.604+0000 7fa4a5ffb640 1 -- 172.21.15.134:0/2681736629 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8045440 con 0x55b816ec1400 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.605+0000 7fa4c9a35740 1 -- 172.21.15.134:0/2681736629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 msgr2=0x55b816e8c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.605+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/2681736629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816e8c480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009890 tx=0x7fa4b8030000 comp rx=0 tx=0).stop 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.605+0000 7fa4c9a35740 1 -- 172.21.15.134:0/2681736629 shutdown_connections 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.605+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/2681736629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816e8c480 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.605+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/2681736629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eba3a0 0x55b816e8bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.605+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/2681736629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eb2190 0x55b816e88660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.605+0000 7fa4c9a35740 1 -- 172.21.15.134:0/2681736629 >> 172.21.15.134:0/2681736629 conn(0x55b816e919a0 msgr2=0x55b816eb6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.605+0000 7fa4c9a35740 1 -- 172.21.15.134:0/2681736629 shutdown_connections 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.605+0000 7fa4c9a35740 1 -- 172.21.15.134:0/2681736629 wait complete. 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.605+0000 7fa4c9a35740 1 -- start start 2024-02-17T14:28:10.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.605+0000 7fa4c9a35740 1 Processor -- start 2024-02-17T14:28:10.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c9a35740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eb2190 0x55b816ed3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c9a35740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eba3a0 0x55b816eb0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c9a35740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816eb13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c9a35740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b816ece120 con 0x55b816ec1400 2024-02-17T14:28:10.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c9a35740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b816eb5c50 con 0x55b816eb2190 2024-02-17T14:28:10.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c9a35740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b816ed3770 con 0x55b816eba3a0 2024-02-17T14:28:10.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c9a35740 10 client.0 _ll_register_callbacks cb 0x7fa4b0009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T14:28:10.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c5401640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816eb13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c5401640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816eb13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45204/0 (socket says 172.21.15.134:45204) 2024-02-17T14:28:10.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c5401640 1 -- 172.21.15.134:0/1235546134 learned_addr learned my addr 172.21.15.134:0/1235546134 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:10.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4bffff640 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eba3a0 0x55b816eb0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eb2190 0x55b816ed3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c5401640 1 -- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eba3a0 msgr2=0x55b816eb0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:10.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c5401640 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eba3a0 0x55b816eb0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c5401640 1 -- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eb2190 msgr2=0x55b816ed3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:10.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c5401640 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eb2190 0x55b816ed3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c5401640 1 -- 172.21.15.134:0/1235546134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c006af00 con 0x55b816ec1400 2024-02-17T14:28:10.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4bffff640 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eba3a0 0x55b816eb0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:10.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.606+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eb2190 0x55b816ed3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:10.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa4c5401640 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816eb13e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa4b802beb0 tx=0x7fa4b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603a9541cb5361a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:10.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa49f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-02-17T14:28:10.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa49f7fe640 1 -- 172.21.15.134:0/1235546134 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8045850 con 0x55b816ec1400 2024-02-17T14:28:10.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa49f7fe640 1 -- 172.21.15.134:0/1235546134 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa4b803f040 con 0x55b816ec1400 2024-02-17T14:28:10.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1235546134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4b0014bb0 con 0x55b816ec1400 2024-02-17T14:28:10.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa49f7fe640 1 -- 172.21.15.134:0/1235546134 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4b8031e50 con 0x55b816ec1400 2024-02-17T14:28:10.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa4c9a35740 10 client.4398 fetch_fsmap learned FSMap version 7 2024-02-17T14:28:10.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1235546134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55b816dba780 con 0x55b816ec1400 2024-02-17T14:28:10.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa49f7fe640 1 -- 172.21.15.134:0/1235546134 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b0014bb0 con 0x55b816ec1400 2024-02-17T14:28:10.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa49f7fe640 1 -- 172.21.15.134:0/1235546134 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 7) v1 ==== 2152+0+0 (secure 0 0 0) 0x7fa4b803acf0 con 0x55b816ec1400 2024-02-17T14:28:10.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa4c9a35740 10 client.4398 fetch_fsmap finished waiting for FSMap version 7 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa4c9a35740 10 client.4398 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa4c9a35740 20 client.4398 populate_metadata read hostname 'smithi134' 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x55b816f25760 0x55b816f25b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa4c9a35740 4 client.4398 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1235546134 --> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b816b36610 con 0x55b816f25760 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.607+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x55b816f25760 0x55b816f25b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa49f7fe640 10 client.4398 ms_handle_connect on v2:172.21.15.142:6832/177127534 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c4c00640 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x55b816f25760 0x55b816f25b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3209009891e8ec34 server_cookie=f788a2cbf8d14303 in_seq=0 out_seq=0 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa49f7fe640 1 -- 172.21.15.134:0/1235546134 <== mds.0 v2:172.21.15.142:6832/177127534 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x55b816b36610 con 0x55b816f25760 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa49f7fe640 10 client.4398 handle_command_reply: tid=0 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c9a35740 1 client.4398 shutdown 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1235546134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 msgr2=0x55b816eb13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816eb13e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa4b802beb0 tx=0x7fa4b8004730 comp rx=0 tx=0).stop 2024-02-17T14:28:10.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1235546134 shutdown_connections 2024-02-17T14:28:10.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x55b816f25760 0x55b816f25b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b816ec1400 0x55b816eb13e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b816eba3a0 0x55b816eb0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c9a35740 1 --2- 172.21.15.134:0/1235546134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b816eb2190 0x55b816ed3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa49f7fe640 0 client.4398 ms_handle_reset on v2:172.21.15.142:6832/177127534 2024-02-17T14:28:10.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1235546134 >> 172.21.15.134:0/1235546134 conn(0x55b816e919a0 msgr2=0x55b816ec03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:10.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1235546134 shutdown_connections 2024-02-17T14:28:10.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c9a35740 1 -- 172.21.15.134:0/1235546134 wait complete. 2024-02-17T14:28:10.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c9a35740 20 client.4398 trim_cache size 0 max 16384 2024-02-17T14:28:10.615 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-17T14:28:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "b1013434-3edf-47fa-8dd2-e861b79d4deb", 2024-02-17T14:28:10.615 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-02-17T14:28:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 4264, 2024-02-17T14:28:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-02-17T14:28:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-02-17T14:28:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-02-17T14:28:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 6.554436731, 2024-02-17T14:28:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 7, 2024-02-17T14:28:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 25, 2024-02-17T14:28:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 25, 2024-02-17T14:28:10.616 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 13.564360771 2024-02-17T14:28:10.616 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-17T14:28:10.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c6e64640 1 -- 172.21.15.134:0/1786986513 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa4ac06b810 msgr2=0x7fa4ac06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c6e64640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa4ac06b810 0x7fa4ac06dcd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0007520 tx=0x7fa4b000b040 comp rx=0 tx=0).stop 2024-02-17T14:28:10.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c6e64640 1 -- 172.21.15.134:0/1786986513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c0146f20 msgr2=0x7fa4c00b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.608+0000 7fa4c6e64640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c0146f20 0x7fa4c00b2840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400c500 tx=0x7fa4b400c9c0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.609+0000 7fa4c6e64640 1 -- 172.21.15.134:0/1786986513 shutdown_connections 2024-02-17T14:28:10.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.609+0000 7fa4c6e64640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4c014f7b0 0x7fa4c0140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.609+0000 7fa4c6e64640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa4ac06b810 0x7fa4ac06dcd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.609+0000 7fa4c6e64640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c0146f20 0x7fa4c00b2840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.609+0000 7fa4c6e64640 1 --2- 172.21.15.134:0/1786986513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c009b3f0 0x7fa4c00a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.609+0000 7fa4c6e64640 1 -- 172.21.15.134:0/1786986513 >> 172.21.15.134:0/1786986513 conn(0x7fa4c00bc630 msgr2=0x7fa4c0144f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:10.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.609+0000 7fa4c6e64640 1 -- 172.21.15.134:0/1786986513 shutdown_connections 2024-02-17T14:28:10.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.609+0000 7fa4c6e64640 1 -- 172.21.15.134:0/1786986513 wait complete. 2024-02-17T14:28:10.619 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-17T14:28:10.619 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-02-17T14:28:10.620 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T14:28:10.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.721+0000 7fd07d08f640 1 Processor -- start 2024-02-17T14:28:10.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.721+0000 7fd07d08f640 1 -- start start 2024-02-17T14:28:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.721+0000 7fd07d08f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd07814e4b0 0x7fd0781508a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.721+0000 7fd07d08f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07813f3b0 con 0x7fd07809cc70 2024-02-17T14:28:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.721+0000 7fd07d08f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd078145b60 con 0x7fd0780b0680 2024-02-17T14:28:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.721+0000 7fd07d08f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0780b0a60 con 0x7fd07814e4b0 2024-02-17T14:28:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.722+0000 7fd07759e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd07814e4b0 0x7fd0781508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.722+0000 7fd06ffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd07809cc70 0x7fd078072280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57816/0 (socket says 172.21.15.134:57816) 2024-02-17T14:28:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.722+0000 7fd06ffff640 1 -- 172.21.15.134:0/2461889806 learned_addr learned my addr 172.21.15.134:0/2461889806 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.722+0000 7fd07759e640 1 -- 172.21.15.134:0/2461889806 >> v1:172.21.15.142:6789/0 conn(0x7fd0780b0680 legacy=0x7fd078071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:10.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.722+0000 7fd07759e640 1 -- 172.21.15.134:0/2461889806 >> v1:172.21.15.134:6789/0 conn(0x7fd07809cc70 legacy=0x7fd078072280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.722+0000 7fd07659c640 1 -- 172.21.15.134:0/2461889806 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653907145 0 0) 0x7fd07813f3b0 con 0x7fd07809cc70 2024-02-17T14:28:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.722+0000 7fd07759e640 1 -- 172.21.15.134:0/2461889806 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd078145080 con 0x7fd07814e4b0 2024-02-17T14:28:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.723+0000 7fd07759e640 1 --2- 172.21.15.134:0/2461889806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd07814e4b0 0x7fd0781508a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd070009d90 tx=0x7fd07002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c8001f05e3b121 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.723+0000 7fd07659c640 1 -- 172.21.15.134:0/2461889806 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07002cbd0 con 0x7fd07814e4b0 2024-02-17T14:28:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.723+0000 7fd07659c640 1 -- 172.21.15.134:0/2461889806 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07002cd30 con 0x7fd07814e4b0 2024-02-17T14:28:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.723+0000 7fd07659c640 1 -- 172.21.15.134:0/2461889806 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07002cea0 con 0x7fd07814e4b0 2024-02-17T14:28:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.723+0000 7fd07d08f640 1 -- 172.21.15.134:0/2461889806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd07814e4b0 msgr2=0x7fd0781508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.723+0000 7fd07d08f640 1 --2- 172.21.15.134:0/2461889806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd07814e4b0 0x7fd0781508a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd070009d90 tx=0x7fd07002be20 comp rx=0 tx=0).stop 2024-02-17T14:28:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.723+0000 7fd07d08f640 1 -- 172.21.15.134:0/2461889806 shutdown_connections 2024-02-17T14:28:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.723+0000 7fd07d08f640 1 --2- 172.21.15.134:0/2461889806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd07814e4b0 0x7fd0781508a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.723+0000 7fd07d08f640 1 -- 172.21.15.134:0/2461889806 >> 172.21.15.134:0/2461889806 conn(0x7fd0780b6e70 msgr2=0x7fd0780b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.723+0000 7fd07d08f640 1 -- 172.21.15.134:0/2461889806 shutdown_connections 2024-02-17T14:28:10.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.723+0000 7fd07d08f640 1 -- 172.21.15.134:0/2461889806 wait complete. 2024-02-17T14:28:10.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.724+0000 7fd07d08f640 1 Processor -- start 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.724+0000 7fd07d08f640 1 -- start start 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07d08f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd07809cc70 0x7fd0780b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07d08f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0780b0680 0x7fd0780b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07d08f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd07814e4b0 0x7fd0781dd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07d08f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0780a0520 con 0x7fd07814e4b0 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07d08f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0780b2870 con 0x7fd0780b0680 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07d08f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0780b2e30 con 0x7fd07809cc70 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07759e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd07814e4b0 0x7fd0781dd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07759e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd07814e4b0 0x7fd0781dd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45214/0 (socket says 172.21.15.134:45214) 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07759e640 1 -- 172.21.15.134:0/3730647278 learned_addr learned my addr 172.21.15.134:0/3730647278 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd076d9d640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd07809cc70 0x7fd0780b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd06ffff640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0780b0680 0x7fd0780b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07759e640 1 -- 172.21.15.134:0/3730647278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd07809cc70 msgr2=0x7fd0780b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07759e640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd07809cc70 0x7fd0780b21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07759e640 1 -- 172.21.15.134:0/3730647278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0780b0680 msgr2=0x7fd0780b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07759e640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0780b0680 0x7fd0780b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.725+0000 7fd07759e640 1 -- 172.21.15.134:0/3730647278 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd070009a70 con 0x7fd07814e4b0 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.726+0000 7fd07759e640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd07814e4b0 0x7fd0781dd9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd07002c430 tx=0x7fd070004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.726+0000 7fd06f7fe640 1 -- 172.21.15.134:0/3730647278 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07002cea0 con 0x7fd07814e4b0 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.726+0000 7fd06f7fe640 1 -- 172.21.15.134:0/3730647278 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07003e610 con 0x7fd07814e4b0 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.726+0000 7fd07d08f640 1 -- 172.21.15.134:0/3730647278 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0780b3b80 con 0x7fd07814e4b0 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.726+0000 7fd06f7fe640 1 -- 172.21.15.134:0/3730647278 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07003e9c0 con 0x7fd07814e4b0 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.726+0000 7fd07d08f640 1 -- 172.21.15.134:0/3730647278 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0781414f0 con 0x7fd07814e4b0 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.727+0000 7fd07d08f640 1 -- 172.21.15.134:0/3730647278 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0780a06d0 con 0x7fd07814e4b0 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.727+0000 7fd06f7fe640 1 -- 172.21.15.134:0/3730647278 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd07003b050 con 0x7fd07814e4b0 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.728+0000 7fd06f7fe640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd05806b810 0x7fd05806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.728+0000 7fd076d9d640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd05806b810 0x7fd05806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:10.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.728+0000 7fd06f7fe640 1 -- 172.21.15.134:0/3730647278 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd0700ac630 con 0x7fd07814e4b0 2024-02-17T14:28:10.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.728+0000 7fd076d9d640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd05806b810 0x7fd05806dcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd068004f60 tx=0x7fd068007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:10.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.732+0000 7fd06f7fe640 1 -- 172.21.15.134:0/3730647278 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd070076e50 con 0x7fd07814e4b0 2024-02-17T14:28:10.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.938+0000 7fd07d08f640 1 -- 172.21.15.134:0/3730647278 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd0780b1780 con 0x7fd07814e4b0 2024-02-17T14:28:10.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.938+0000 7fd06f7fe640 1 -- 172.21.15.134:0/3730647278 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd0780b1780 con 0x7fd07814e4b0 2024-02-17T14:28:10.938 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-17T14:28:10.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.940+0000 7fd07d08f640 1 -- 172.21.15.134:0/3730647278 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd05806b810 msgr2=0x7fd05806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.940+0000 7fd07d08f640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd05806b810 0x7fd05806dcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd068004f60 tx=0x7fd068007e30 comp rx=0 tx=0).stop 2024-02-17T14:28:10.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.940+0000 7fd07d08f640 1 -- 172.21.15.134:0/3730647278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd07814e4b0 msgr2=0x7fd0781dd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:10.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.940+0000 7fd07d08f640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd07814e4b0 0x7fd0781dd9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd07002c430 tx=0x7fd070004a40 comp rx=0 tx=0).stop 2024-02-17T14:28:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.940+0000 7fd07d08f640 1 -- 172.21.15.134:0/3730647278 shutdown_connections 2024-02-17T14:28:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.940+0000 7fd07d08f640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd05806b810 0x7fd05806dcd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.940+0000 7fd07d08f640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd07814e4b0 0x7fd0781dd9c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.940+0000 7fd07d08f640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0780b0680 0x7fd0780b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.940+0000 7fd07d08f640 1 --2- 172.21.15.134:0/3730647278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd07809cc70 0x7fd0780b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.940+0000 7fd07d08f640 1 -- 172.21.15.134:0/3730647278 >> 172.21.15.134:0/3730647278 conn(0x7fd0780b6e70 msgr2=0x7fd0780b8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.941+0000 7fd07d08f640 1 -- 172.21.15.134:0/3730647278 shutdown_connections 2024-02-17T14:28:10.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:10.941+0000 7fd07d08f640 1 -- 172.21.15.134:0/3730647278 wait complete. 2024-02-17T14:28:10.951 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-17T14:28:10.951 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T14:28:10.951 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-02-17T14:28:10.951 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-02-17T14:28:10.951 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-02-17T14:28:10.951 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-17T14:28:10.951 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-17T14:28:10.951 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T14:28:10.951 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-02-17T14:28:10.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:10.952 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-02-17T14:28:10.967 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T14:28:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T14:28:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T14:28:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-02-17T14:28:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-02-17T14:28:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-02-17T14:28:10.967 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T14:28:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-02-17T14:28:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-02-17T14:28:10.967 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T14:28:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-02-17T14:28:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-02-17T14:28:10.967 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T14:28:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-02-17T14:28:10.968 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T14:28:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-02-17T14:28:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-17T14:28:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42730sec preferred_lft 42730sec 2024-02-17T14:28:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2024-02-17T14:28:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-02-17T14:28:10.968 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-17T14:28:10.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:10.969 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-17T14:28:10.969 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-17T14:28:10.969 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2024-02-17T14:28:10.969 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2024-02-17T14:28:10.969 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2024-02-17T14:28:10.969 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-17T14:28:10.969 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-17T14:28:11.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:11.134 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T14:28:11.160 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-02-17T14:28:11.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:11.162 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-02-17T14:28:11.237 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-02-17T14:28:11.237 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T14:28:11.237 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T14:28:11.237 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T14:28:11.237 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T14:28:11.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:11.238 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-17T14:28:11.238 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-17T14:28:11.238 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T14:28:11.238 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T14:28:11.238 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T14:28:11.238 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-17T14:28:11.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:11.476 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-02-17T14:28:11.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:11.492 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-02-17T14:28:11.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:11.548 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-17T14:28:11.548 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-17T14:28:11.548 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T14:28:11.548 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-02-17T14:28:11.549 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-17T14:28:11.632 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-02-17T14:28:11.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:11.632 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-17T14:28:11.632 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-17T14:28:11.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-02-17T14:28:11.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-17T14:28:11.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-02-17T14:28:11.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-02-17T14:28:11.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-02-17T14:28:11.632 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-17T14:28:11.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:11.767 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-17T14:28:11.768 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-17T14:28:11.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-02-17T14:28:11.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2024-02-17T14:28:11.768 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-17T14:28:11.817 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-02-17T14:28:11.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T14:28:11.817 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-02-17T14:28:11.843 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-02-17T14:28:11.843 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T14:28:11.843 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-02-17T14:28:11.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo modprobe fuse 2024-02-17T14:28:11.965 DEBUG:teuthology.orchestra.run.smithi134:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T14:28:12.021 INFO:teuthology.orchestra.run.smithi134.stdout:/proc 2024-02-17T14:28:12.021 INFO:teuthology.orchestra.run.smithi134.stdout:/sys 2024-02-17T14:28:12.021 INFO:teuthology.orchestra.run.smithi134.stdout:/dev 2024-02-17T14:28:12.021 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/security 2024-02-17T14:28:12.021 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/shm 2024-02-17T14:28:12.021 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/pts 2024-02-17T14:28:12.021 INFO:teuthology.orchestra.run.smithi134.stdout:/run 2024-02-17T14:28:12.021 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/cgroup 2024-02-17T14:28:12.021 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/pstore 2024-02-17T14:28:12.021 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/bpf 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/ 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/selinux 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/debug 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/mqueue 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/hugepages 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/tracing 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/fuse/connections 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/config 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T14:28:12.022 INFO:teuthology.orchestra.run.smithi134.stdout:/run/user/1000 2024-02-17T14:28:12.023 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph 2024-02-17T14:28:12.023 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T14:28:12.023 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T14:28:12.023 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T14:28:12.023 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T14:28:12.023 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns 2024-02-17T14:28:12.023 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T14:28:12.023 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T14:28:12.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:12.023 DEBUG:teuthology.orchestra.run.smithi134:> ls /sys/fs/fuse/connections 2024-02-17T14:28:12.075 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-17T14:28:12.076 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-02-17T14:28:12.119 DEBUG:teuthology.orchestra.run.smithi134:> sudo modprobe fuse 2024-02-17T14:28:12.145 DEBUG:teuthology.orchestra.run.smithi134:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T14:28:12.200 INFO:teuthology.orchestra.run.smithi134.stdout:/proc 2024-02-17T14:28:12.200 INFO:teuthology.orchestra.run.smithi134.stdout:/sys 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/dev 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/security 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/shm 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/pts 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/run 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/cgroup 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/pstore 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/bpf 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/ 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/selinux 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/debug 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/mqueue 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/hugepages 2024-02-17T14:28:12.201 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/tracing 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/fuse/connections 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/config 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/run/user/1000 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T14:28:12.202 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T14:28:12.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:12.203 DEBUG:teuthology.orchestra.run.smithi134:> ls /sys/fs/fuse/connections 2024-02-17T14:28:12.205 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi134.stderr:2024-02-17T14:28:12.205+0000 7fabb9c4b480 -1 init, newargv = 0x5651a51ba610 newargc=15 2024-02-17T14:28:12.205 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi134.stderr:ceph-fuse[43089]: starting ceph client 2024-02-17T14:28:12.211 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi134.stderr:ceph-fuse[43089]: starting fuse 2024-02-17T14:28:12.219 INFO:teuthology.orchestra.run.smithi134.stdout:41 2024-02-17T14:28:12.219 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-02-17T14:28:12.219 DEBUG:teuthology.orchestra.run.smithi134:> sudo stdin-killer -- python3 -c ' 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> import glob 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> import re 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> import os 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> import subprocess 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> def _find_admin_socket(client_name): 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> files = glob.glob(asok_path) 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> # Given a non-glob path, it better be there 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> if "*" not in asok_path: 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> assert(len(files) == 1) 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> return files[0] 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> 2024-02-17T14:28:12.220 DEBUG:teuthology.orchestra.run.smithi134:> for f in files: 2024-02-17T14:28:12.221 DEBUG:teuthology.orchestra.run.smithi134:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-17T14:28:12.221 DEBUG:teuthology.orchestra.run.smithi134:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-17T14:28:12.221 DEBUG:teuthology.orchestra.run.smithi134:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-17T14:28:12.221 DEBUG:teuthology.orchestra.run.smithi134:> contents = proc_f.read() 2024-02-17T14:28:12.221 DEBUG:teuthology.orchestra.run.smithi134:> if mountpoint in contents: 2024-02-17T14:28:12.221 DEBUG:teuthology.orchestra.run.smithi134:> return f 2024-02-17T14:28:12.221 DEBUG:teuthology.orchestra.run.smithi134:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-17T14:28:12.221 DEBUG:teuthology.orchestra.run.smithi134:> 2024-02-17T14:28:12.221 DEBUG:teuthology.orchestra.run.smithi134:> print(_find_admin_socket("client.admin")) 2024-02-17T14:28:12.221 DEBUG:teuthology.orchestra.run.smithi134:> ' 2024-02-17T14:28:12.339 INFO:teuthology.orchestra.run.smithi134.stdout:/var/run/ceph/ceph-client.admin.43089.asok 2024-02-17T14:28:12.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-17T14:28:12.349 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43089.asok 2024-02-17T14:28:12.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:12.349 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43089.asok status 2024-02-17T14:28:12.483 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-17T14:28:12.484 INFO:teuthology.orchestra.run.smithi134.stdout: "metadata": { 2024-02-17T14:28:12.484 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_sha1": "6822c7b54e949006be7a0802650d01723d834d1d", 2024-02-17T14:28:12.484 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 19.0.0-1515-g6822c7b5 (6822c7b54e949006be7a0802650d01723d834d1d) squid (dev)", 2024-02-17T14:28:12.484 INFO:teuthology.orchestra.run.smithi134.stdout: "entity_id": "admin", 2024-02-17T14:28:12.484 INFO:teuthology.orchestra.run.smithi134.stdout: "hostname": "smithi134", 2024-02-17T14:28:12.484 INFO:teuthology.orchestra.run.smithi134.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-02-17T14:28:12.484 INFO:teuthology.orchestra.run.smithi134.stdout: "pid": "43089", 2024-02-17T14:28:12.484 INFO:teuthology.orchestra.run.smithi134.stdout: "root": "/" 2024-02-17T14:28:12.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-17T14:28:12.484 INFO:teuthology.orchestra.run.smithi134.stdout: "dentry_count": 0, 2024-02-17T14:28:12.484 INFO:teuthology.orchestra.run.smithi134.stdout: "dentry_pinned_count": 0, 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 4413, 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: "inst": { 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: "name": { 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client", 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: "num": 4413 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": { 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "192.168.0.1:0", 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3407677291 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": { 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-02-17T14:28:12.485 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "192.168.0.1:0", 2024-02-17T14:28:12.486 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3407677291 2024-02-17T14:28:12.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-17T14:28:12.486 INFO:teuthology.orchestra.run.smithi134.stdout: "inst_str": "client.4413 192.168.0.1:0/3407677291", 2024-02-17T14:28:12.486 INFO:teuthology.orchestra.run.smithi134.stdout: "addr_str": "192.168.0.1:0/3407677291", 2024-02-17T14:28:12.486 INFO:teuthology.orchestra.run.smithi134.stdout: "inode_count": 1, 2024-02-17T14:28:12.486 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_epoch": 7, 2024-02-17T14:28:12.486 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_epoch": 25, 2024-02-17T14:28:12.486 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_epoch_barrier": 0, 2024-02-17T14:28:12.486 INFO:teuthology.orchestra.run.smithi134.stdout: "blocklisted": false, 2024-02-17T14:28:12.486 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs" 2024-02-17T14:28:12.486 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-17T14:28:12.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:12.492 DEBUG:teuthology.orchestra.run.smithi134:> stat --file-system '--printf=%T 2024-02-17T14:28:12.492 DEBUG:teuthology.orchestra.run.smithi134:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-02-17T14:28:12.507 INFO:teuthology.orchestra.run.smithi134.stdout:fuseblk 2024-02-17T14:28:12.507 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-02-17T14:28:12.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:12.507 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-02-17T14:28:12.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:12.576 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-02-17T14:28:12.645 INFO:teuthology.orchestra.run.smithi134.stdout:# file: . 2024-02-17T14:28:12.645 INFO:teuthology.orchestra.run.smithi134.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-02-17T14:28:12.645 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:12.646 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:28:12.646 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T14:28:12.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:12.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.843+0000 7f6041da0640 1 Processor -- start 2024-02-17T14:28:12.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.843+0000 7f6041da0640 1 -- start start 2024-02-17T14:28:12.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.844+0000 7f6041da0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f603c072ae0 0x7f603c0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:12.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.844+0000 7f6041da0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c0712c0 con 0x7f603c0716e0 2024-02-17T14:28:12.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.844+0000 7f6041da0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c148e40 con 0x7f603c071b50 2024-02-17T14:28:12.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.844+0000 7f6041da0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c0b20e0 con 0x7f603c072ae0 2024-02-17T14:28:12.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.844+0000 7f603bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f603c0716e0 0x7f603c148020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57828/0 (socket says 172.21.15.134:57828) 2024-02-17T14:28:12.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.844+0000 7f603bfff640 1 -- 172.21.15.134:0/2061833661 learned_addr learned my addr 172.21.15.134:0/2061833661 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:12.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.844+0000 7f6040d9e640 1 --2- 172.21.15.134:0/2061833661 >> v2:172.21.15.142:3300/0 conn(0x7f603c072ae0 0x7f603c0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:12.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.844+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958189753 0 0) 0x7f603c0712c0 con 0x7f603c0716e0 2024-02-17T14:28:12.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6024003520 con 0x7f603c0716e0 2024-02-17T14:28:12.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854376799 0 0) 0x7f603c148e40 con 0x7f603c071b50 2024-02-17T14:28:12.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f603c0712c0 con 0x7f603c071b50 2024-02-17T14:28:12.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1279475535 0 0) 0x7f6024003520 con 0x7f603c0716e0 2024-02-17T14:28:12.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 >> v2:172.21.15.142:3300/0 conn(0x7f603c072ae0 msgr2=0x7f603c0b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:12.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 --2- 172.21.15.134:0/2061833661 >> v2:172.21.15.142:3300/0 conn(0x7f603c072ae0 0x7f603c0b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:12.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 >> v1:172.21.15.142:6789/0 conn(0x7f603c071b50 legacy=0x7f603c148730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:12.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c072ec0 con 0x7f603c0716e0 2024-02-17T14:28:12.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f6030001670 con 0x7f603c0716e0 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 >> v1:172.21.15.134:6789/0 conn(0x7f603c0716e0 legacy=0x7f603c148020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 --2- 172.21.15.134:0/2061833661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6024003b00 0x7f6024003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 --2- 172.21.15.134:0/2061833661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60240047c0 0x7f6024004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 --2- 172.21.15.134:0/2061833661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6024005180 0x7f602400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0b20e0 con 0x7f60240047c0 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602400c000 con 0x7f6024005180 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602400c1c0 con 0x7f6024003b00 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603bfff640 1 --2- 172.21.15.134:0/2061833661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60240047c0 0x7f6024004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f604159f640 1 --2- 172.21.15.134:0/2061833661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6024005180 0x7f602400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f6040d9e640 1 --2- 172.21.15.134:0/2061833661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6024003b00 0x7f6024003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603bfff640 1 -- 172.21.15.134:0/2061833661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6024003b00 msgr2=0x7f6024003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603bfff640 1 --2- 172.21.15.134:0/2061833661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6024003b00 0x7f6024003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603bfff640 1 -- 172.21.15.134:0/2061833661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6024005180 msgr2=0x7f602400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603bfff640 1 --2- 172.21.15.134:0/2061833661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6024005180 0x7f602400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:12.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f603bfff640 1 -- 172.21.15.134:0/2061833661 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024003520 con 0x7f60240047c0 2024-02-17T14:28:12.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.845+0000 7f604159f640 1 -- 172.21.15.134:0/2061833661 reap_dead start 2024-02-17T14:28:12.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.846+0000 7f603bfff640 1 --2- 172.21.15.134:0/2061833661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60240047c0 0x7f6024004c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6030007fd0 tx=0x7f60240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24afee3c21c43a46 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:12.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.846+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030005ad0 con 0x7f60240047c0 2024-02-17T14:28:12.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.846+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6030005c50 con 0x7f60240047c0 2024-02-17T14:28:12.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.846+0000 7f603b7fe640 1 -- 172.21.15.134:0/2061833661 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603002c830 con 0x7f60240047c0 2024-02-17T14:28:12.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.846+0000 7f6041da0640 1 -- 172.21.15.134:0/2061833661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60240047c0 msgr2=0x7f6024004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:12.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.846+0000 7f6041da0640 1 --2- 172.21.15.134:0/2061833661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60240047c0 0x7f6024004c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6030007fd0 tx=0x7f60240057f0 comp rx=0 tx=0).stop 2024-02-17T14:28:12.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.847+0000 7f6041da0640 1 -- 172.21.15.134:0/2061833661 shutdown_connections 2024-02-17T14:28:12.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.847+0000 7f6041da0640 1 --2- 172.21.15.134:0/2061833661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60240047c0 0x7f6024004c40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:12.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.847+0000 7f6041da0640 1 -- 172.21.15.134:0/2061833661 >> 172.21.15.134:0/2061833661 conn(0x7f603c06b6a0 msgr2=0x7f603c0b4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:12.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.847+0000 7f6041da0640 1 -- 172.21.15.134:0/2061833661 shutdown_connections 2024-02-17T14:28:12.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.847+0000 7f6041da0640 1 -- 172.21.15.134:0/2061833661 wait complete. 2024-02-17T14:28:12.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.848+0000 7f6041da0640 1 Processor -- start 2024-02-17T14:28:12.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.848+0000 7f6041da0640 1 -- start start 2024-02-17T14:28:12.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.848+0000 7f6041da0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60240047c0 0x7f603c147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:12.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.848+0000 7f6041da0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f603c145bf0 0x7f603c146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:12.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.848+0000 7f6041da0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c0b30e0 0x7f603c0b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:12.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.848+0000 7f6041da0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c148660 con 0x7f603c0b30e0 2024-02-17T14:28:12.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.848+0000 7f6041da0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c1488d0 con 0x7f603c145bf0 2024-02-17T14:28:12.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.848+0000 7f6041da0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0b3a80 con 0x7f60240047c0 2024-02-17T14:28:12.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.848+0000 7f604159f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c0b30e0 0x7f603c0b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.848+0000 7f604159f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c0b30e0 0x7f603c0b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45226/0 (socket says 172.21.15.134:45226) 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.848+0000 7f604159f640 1 -- 172.21.15.134:0/3147467893 learned_addr learned my addr 172.21.15.134:0/3147467893 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f603bfff640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f603c145bf0 0x7f603c146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f6040d9e640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60240047c0 0x7f603c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f604159f640 1 -- 172.21.15.134:0/3147467893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60240047c0 msgr2=0x7f603c147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f604159f640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60240047c0 0x7f603c147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f604159f640 1 -- 172.21.15.134:0/3147467893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f603c145bf0 msgr2=0x7f603c146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f604159f640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f603c145bf0 0x7f603c146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f604159f640 1 -- 172.21.15.134:0/3147467893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c148d40 con 0x7f603c0b30e0 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f603bfff640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f603c145bf0 0x7f603c146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f6040d9e640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60240047c0 0x7f603c147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f604159f640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c0b30e0 0x7f603c0b3540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6024004740 tx=0x7f603400ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f60397fa640 1 -- 172.21.15.134:0/3147467893 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034003c40 con 0x7f603c0b30e0 2024-02-17T14:28:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f60397fa640 1 -- 172.21.15.134:0/3147467893 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6034003da0 con 0x7f603c0b30e0 2024-02-17T14:28:12.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f6041da0640 1 -- 172.21.15.134:0/3147467893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c147fa0 con 0x7f603c0b30e0 2024-02-17T14:28:12.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f60397fa640 1 -- 172.21.15.134:0/3147467893 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034005290 con 0x7f603c0b30e0 2024-02-17T14:28:12.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.849+0000 7f6041da0640 1 -- 172.21.15.134:0/3147467893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c130240 con 0x7f603c0b30e0 2024-02-17T14:28:12.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.850+0000 7f6041da0640 1 -- 172.21.15.134:0/3147467893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c074d50 con 0x7f603c0b30e0 2024-02-17T14:28:12.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.851+0000 7f60397fa640 1 -- 172.21.15.134:0/3147467893 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f60340053f0 con 0x7f603c0b30e0 2024-02-17T14:28:12.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.851+0000 7f60397fa640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f602806b810 0x7f602806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:12.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.851+0000 7f60397fa640 1 -- 172.21.15.134:0/3147467893 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6034089db0 con 0x7f603c0b30e0 2024-02-17T14:28:12.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.851+0000 7f6040d9e640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f602806b810 0x7f602806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:12.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.852+0000 7f6040d9e640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f602806b810 0x7f602806dcd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f602c0099e0 tx=0x7f602c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:12.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:12.855+0000 7f60397fa640 1 -- 172.21.15.134:0/3147467893 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6034054520 con 0x7f603c0b30e0 2024-02-17T14:28:13.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.028+0000 7f6041da0640 1 -- 172.21.15.134:0/3147467893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f603c070f70 con 0x7f603c0b30e0 2024-02-17T14:28:13.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.029+0000 7f60397fa640 1 -- 172.21.15.134:0/3147467893 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f603401a090 con 0x7f603c0b30e0 2024-02-17T14:28:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:13.028 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:07.990271+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:13.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.031+0000 7f6041da0640 1 -- 172.21.15.134:0/3147467893 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f602806b810 msgr2=0x7f602806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.031+0000 7f6041da0640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f602806b810 0x7f602806dcd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f602c0099e0 tx=0x7f602c008040 comp rx=0 tx=0).stop 2024-02-17T14:28:13.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.031+0000 7f6041da0640 1 -- 172.21.15.134:0/3147467893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c0b30e0 msgr2=0x7f603c0b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.031+0000 7f6041da0640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c0b30e0 0x7f603c0b3540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6024004740 tx=0x7f603400ff70 comp rx=0 tx=0).stop 2024-02-17T14:28:13.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.031+0000 7f6041da0640 1 -- 172.21.15.134:0/3147467893 shutdown_connections 2024-02-17T14:28:13.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.031+0000 7f6041da0640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f602806b810 0x7f602806dcd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.031+0000 7f6041da0640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c0b30e0 0x7f603c0b3540 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.031+0000 7f6041da0640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f603c145bf0 0x7f603c146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.031+0000 7f6041da0640 1 --2- 172.21.15.134:0/3147467893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60240047c0 0x7f603c147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.031+0000 7f6041da0640 1 -- 172.21.15.134:0/3147467893 >> 172.21.15.134:0/3147467893 conn(0x7f603c06b6a0 msgr2=0x7f603c0b80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:13.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.031+0000 7f6041da0640 1 -- 172.21.15.134:0/3147467893 shutdown_connections 2024-02-17T14:28:13.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.031+0000 7f6041da0640 1 -- 172.21.15.134:0/3147467893 wait complete. 2024-02-17T14:28:13.041 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T14:27:58.602268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T14:28:01.178917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T14:28:02.371936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T14:28:05.647194+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T14:28:13.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T14:28:13.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.145+0000 7f202cd4b640 1 Processor -- start 2024-02-17T14:28:13.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.145+0000 7f202cd4b640 1 -- start start 2024-02-17T14:28:13.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.146+0000 7f202cd4b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f202806ae10 0x7f20280b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.146+0000 7f202cd4b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2028140a90 0x7f2028140e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.146+0000 7f202cd4b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2028071360 con 0x7f2028070ef0 2024-02-17T14:28:13.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.146+0000 7f202cd4b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2028071850 con 0x7f202806ae10 2024-02-17T14:28:13.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.146+0000 7f202cd4b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2028073240 con 0x7f2028140a90 2024-02-17T14:28:13.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.146+0000 7f202659c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f202806ae10 0x7f20280b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.146+0000 7f202659c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f202806ae10 0x7f20280b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45230/0 (socket says 172.21.15.134:45230) 2024-02-17T14:28:13.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.146+0000 7f202659c640 1 -- 172.21.15.134:0/3099950844 learned_addr learned my addr 172.21.15.134:0/3099950844 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:13.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.146+0000 7f2026d9d640 1 --2- 172.21.15.134:0/3099950844 >> v2:172.21.15.142:3300/0 conn(0x7f2028140a90 0x7f2028140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.146+0000 7f202659c640 1 -- 172.21.15.134:0/3099950844 >> v2:172.21.15.142:3300/0 conn(0x7f2028140a90 msgr2=0x7f2028140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:13.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.146+0000 7f202659c640 1 --2- 172.21.15.134:0/3099950844 >> v2:172.21.15.142:3300/0 conn(0x7f2028140a90 0x7f2028140e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.146+0000 7f202659c640 1 -- 172.21.15.134:0/3099950844 >> v1:172.21.15.142:6789/0 conn(0x7f2028070ef0 legacy=0x7f20280afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.146+0000 7f202659c640 1 -- 172.21.15.134:0/3099950844 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202806b1f0 con 0x7f202806ae10 2024-02-17T14:28:13.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.147+0000 7f202659c640 1 --2- 172.21.15.134:0/3099950844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f202806ae10 0x7f20280b4de0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f20280b5b90 tx=0x7f201802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dcbb5ad9ae136f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:13.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.147+0000 7f202559a640 1 -- 172.21.15.134:0/3099950844 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201802cb20 con 0x7f202806ae10 2024-02-17T14:28:13.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.147+0000 7f202559a640 1 -- 172.21.15.134:0/3099950844 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201802cc80 con 0x7f202806ae10 2024-02-17T14:28:13.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.147+0000 7f202559a640 1 -- 172.21.15.134:0/3099950844 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20180343f0 con 0x7f202806ae10 2024-02-17T14:28:13.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.148+0000 7f202cd4b640 1 -- 172.21.15.134:0/3099950844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f202806ae10 msgr2=0x7f20280b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.148+0000 7f202cd4b640 1 --2- 172.21.15.134:0/3099950844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f202806ae10 0x7f20280b4de0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f20280b5b90 tx=0x7f201802bf80 comp rx=0 tx=0).stop 2024-02-17T14:28:13.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.148+0000 7f202cd4b640 1 -- 172.21.15.134:0/3099950844 shutdown_connections 2024-02-17T14:28:13.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.148+0000 7f202cd4b640 1 --2- 172.21.15.134:0/3099950844 >> v2:172.21.15.142:3300/0 conn(0x7f2028140a90 0x7f2028140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.148+0000 7f202cd4b640 1 --2- 172.21.15.134:0/3099950844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f202806ae10 0x7f20280b4de0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.148+0000 7f202cd4b640 1 -- 172.21.15.134:0/3099950844 >> 172.21.15.134:0/3099950844 conn(0x7f20280b9350 msgr2=0x7f20280b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:13.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.148+0000 7f202cd4b640 1 -- 172.21.15.134:0/3099950844 shutdown_connections 2024-02-17T14:28:13.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.148+0000 7f202cd4b640 1 -- 172.21.15.134:0/3099950844 wait complete. 2024-02-17T14:28:13.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.149+0000 7f202cd4b640 1 Processor -- start 2024-02-17T14:28:13.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.149+0000 7f202cd4b640 1 -- start start 2024-02-17T14:28:13.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202cd4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f202806ae10 0x7f20280b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202cd4b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2028070ef0 0x7f20281df670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202cd4b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2028140a90 0x7f20280b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202cd4b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20281dfbb0 con 0x7f202806ae10 2024-02-17T14:28:13.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202cd4b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20280b1c50 con 0x7f2028070ef0 2024-02-17T14:28:13.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202cd4b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20280b0ae0 con 0x7f2028140a90 2024-02-17T14:28:13.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f202806ae10 0x7f20280b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f202806ae10 0x7f20280b0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45240/0 (socket says 172.21.15.134:45240) 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202659c640 1 -- 172.21.15.134:0/3727501728 learned_addr learned my addr 172.21.15.134:0/3727501728 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f2025d9b640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2028070ef0 0x7f20281df670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f2026d9d640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2028140a90 0x7f20280b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202659c640 1 -- 172.21.15.134:0/3727501728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2028140a90 msgr2=0x7f20280b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202659c640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2028140a90 0x7f20280b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202659c640 1 -- 172.21.15.134:0/3727501728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2028070ef0 msgr2=0x7f20281df670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202659c640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2028070ef0 0x7f20281df670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202659c640 1 -- 172.21.15.134:0/3727501728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2018009b30 con 0x7f202806ae10 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f2026d9d640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2028140a90 0x7f20280b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f2025d9b640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2028070ef0 0x7f20281df670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.150+0000 7f202659c640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f202806ae10 0x7f20280b0500 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2018000f80 tx=0x7f2018004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.151+0000 7f2016ffd640 1 -- 172.21.15.134:0/3727501728 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018009510 con 0x7f202806ae10 2024-02-17T14:28:13.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.151+0000 7f2016ffd640 1 -- 172.21.15.134:0/3727501728 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201803e450 con 0x7f202806ae10 2024-02-17T14:28:13.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.151+0000 7f202cd4b640 1 -- 172.21.15.134:0/3727501728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202814a530 con 0x7f202806ae10 2024-02-17T14:28:13.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.151+0000 7f2016ffd640 1 -- 172.21.15.134:0/3727501728 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201803e800 con 0x7f202806ae10 2024-02-17T14:28:13.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.151+0000 7f202cd4b640 1 -- 172.21.15.134:0/3727501728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20280b1970 con 0x7f202806ae10 2024-02-17T14:28:13.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.152+0000 7f202cd4b640 1 -- 172.21.15.134:0/3727501728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2028068280 con 0x7f202806ae10 2024-02-17T14:28:13.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.152+0000 7f2016ffd640 1 -- 172.21.15.134:0/3727501728 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f201803e960 con 0x7f202806ae10 2024-02-17T14:28:13.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.152+0000 7f2016ffd640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f200806b810 0x7f200806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.152+0000 7f2016ffd640 1 -- 172.21.15.134:0/3727501728 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f20180ad0b0 con 0x7f202806ae10 2024-02-17T14:28:13.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.152+0000 7f2025d9b640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f200806b810 0x7f200806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.153+0000 7f2025d9b640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f200806b810 0x7f200806dcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f20281d69e0 tx=0x7f201c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:13.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.157+0000 7f2016ffd640 1 -- 172.21.15.134:0/3727501728 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20180778d0 con 0x7f202806ae10 2024-02-17T14:28:13.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.326+0000 7f202cd4b640 1 -- 172.21.15.134:0/3727501728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f202813f830 con 0x7f202806ae10 2024-02-17T14:28:13.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.326+0000 7f2016ffd640 1 -- 172.21.15.134:0/3727501728 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20180430a0 con 0x7f202806ae10 2024-02-17T14:28:13.325 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-02-17T14:28:13.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.328+0000 7f202cd4b640 1 -- 172.21.15.134:0/3727501728 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f200806b810 msgr2=0x7f200806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.328+0000 7f202cd4b640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f200806b810 0x7f200806dcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f20281d69e0 tx=0x7f201c009040 comp rx=0 tx=0).stop 2024-02-17T14:28:13.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.328+0000 7f202cd4b640 1 -- 172.21.15.134:0/3727501728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f202806ae10 msgr2=0x7f20280b0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.328+0000 7f202cd4b640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f202806ae10 0x7f20280b0500 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2018000f80 tx=0x7f2018004a40 comp rx=0 tx=0).stop 2024-02-17T14:28:13.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.328+0000 7f202cd4b640 1 -- 172.21.15.134:0/3727501728 shutdown_connections 2024-02-17T14:28:13.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.328+0000 7f202cd4b640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2028140a90 0x7f20280b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.328+0000 7f202cd4b640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2028070ef0 0x7f20281df670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.328+0000 7f202cd4b640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f200806b810 0x7f200806dcd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.328+0000 7f202cd4b640 1 --2- 172.21.15.134:0/3727501728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f202806ae10 0x7f20280b0500 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.328+0000 7f202cd4b640 1 -- 172.21.15.134:0/3727501728 >> 172.21.15.134:0/3727501728 conn(0x7f20280b9350 msgr2=0x7f20280b6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:13.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.328+0000 7f202cd4b640 1 -- 172.21.15.134:0/3727501728 shutdown_connections 2024-02-17T14:28:13.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.328+0000 7f202cd4b640 1 -- 172.21.15.134:0/3727501728 wait complete. 2024-02-17T14:28:13.338 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T14:28:13.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.442+0000 7fec752dd640 1 Processor -- start 2024-02-17T14:28:13.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.442+0000 7fec752dd640 1 -- start start 2024-02-17T14:28:13.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.443+0000 7fec752dd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fec7014a710 0x7fec700b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.443+0000 7fec752dd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fec70144960 0x7fec701517d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.443+0000 7fec752dd640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7014aaf0 con 0x7fec7009b190 2024-02-17T14:28:13.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.443+0000 7fec752dd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7009c280 con 0x7fec70144960 2024-02-17T14:28:13.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.443+0000 7fec752dd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7009c4f0 con 0x7fec7014a710 2024-02-17T14:28:13.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.443+0000 7fec6f7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fec70144960 0x7fec701517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.443+0000 7fec6e7fc640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fec7009b190 0x7fec70144250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:57830/0 (socket says 172.21.15.134:57830) 2024-02-17T14:28:13.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.443+0000 7fec6e7fc640 1 -- 172.21.15.134:0/550055820 learned_addr learned my addr 172.21.15.134:0/550055820 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:13.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.443+0000 7fec6effd640 1 --2- 172.21.15.134:0/550055820 >> v2:172.21.15.142:3300/0 conn(0x7fec7014a710 0x7fec700b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.443+0000 7fec6f7fe640 1 -- 172.21.15.134:0/550055820 >> v2:172.21.15.142:3300/0 conn(0x7fec7014a710 msgr2=0x7fec700b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:13.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.443+0000 7fec6f7fe640 1 --2- 172.21.15.134:0/550055820 >> v2:172.21.15.142:3300/0 conn(0x7fec7014a710 0x7fec700b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.443+0000 7fec6f7fe640 1 -- 172.21.15.134:0/550055820 >> v1:172.21.15.134:6789/0 conn(0x7fec7009b190 legacy=0x7fec70144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.444+0000 7fec6f7fe640 1 -- 172.21.15.134:0/550055820 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7009a6b0 con 0x7fec70144960 2024-02-17T14:28:13.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.444+0000 7fec6dffb640 1 -- 172.21.15.134:0/550055820 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744193898 0 0) 0x7fec7014aaf0 con 0x7fec7009b190 2024-02-17T14:28:13.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.444+0000 7fec6effd640 1 --2- 172.21.15.134:0/550055820 >> v2:172.21.15.142:3300/0 conn(0x7fec7014a710 0x7fec700b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:13.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.444+0000 7fec6f7fe640 1 --2- 172.21.15.134:0/550055820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec70144960 0x7fec701517d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec7006cf30 tx=0x7fec6802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cac76636a707882 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:13.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.444+0000 7fec6dffb640 1 -- 172.21.15.134:0/550055820 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6802e070 con 0x7fec70144960 2024-02-17T14:28:13.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.444+0000 7fec6dffb640 1 -- 172.21.15.134:0/550055820 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec680315a0 con 0x7fec70144960 2024-02-17T14:28:13.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.444+0000 7fec6dffb640 1 -- 172.21.15.134:0/550055820 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68031930 con 0x7fec70144960 2024-02-17T14:28:13.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.445+0000 7fec752dd640 1 -- 172.21.15.134:0/550055820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec70144960 msgr2=0x7fec701517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.445+0000 7fec752dd640 1 --2- 172.21.15.134:0/550055820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec70144960 0x7fec701517d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec7006cf30 tx=0x7fec6802b840 comp rx=0 tx=0).stop 2024-02-17T14:28:13.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.445+0000 7fec752dd640 1 -- 172.21.15.134:0/550055820 shutdown_connections 2024-02-17T14:28:13.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.445+0000 7fec752dd640 1 --2- 172.21.15.134:0/550055820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec70144960 0x7fec701517d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.445+0000 7fec752dd640 1 --2- 172.21.15.134:0/550055820 >> v2:172.21.15.142:3300/0 conn(0x7fec7014a710 0x7fec700b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.445+0000 7fec752dd640 1 -- 172.21.15.134:0/550055820 >> 172.21.15.134:0/550055820 conn(0x7fec700b90c0 msgr2=0x7fec700b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:13.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.445+0000 7fec752dd640 1 -- 172.21.15.134:0/550055820 shutdown_connections 2024-02-17T14:28:13.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.445+0000 7fec752dd640 1 -- 172.21.15.134:0/550055820 wait complete. 2024-02-17T14:28:13.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.446+0000 7fec752dd640 1 Processor -- start 2024-02-17T14:28:13.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.446+0000 7fec752dd640 1 -- start start 2024-02-17T14:28:13.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec752dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec7009b190 0x7fec70145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec752dd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec70144960 0x7fec700aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec752dd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec7014a710 0x7fec700af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec752dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec701dfa00 con 0x7fec7009b190 2024-02-17T14:28:13.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec752dd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec70146240 con 0x7fec70144960 2024-02-17T14:28:13.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec752dd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec70145f40 con 0x7fec7014a710 2024-02-17T14:28:13.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec6effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec7009b190 0x7fec70145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec6effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec7009b190 0x7fec70145a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45264/0 (socket says 172.21.15.134:45264) 2024-02-17T14:28:13.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec6effd640 1 -- 172.21.15.134:0/587302460 learned_addr learned my addr 172.21.15.134:0/587302460 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:13.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec6e7fc640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec70144960 0x7fec700aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec6f7fe640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec7014a710 0x7fec700af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec6effd640 1 -- 172.21.15.134:0/587302460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec7014a710 msgr2=0x7fec700af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec6effd640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec7014a710 0x7fec700af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec6effd640 1 -- 172.21.15.134:0/587302460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec70144960 msgr2=0x7fec700aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec6effd640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec70144960 0x7fec700aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec6effd640 1 -- 172.21.15.134:0/587302460 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec68009400 con 0x7fec7009b190 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec6e7fc640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec70144960 0x7fec700aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec6effd640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec7009b190 0x7fec70145a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fec6000ce00 tx=0x7fec6000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec577fe640 1 -- 172.21.15.134:0/587302460 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6000f890 con 0x7fec7009b190 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec577fe640 1 -- 172.21.15.134:0/587302460 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6000f9f0 con 0x7fec7009b190 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec752dd640 1 -- 172.21.15.134:0/587302460 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec70144e80 con 0x7fec7009b190 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.447+0000 7fec577fe640 1 -- 172.21.15.134:0/587302460 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6000fdc0 con 0x7fec7009b190 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.448+0000 7fec752dd640 1 -- 172.21.15.134:0/587302460 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec70147b10 con 0x7fec7009b190 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.448+0000 7fec752dd640 1 -- 172.21.15.134:0/587302460 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec70067b70 con 0x7fec7009b190 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.449+0000 7fec577fe640 1 -- 172.21.15.134:0/587302460 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fec6000b040 con 0x7fec7009b190 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.449+0000 7fec577fe640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fec5c06b840 0x7fec5c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.449+0000 7fec577fe640 1 -- 172.21.15.134:0/587302460 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fec6008af40 con 0x7fec7009b190 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.449+0000 7fec6e7fc640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fec5c06b840 0x7fec5c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.450+0000 7fec6e7fc640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fec5c06b840 0x7fec5c06dd00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec701472d0 tx=0x7fec64007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:13.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.453+0000 7fec577fe640 1 -- 172.21.15.134:0/587302460 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fec60055620 con 0x7fec7009b190 2024-02-17T14:28:13.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.624+0000 7fec752dd640 1 -- 172.21.15.134:0/587302460 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec7009bd10 con 0x7fec7009b190 2024-02-17T14:28:13.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.625+0000 7fec577fe640 1 -- 172.21.15.134:0/587302460 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fec60058ce0 con 0x7fec7009b190 2024-02-17T14:28:13.624 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-17T14:28:13.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.627+0000 7fec752dd640 1 -- 172.21.15.134:0/587302460 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fec5c06b840 msgr2=0x7fec5c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.627+0000 7fec752dd640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fec5c06b840 0x7fec5c06dd00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec701472d0 tx=0x7fec64007c10 comp rx=0 tx=0).stop 2024-02-17T14:28:13.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.627+0000 7fec752dd640 1 -- 172.21.15.134:0/587302460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec7009b190 msgr2=0x7fec70145a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.627+0000 7fec752dd640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec7009b190 0x7fec70145a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fec6000ce00 tx=0x7fec6000a650 comp rx=0 tx=0).stop 2024-02-17T14:28:13.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.627+0000 7fec752dd640 1 -- 172.21.15.134:0/587302460 shutdown_connections 2024-02-17T14:28:13.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.627+0000 7fec752dd640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec7014a710 0x7fec700af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.627+0000 7fec752dd640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec70144960 0x7fec700aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.627+0000 7fec752dd640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fec5c06b840 0x7fec5c06dd00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.627+0000 7fec752dd640 1 --2- 172.21.15.134:0/587302460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec7009b190 0x7fec70145a00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.627+0000 7fec752dd640 1 -- 172.21.15.134:0/587302460 >> 172.21.15.134:0/587302460 conn(0x7fec700b90c0 msgr2=0x7fec7009cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:13.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.627+0000 7fec752dd640 1 -- 172.21.15.134:0/587302460 shutdown_connections 2024-02-17T14:28:13.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.627+0000 7fec752dd640 1 -- 172.21.15.134:0/587302460 wait complete. 2024-02-17T14:28:13.637 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T14:28:13.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.741+0000 7fd9faedf640 1 Processor -- start 2024-02-17T14:28:13.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.741+0000 7fd9faedf640 1 -- start start 2024-02-17T14:28:13.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.741+0000 7fd9faedf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd9f409b3f0 0x7fd9f40b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.741+0000 7fd9faedf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd9f4146f20 0x7fd9f4147380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.741+0000 7fd9faedf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f406b530 con 0x7fd9f414a490 2024-02-17T14:28:13.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.741+0000 7fd9faedf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f40b85e0 con 0x7fd9f4146f20 2024-02-17T14:28:13.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.741+0000 7fd9faedf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f41478c0 con 0x7fd9f409b3f0 2024-02-17T14:28:13.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.742+0000 7fd9f3fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd9f4146f20 0x7fd9f4147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.742+0000 7fd9f947c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd9f414a490 0x7fd9f414a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52774/0 (socket says 172.21.15.134:52774) 2024-02-17T14:28:13.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.742+0000 7fd9f947c640 1 -- 172.21.15.134:0/3921419652 learned_addr learned my addr 172.21.15.134:0/3921419652 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:13.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.742+0000 7fd9f8c7b640 1 --2- 172.21.15.134:0/3921419652 >> v2:172.21.15.142:3300/0 conn(0x7fd9f409b3f0 0x7fd9f40b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.742+0000 7fd9f3fff640 1 -- 172.21.15.134:0/3921419652 >> v2:172.21.15.142:3300/0 conn(0x7fd9f409b3f0 msgr2=0x7fd9f40b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:13.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.742+0000 7fd9f3fff640 1 --2- 172.21.15.134:0/3921419652 >> v2:172.21.15.142:3300/0 conn(0x7fd9f409b3f0 0x7fd9f40b6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.742+0000 7fd9f3fff640 1 -- 172.21.15.134:0/3921419652 >> v1:172.21.15.134:6789/0 conn(0x7fd9f414a490 legacy=0x7fd9f414a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.742+0000 7fd9f37fe640 1 -- 172.21.15.134:0/3921419652 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774376662 0 0) 0x7fd9f406b530 con 0x7fd9f414a490 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.742+0000 7fd9f3fff640 1 -- 172.21.15.134:0/3921419652 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f409b7d0 con 0x7fd9f4146f20 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.743+0000 7fd9f3fff640 1 --2- 172.21.15.134:0/3921419652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9f4146f20 0x7fd9f4147380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4148050 tx=0x7fd9e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcba79827a44d82 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.743+0000 7fd9f37fe640 1 -- 172.21.15.134:0/3921419652 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0031830 con 0x7fd9f4146f20 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.743+0000 7fd9f37fe640 1 -- 172.21.15.134:0/3921419652 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e0031990 con 0x7fd9f4146f20 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.743+0000 7fd9f37fe640 1 -- 172.21.15.134:0/3921419652 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0031d20 con 0x7fd9f4146f20 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.743+0000 7fd9faedf640 1 -- 172.21.15.134:0/3921419652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9f4146f20 msgr2=0x7fd9f4147380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.743+0000 7fd9faedf640 1 --2- 172.21.15.134:0/3921419652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9f4146f20 0x7fd9f4147380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4148050 tx=0x7fd9e002b8d0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.743+0000 7fd9faedf640 1 -- 172.21.15.134:0/3921419652 shutdown_connections 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.743+0000 7fd9faedf640 1 --2- 172.21.15.134:0/3921419652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9f4146f20 0x7fd9f4147380 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.743+0000 7fd9faedf640 1 --2- 172.21.15.134:0/3921419652 >> v2:172.21.15.142:3300/0 conn(0x7fd9f409b3f0 0x7fd9f40b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.743+0000 7fd9faedf640 1 -- 172.21.15.134:0/3921419652 >> 172.21.15.134:0/3921419652 conn(0x7fd9f40bc630 msgr2=0x7fd9f40bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.743+0000 7fd9faedf640 1 -- 172.21.15.134:0/3921419652 shutdown_connections 2024-02-17T14:28:13.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.743+0000 7fd9faedf640 1 -- 172.21.15.134:0/3921419652 wait complete. 2024-02-17T14:28:13.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.744+0000 7fd9faedf640 1 Processor -- start 2024-02-17T14:28:13.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.744+0000 7fd9faedf640 1 -- start start 2024-02-17T14:28:13.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9faedf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9f409b3f0 0x7fd9f4149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9faedf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f4146f20 0x7fd9f41e0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9faedf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f414a490 0x7fd9f41dd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9faedf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f41e12a0 con 0x7fd9f409b3f0 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9faedf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f41e0950 con 0x7fd9f4146f20 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9faedf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f41e0be0 con 0x7fd9f414a490 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9f8c7b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9f409b3f0 0x7fd9f4149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9f8c7b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9f409b3f0 0x7fd9f4149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51764/0 (socket says 172.21.15.134:51764) 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9f8c7b640 1 -- 172.21.15.134:0/739978004 learned_addr learned my addr 172.21.15.134:0/739978004 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9f8c7b640 1 -- 172.21.15.134:0/739978004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f414a490 msgr2=0x7fd9f41dd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9f947c640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f414a490 0x7fd9f41dd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9f8c7b640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f414a490 0x7fd9f41dd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9f3fff640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f4146f20 0x7fd9f41e0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9f8c7b640 1 -- 172.21.15.134:0/739978004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f4146f20 msgr2=0x7fd9f41e0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9f8c7b640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f4146f20 0x7fd9f41e0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.745+0000 7fd9f8c7b640 1 -- 172.21.15.134:0/739978004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e0009400 con 0x7fd9f409b3f0 2024-02-17T14:28:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.746+0000 7fd9f8c7b640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9f409b3f0 0x7fd9f4149c20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800c7f0 tx=0x7fd9e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.746+0000 7fd9f17fa640 1 -- 172.21.15.134:0/739978004 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8004220 con 0x7fd9f409b3f0 2024-02-17T14:28:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.746+0000 7fd9f17fa640 1 -- 172.21.15.134:0/739978004 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e80043a0 con 0x7fd9f409b3f0 2024-02-17T14:28:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.746+0000 7fd9f17fa640 1 -- 172.21.15.134:0/739978004 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8007860 con 0x7fd9f409b3f0 2024-02-17T14:28:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.746+0000 7fd9faedf640 1 -- 172.21.15.134:0/739978004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f41e0ec0 con 0x7fd9f409b3f0 2024-02-17T14:28:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.746+0000 7fd9faedf640 1 -- 172.21.15.134:0/739978004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f40b0330 con 0x7fd9f409b3f0 2024-02-17T14:28:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.747+0000 7fd9faedf640 1 -- 172.21.15.134:0/739978004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f4067b70 con 0x7fd9f409b3f0 2024-02-17T14:28:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.747+0000 7fd9f17fa640 1 -- 172.21.15.134:0/739978004 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd9e8007bd0 con 0x7fd9f409b3f0 2024-02-17T14:28:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.747+0000 7fd9f17fa640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd9d806b810 0x7fd9d806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.748+0000 7fd9f17fa640 1 -- 172.21.15.134:0/739978004 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd9e808a460 con 0x7fd9f409b3f0 2024-02-17T14:28:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.748+0000 7fd9f3fff640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd9d806b810 0x7fd9d806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:13.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.748+0000 7fd9f3fff640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd9d806b810 0x7fd9d806dcd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0036000 tx=0x7fd9e0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:13.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.752+0000 7fd9f17fa640 1 -- 172.21.15.134:0/739978004 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9e8054bd0 con 0x7fd9f409b3f0 2024-02-17T14:28:13.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.923+0000 7fd9faedf640 1 -- 172.21.15.134:0/739978004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd9f40ba960 con 0x7fd9f409b3f0 2024-02-17T14:28:13.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.923+0000 7fd9f17fa640 1 -- 172.21.15.134:0/739978004 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd9e8058290 con 0x7fd9f409b3f0 2024-02-17T14:28:13.923 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 64 2024-02-17T14:28:13.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.925+0000 7fd9faedf640 1 -- 172.21.15.134:0/739978004 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd9d806b810 msgr2=0x7fd9d806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.925+0000 7fd9faedf640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd9d806b810 0x7fd9d806dcd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0036000 tx=0x7fd9e0008030 comp rx=0 tx=0).stop 2024-02-17T14:28:13.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.925+0000 7fd9faedf640 1 -- 172.21.15.134:0/739978004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9f409b3f0 msgr2=0x7fd9f4149c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:13.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.925+0000 7fd9faedf640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9f409b3f0 0x7fd9f4149c20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800c7f0 tx=0x7fd9e800ccb0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.925+0000 7fd9faedf640 1 -- 172.21.15.134:0/739978004 shutdown_connections 2024-02-17T14:28:13.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.925+0000 7fd9faedf640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f414a490 0x7fd9f41dd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.925+0000 7fd9faedf640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f4146f20 0x7fd9f41e0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.925+0000 7fd9faedf640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd9d806b810 0x7fd9d806dcd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.925+0000 7fd9faedf640 1 --2- 172.21.15.134:0/739978004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9f409b3f0 0x7fd9f4149c20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:13.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.925+0000 7fd9faedf640 1 -- 172.21.15.134:0/739978004 >> 172.21.15.134:0/739978004 conn(0x7fd9f40bc630 msgr2=0x7fd9f40b6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:13.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.925+0000 7fd9faedf640 1 -- 172.21.15.134:0/739978004 shutdown_connections 2024-02-17T14:28:13.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:13.925+0000 7fd9faedf640 1 -- 172.21.15.134:0/739978004 wait complete. 2024-02-17T14:28:13.936 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T14:28:14.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.040+0000 7f0d313eb640 1 Processor -- start 2024-02-17T14:28:14.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.040+0000 7f0d313eb640 1 -- start start 2024-02-17T14:28:14.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.040+0000 7f0d313eb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0d2c14a710 0x7f0d2c0b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.040+0000 7f0d313eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d2c144960 0x7f0d2c1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.040+0000 7f0d313eb640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2c14aaf0 con 0x7f0d2c09b190 2024-02-17T14:28:14.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.040+0000 7f0d313eb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2c09c280 con 0x7f0d2c14a710 2024-02-17T14:28:14.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.040+0000 7f0d313eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c09c4f0 con 0x7f0d2c144960 2024-02-17T14:28:14.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d23fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0d2c09b190 0x7f0d2c144250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52788/0 (socket says 172.21.15.134:52788) 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d23fff640 1 -- 172.21.15.134:0/1949542013 learned_addr learned my addr 172.21.15.134:0/1949542013 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2b7fe640 1 --2- 172.21.15.134:0/1949542013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d2c144960 0x7f0d2c1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2affd640 1 --2- 172.21.15.134:0/1949542013 >> v2:172.21.15.142:3300/0 conn(0x7f0d2c14a710 0x7f0d2c0b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180813754 0 0) 0x7f0d2c14aaf0 con 0x7f0d2c09b190 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d18003520 con 0x7f0d2c09b190 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 34588104 0 0) 0x7f0d18003520 con 0x7f0d2c09b190 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d2c144960 msgr2=0x7f0d2c1517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 --2- 172.21.15.134:0/1949542013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d2c144960 0x7f0d2c1517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 >> v2:172.21.15.142:3300/0 conn(0x7f0d2c14a710 msgr2=0x7f0d2c0b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 --2- 172.21.15.134:0/1949542013 >> v2:172.21.15.142:3300/0 conn(0x7f0d2c14a710 0x7f0d2c0b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c09a6b0 con 0x7f0d2c09b190 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f0d14001670 con 0x7f0d2c09b190 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2affd640 1 --2- 172.21.15.134:0/1949542013 >> v2:172.21.15.142:3300/0 conn(0x7f0d2c14a710 0x7f0d2c0b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:14.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 >> v1:172.21.15.134:6789/0 conn(0x7f0d2c09b190 legacy=0x7f0d2c144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 --2- 172.21.15.134:0/1949542013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18003970 0x7f0d18003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 --2- 172.21.15.134:0/1949542013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d2c144960 0x7f0d180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 --2- 172.21.15.134:0/1949542013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d18004d00 0x7f0d18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c09c4f0 con 0x7f0d18003970 2024-02-17T14:28:14.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1800b980 con 0x7f0d18004d00 2024-02-17T14:28:14.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1800bac0 con 0x7f0d2c144960 2024-02-17T14:28:14.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2affd640 1 --2- 172.21.15.134:0/1949542013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18003970 0x7f0d18003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d23fff640 1 --2- 172.21.15.134:0/1949542013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d2c144960 0x7f0d180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2b7fe640 1 --2- 172.21.15.134:0/1949542013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d18004d00 0x7f0d18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2affd640 1 -- 172.21.15.134:0/1949542013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d2c144960 msgr2=0x7f0d180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2affd640 1 --2- 172.21.15.134:0/1949542013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d2c144960 0x7f0d180047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2affd640 1 -- 172.21.15.134:0/1949542013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d18004d00 msgr2=0x7f0d18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2affd640 1 --2- 172.21.15.134:0/1949542013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d18004d00 0x7f0d18005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.041+0000 7f0d2affd640 1 -- 172.21.15.134:0/1949542013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d18003520 con 0x7f0d18003970 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.042+0000 7f0d2b7fe640 1 --2- 172.21.15.134:0/1949542013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d18004d00 0x7f0d18005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.042+0000 7f0d2affd640 1 --2- 172.21.15.134:0/1949542013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18003970 0x7f0d18003d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009c90 tx=0x7f0d180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5537b5a227be7e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.042+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c02c980 con 0x7f0d18003970 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.042+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c02cae0 con 0x7f0d18003970 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.042+0000 7f0d2a7fc640 1 -- 172.21.15.134:0/1949542013 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c02ce90 con 0x7f0d18003970 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.043+0000 7f0d313eb640 1 -- 172.21.15.134:0/1949542013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18003970 msgr2=0x7f0d18003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.043+0000 7f0d313eb640 1 --2- 172.21.15.134:0/1949542013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18003970 0x7f0d18003d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009c90 tx=0x7f0d180057f0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.043+0000 7f0d2b7fe640 1 -- 172.21.15.134:0/1949542013 reap_dead start 2024-02-17T14:28:14.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.043+0000 7f0d313eb640 1 -- 172.21.15.134:0/1949542013 shutdown_connections 2024-02-17T14:28:14.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.043+0000 7f0d313eb640 1 -- 172.21.15.134:0/1949542013 >> 172.21.15.134:0/1949542013 conn(0x7f0d2c0b90c0 msgr2=0x7f0d2c0b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:14.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.043+0000 7f0d313eb640 1 -- 172.21.15.134:0/1949542013 shutdown_connections 2024-02-17T14:28:14.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.043+0000 7f0d313eb640 1 -- 172.21.15.134:0/1949542013 wait complete. 2024-02-17T14:28:14.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.044+0000 7f0d313eb640 1 Processor -- start 2024-02-17T14:28:14.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.044+0000 7f0d313eb640 1 -- start start 2024-02-17T14:28:14.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d313eb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18003970 0x7f0d2c0b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d313eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d2c147680 0x7f0d2c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d313eb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d2c0b6100 0x7f0d2c0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d313eb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b5220 con 0x7f0d18003970 2024-02-17T14:28:14.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d313eb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c1471f0 con 0x7f0d2c0b6100 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d313eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b10c0 con 0x7f0d2c147680 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d2affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18003970 0x7f0d2c0b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d2affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18003970 0x7f0d2c0b5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51786/0 (socket says 172.21.15.134:51786) 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d2affd640 1 -- 172.21.15.134:0/3433402646 learned_addr learned my addr 172.21.15.134:0/3433402646 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d23fff640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d2c147680 0x7f0d2c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d2b7fe640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d2c0b6100 0x7f0d2c0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d2affd640 1 -- 172.21.15.134:0/3433402646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d2c147680 msgr2=0x7f0d2c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d2affd640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d2c147680 0x7f0d2c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d2affd640 1 -- 172.21.15.134:0/3433402646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d2c0b6100 msgr2=0x7f0d2c0b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d2affd640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d2c0b6100 0x7f0d2c0b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d2affd640 1 -- 172.21.15.134:0/3433402646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c0b3e80 con 0x7f0d18003970 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d2b7fe640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d2c0b6100 0x7f0d2c0b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d2affd640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18003970 0x7f0d2c0b5860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c02c530 tx=0x7f0d1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d237fe640 1 -- 172.21.15.134:0/3433402646 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c034c80 con 0x7f0d18003970 2024-02-17T14:28:14.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d237fe640 1 -- 172.21.15.134:0/3433402646 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c034e20 con 0x7f0d18003970 2024-02-17T14:28:14.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d237fe640 1 -- 172.21.15.134:0/3433402646 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c040690 con 0x7f0d18003970 2024-02-17T14:28:14.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d313eb640 1 -- 172.21.15.134:0/3433402646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2c0b1330 con 0x7f0d18003970 2024-02-17T14:28:14.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.045+0000 7f0d313eb640 1 -- 172.21.15.134:0/3433402646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2c0b0170 con 0x7f0d18003970 2024-02-17T14:28:14.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.046+0000 7f0d313eb640 1 -- 172.21.15.134:0/3433402646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2c0b0300 con 0x7f0d18003970 2024-02-17T14:28:14.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.047+0000 7f0d237fe640 1 -- 172.21.15.134:0/3433402646 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0d1c0407f0 con 0x7f0d18003970 2024-02-17T14:28:14.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.047+0000 7f0d237fe640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0d0c06b840 0x7f0d0c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.047+0000 7f0d23fff640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0d0c06b840 0x7f0d0c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.047+0000 7f0d237fe640 1 -- 172.21.15.134:0/3433402646 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0d1c0ac4e0 con 0x7f0d18003970 2024-02-17T14:28:14.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.048+0000 7f0d23fff640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0d0c06b840 0x7f0d0c06dd00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0b5da0 tx=0x7f0d14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:14.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.051+0000 7f0d237fe640 1 -- 172.21.15.134:0/3433402646 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0d1c076c50 con 0x7f0d18003970 2024-02-17T14:28:14.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.222+0000 7f0d313eb640 1 -- 172.21.15.134:0/3433402646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0d2c0b7ed0 con 0x7f0d18003970 2024-02-17T14:28:14.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.222+0000 7f0d237fe640 1 -- 172.21.15.134:0/3433402646 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0d1c07a310 con 0x7f0d18003970 2024-02-17T14:28:14.222 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-17T14:28:14.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.224+0000 7f0d313eb640 1 -- 172.21.15.134:0/3433402646 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0d0c06b840 msgr2=0x7f0d0c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.224+0000 7f0d313eb640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0d0c06b840 0x7f0d0c06dd00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0b5da0 tx=0x7f0d14009040 comp rx=0 tx=0).stop 2024-02-17T14:28:14.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.224+0000 7f0d313eb640 1 -- 172.21.15.134:0/3433402646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18003970 msgr2=0x7f0d2c0b5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.224+0000 7f0d313eb640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18003970 0x7f0d2c0b5860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c02c530 tx=0x7f0d1c004730 comp rx=0 tx=0).stop 2024-02-17T14:28:14.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.224+0000 7f0d313eb640 1 -- 172.21.15.134:0/3433402646 shutdown_connections 2024-02-17T14:28:14.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.224+0000 7f0d313eb640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d2c0b6100 0x7f0d2c0b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.224+0000 7f0d313eb640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d2c147680 0x7f0d2c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.224+0000 7f0d313eb640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0d0c06b840 0x7f0d0c06dd00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.224+0000 7f0d313eb640 1 --2- 172.21.15.134:0/3433402646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d18003970 0x7f0d2c0b5860 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.224+0000 7f0d313eb640 1 -- 172.21.15.134:0/3433402646 >> 172.21.15.134:0/3433402646 conn(0x7f0d2c0b90c0 msgr2=0x7f0d2c141e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:14.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.224+0000 7f0d313eb640 1 -- 172.21.15.134:0/3433402646 shutdown_connections 2024-02-17T14:28:14.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.224+0000 7f0d313eb640 1 -- 172.21.15.134:0/3433402646 wait complete. 2024-02-17T14:28:14.234 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T14:28:14.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.337+0000 7f17b26eb640 1 Processor -- start 2024-02-17T14:28:14.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.337+0000 7f17b26eb640 1 -- start start 2024-02-17T14:28:14.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17b26eb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f17ac0ae380 0x7f17ac14a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17b26eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17ac0b2210 0x7f17ac0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17b26eb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac0b26a0 con 0x7f17ac0af040 2024-02-17T14:28:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17b26eb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ac0ade40 con 0x7f17ac0ae380 2024-02-17T14:28:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17b26eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac0af800 con 0x7f17ac0b2210 2024-02-17T14:28:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17abfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f17ac0ae380 0x7f17ac14a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17b0c88640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17ac0b2210 0x7f17ac0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17ab7fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f17ac0af040 0x7f17ac14ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:57164/0 (socket says 172.21.15.134:57164) 2024-02-17T14:28:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17ab7fe640 1 -- 172.21.15.134:0/1329456384 learned_addr learned my addr 172.21.15.134:0/1329456384 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17b0c88640 1 -- 172.21.15.134:0/1329456384 >> v2:172.21.15.142:3300/0 conn(0x7f17ac0ae380 msgr2=0x7f17ac14a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17aaffd640 1 -- 172.21.15.134:0/1329456384 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772054553 0 0) 0x7f17ac0b26a0 con 0x7f17ac0af040 2024-02-17T14:28:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17b0c88640 1 --2- 172.21.15.134:0/1329456384 >> v2:172.21.15.142:3300/0 conn(0x7f17ac0ae380 0x7f17ac14a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17b0c88640 1 -- 172.21.15.134:0/1329456384 >> v1:172.21.15.142:6789/0 conn(0x7f17ac0af040 legacy=0x7f17ac14ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.338+0000 7f17b0c88640 1 -- 172.21.15.134:0/1329456384 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac0ae760 con 0x7f17ac0b2210 2024-02-17T14:28:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.339+0000 7f17b0c88640 1 --2- 172.21.15.134:0/1329456384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17ac0b2210 0x7f17ac0b3db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009d90 tx=0x7f17a402bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d83ab9198db4fc28 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.339+0000 7f17aaffd640 1 -- 172.21.15.134:0/1329456384 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a402cb30 con 0x7f17ac0b2210 2024-02-17T14:28:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.339+0000 7f17aaffd640 1 -- 172.21.15.134:0/1329456384 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a402cc90 con 0x7f17ac0b2210 2024-02-17T14:28:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.339+0000 7f17aaffd640 1 -- 172.21.15.134:0/1329456384 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a4034440 con 0x7f17ac0b2210 2024-02-17T14:28:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.340+0000 7f17b26eb640 1 -- 172.21.15.134:0/1329456384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17ac0b2210 msgr2=0x7f17ac0b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.340+0000 7f17b26eb640 1 --2- 172.21.15.134:0/1329456384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17ac0b2210 0x7f17ac0b3db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009d90 tx=0x7f17a402bd80 comp rx=0 tx=0).stop 2024-02-17T14:28:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.340+0000 7f17b26eb640 1 -- 172.21.15.134:0/1329456384 shutdown_connections 2024-02-17T14:28:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.340+0000 7f17b26eb640 1 --2- 172.21.15.134:0/1329456384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17ac0b2210 0x7f17ac0b3db0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.340+0000 7f17b26eb640 1 --2- 172.21.15.134:0/1329456384 >> v2:172.21.15.142:3300/0 conn(0x7f17ac0ae380 0x7f17ac14a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.340+0000 7f17b26eb640 1 -- 172.21.15.134:0/1329456384 >> 172.21.15.134:0/1329456384 conn(0x7f17ac0b8270 msgr2=0x7f17ac0b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.340+0000 7f17b26eb640 1 -- 172.21.15.134:0/1329456384 shutdown_connections 2024-02-17T14:28:14.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.340+0000 7f17b26eb640 1 -- 172.21.15.134:0/1329456384 wait complete. 2024-02-17T14:28:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.341+0000 7f17b26eb640 1 Processor -- start 2024-02-17T14:28:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.341+0000 7f17b26eb640 1 -- start start 2024-02-17T14:28:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17b26eb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17ac0ae380 0x7f17ac148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17b26eb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17ac1490f0 0x7f17ac1406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17b26eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17ac140c00 0x7f17ac1df970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17b26eb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac0704f0 con 0x7f17ac1490f0 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17b26eb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac149530 con 0x7f17ac0ae380 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17b26eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac1483b0 con 0x7f17ac140c00 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17ab7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17ac1490f0 0x7f17ac1406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17ab7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17ac1490f0 0x7f17ac1406c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51794/0 (socket says 172.21.15.134:51794) 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17ab7fe640 1 -- 172.21.15.134:0/2932067447 learned_addr learned my addr 172.21.15.134:0/2932067447 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17abfff640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17ac0ae380 0x7f17ac148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17b0c88640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17ac140c00 0x7f17ac1df970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17ab7fe640 1 -- 172.21.15.134:0/2932067447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17ac140c00 msgr2=0x7f17ac1df970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17ab7fe640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17ac140c00 0x7f17ac1df970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17ab7fe640 1 -- 172.21.15.134:0/2932067447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17ac0ae380 msgr2=0x7f17ac148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17ab7fe640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17ac0ae380 0x7f17ac148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17ab7fe640 1 -- 172.21.15.134:0/2932067447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a4009a70 con 0x7f17ac1490f0 2024-02-17T14:28:14.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17ab7fe640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17ac1490f0 0x7f17ac1406c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f17a000c4b0 tx=0x7f17a000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:14.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17a8ff9640 1 -- 172.21.15.134:0/2932067447 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a00074e0 con 0x7f17ac1490f0 2024-02-17T14:28:14.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17a8ff9640 1 -- 172.21.15.134:0/2932067447 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a0007660 con 0x7f17ac1490f0 2024-02-17T14:28:14.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17b26eb640 1 -- 172.21.15.134:0/2932067447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ac148690 con 0x7f17ac1490f0 2024-02-17T14:28:14.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17a8ff9640 1 -- 172.21.15.134:0/2932067447 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0004a20 con 0x7f17ac1490f0 2024-02-17T14:28:14.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.342+0000 7f17b26eb640 1 -- 172.21.15.134:0/2932067447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ac070720 con 0x7f17ac1490f0 2024-02-17T14:28:14.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.343+0000 7f17b26eb640 1 -- 172.21.15.134:0/2932067447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ac070910 con 0x7f17ac1490f0 2024-02-17T14:28:14.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.344+0000 7f17a8ff9640 1 -- 172.21.15.134:0/2932067447 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f17a0004b80 con 0x7f17ac1490f0 2024-02-17T14:28:14.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.344+0000 7f17a8ff9640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f179806b810 0x7f179806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.344+0000 7f17a8ff9640 1 -- 172.21.15.134:0/2932067447 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f17a0089590 con 0x7f17ac1490f0 2024-02-17T14:28:14.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.344+0000 7f17abfff640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f179806b810 0x7f179806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.345+0000 7f17abfff640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f179806b810 0x7f179806dcd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f179c009b40 tx=0x7f179c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:14.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.349+0000 7f17a8ff9640 1 -- 172.21.15.134:0/2932067447 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f17a0053df0 con 0x7f17ac1490f0 2024-02-17T14:28:14.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.531+0000 7f17b26eb640 1 -- 172.21.15.134:0/2932067447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f17ac067b70 con 0x7f17ac1490f0 2024-02-17T14:28:14.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.531+0000 7f17a8ff9640 1 -- 172.21.15.134:0/2932067447 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f17a00574b0 con 0x7f17ac1490f0 2024-02-17T14:28:14.531 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-02-17T14:28:14.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.533+0000 7f17b26eb640 1 -- 172.21.15.134:0/2932067447 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f179806b810 msgr2=0x7f179806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.533+0000 7f17b26eb640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f179806b810 0x7f179806dcd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f179c009b40 tx=0x7f179c009190 comp rx=0 tx=0).stop 2024-02-17T14:28:14.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.533+0000 7f17b26eb640 1 -- 172.21.15.134:0/2932067447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17ac1490f0 msgr2=0x7f17ac1406c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.533+0000 7f17b26eb640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17ac1490f0 0x7f17ac1406c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f17a000c4b0 tx=0x7f17a000c970 comp rx=0 tx=0).stop 2024-02-17T14:28:14.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.533+0000 7f17b26eb640 1 -- 172.21.15.134:0/2932067447 shutdown_connections 2024-02-17T14:28:14.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.533+0000 7f17b26eb640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17ac140c00 0x7f17ac1df970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.533+0000 7f17b26eb640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f179806b810 0x7f179806dcd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.533+0000 7f17b26eb640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17ac1490f0 0x7f17ac1406c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.533+0000 7f17b26eb640 1 --2- 172.21.15.134:0/2932067447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17ac0ae380 0x7f17ac148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.533+0000 7f17b26eb640 1 -- 172.21.15.134:0/2932067447 >> 172.21.15.134:0/2932067447 conn(0x7f17ac0b8270 msgr2=0x7f17ac0b66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:14.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.533+0000 7f17b26eb640 1 -- 172.21.15.134:0/2932067447 shutdown_connections 2024-02-17T14:28:14.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.533+0000 7f17b26eb640 1 -- 172.21.15.134:0/2932067447 wait complete. 2024-02-17T14:28:14.543 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:28:14.543 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T14:28:14.559 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:14.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.702+0000 7feba580e640 1 Processor -- start 2024-02-17T14:28:14.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.702+0000 7feba580e640 1 -- start start 2024-02-17T14:28:14.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feba580e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feba009b3f0 0x7feba00b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feba580e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feba014f7b0 0x7feba0151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feba580e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba006b530 con 0x7feba0146f20 2024-02-17T14:28:14.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feba580e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba00b85e0 con 0x7feba009b3f0 2024-02-17T14:28:14.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feba580e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba009b7d0 con 0x7feba014f7b0 2024-02-17T14:28:14.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feb9effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feba009b3f0 0x7feba00b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feb9effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feba009b3f0 0x7feba00b6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51808/0 (socket says 172.21.15.134:51808) 2024-02-17T14:28:14.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feb9effd640 1 -- 172.21.15.134:0/1980111119 learned_addr learned my addr 172.21.15.134:0/1980111119 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:14.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feb9f7fe640 1 --2- 172.21.15.134:0/1980111119 >> v2:172.21.15.142:3300/0 conn(0x7feba014f7b0 0x7feba0151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feb9effd640 1 -- 172.21.15.134:0/1980111119 >> v2:172.21.15.142:3300/0 conn(0x7feba014f7b0 msgr2=0x7feba0151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:14.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feb9effd640 1 --2- 172.21.15.134:0/1980111119 >> v2:172.21.15.142:3300/0 conn(0x7feba014f7b0 0x7feba0151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feb9effd640 1 -- 172.21.15.134:0/1980111119 >> v1:172.21.15.142:6789/0 conn(0x7feba0146f20 legacy=0x7feba0147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feb9effd640 1 -- 172.21.15.134:0/1980111119 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba006af00 con 0x7feba009b3f0 2024-02-17T14:28:14.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.703+0000 7feb9f7fe640 1 --2- 172.21.15.134:0/1980111119 >> v2:172.21.15.142:3300/0 conn(0x7feba014f7b0 0x7feba0151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:14.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.704+0000 7feb9effd640 1 --2- 172.21.15.134:0/1980111119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feba009b3f0 0x7feba00b6fb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feba00a2560 tx=0x7feb9002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74764ffc357294 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:14.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.704+0000 7feb9e7fc640 1 -- 172.21.15.134:0/1980111119 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90030860 con 0x7feba009b3f0 2024-02-17T14:28:14.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.704+0000 7feb9e7fc640 1 -- 172.21.15.134:0/1980111119 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb900309c0 con 0x7feba009b3f0 2024-02-17T14:28:14.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.704+0000 7feb9e7fc640 1 -- 172.21.15.134:0/1980111119 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90030d50 con 0x7feba009b3f0 2024-02-17T14:28:14.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.704+0000 7feba580e640 1 -- 172.21.15.134:0/1980111119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feba009b3f0 msgr2=0x7feba00b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.704+0000 7feba580e640 1 --2- 172.21.15.134:0/1980111119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feba009b3f0 0x7feba00b6fb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feba00a2560 tx=0x7feb9002b9a0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.704+0000 7feba580e640 1 -- 172.21.15.134:0/1980111119 shutdown_connections 2024-02-17T14:28:14.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.704+0000 7feba580e640 1 --2- 172.21.15.134:0/1980111119 >> v2:172.21.15.142:3300/0 conn(0x7feba014f7b0 0x7feba0151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.704+0000 7feba580e640 1 --2- 172.21.15.134:0/1980111119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feba009b3f0 0x7feba00b6fb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.704+0000 7feba580e640 1 -- 172.21.15.134:0/1980111119 >> 172.21.15.134:0/1980111119 conn(0x7feba00bc630 msgr2=0x7feba00bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:14.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.704+0000 7feba580e640 1 -- 172.21.15.134:0/1980111119 shutdown_connections 2024-02-17T14:28:14.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.704+0000 7feba580e640 1 -- 172.21.15.134:0/1980111119 wait complete. 2024-02-17T14:28:14.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.705+0000 7feba580e640 1 Processor -- start 2024-02-17T14:28:14.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.705+0000 7feba580e640 1 -- start start 2024-02-17T14:28:14.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feba580e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feba009b3f0 0x7feba01dca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feba580e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba0146f20 0x7feba01416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feba580e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba014f7b0 0x7feba00a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feba580e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba01e07f0 con 0x7feba009b3f0 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feba580e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba01e04c0 con 0x7feba0146f20 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feba580e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba00b2490 con 0x7feba014f7b0 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feb9effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feba009b3f0 0x7feba01dca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feb9effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feba009b3f0 0x7feba01dca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51822/0 (socket says 172.21.15.134:51822) 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feb9effd640 1 -- 172.21.15.134:0/3313034985 learned_addr learned my addr 172.21.15.134:0/3313034985 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feb9effd640 1 -- 172.21.15.134:0/3313034985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba014f7b0 msgr2=0x7feba00a1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feb9effd640 1 --2- 172.21.15.134:0/3313034985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba014f7b0 0x7feba00a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feb9effd640 1 -- 172.21.15.134:0/3313034985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba0146f20 msgr2=0x7feba01416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feb9effd640 1 --2- 172.21.15.134:0/3313034985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba0146f20 0x7feba01416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feb9effd640 1 -- 172.21.15.134:0/3313034985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900094d0 con 0x7feba009b3f0 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.706+0000 7feb9effd640 1 --2- 172.21.15.134:0/3313034985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feba009b3f0 0x7feba01dca90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb9002b9e0 tx=0x7feb90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.707+0000 7feb9cff9640 1 -- 172.21.15.134:0/3313034985 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90039d60 con 0x7feba009b3f0 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.707+0000 7feb9cff9640 1 -- 172.21.15.134:0/3313034985 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90043400 con 0x7feba009b3f0 2024-02-17T14:28:14.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.707+0000 7feba580e640 1 -- 172.21.15.134:0/3313034985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba00b2770 con 0x7feba009b3f0 2024-02-17T14:28:14.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.707+0000 7feb9cff9640 1 -- 172.21.15.134:0/3313034985 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900437b0 con 0x7feba009b3f0 2024-02-17T14:28:14.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.707+0000 7feba580e640 1 -- 172.21.15.134:0/3313034985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba00b66e0 con 0x7feba009b3f0 2024-02-17T14:28:14.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.708+0000 7feba580e640 1 -- 172.21.15.134:0/3313034985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba0145a40 con 0x7feba009b3f0 2024-02-17T14:28:14.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.708+0000 7feb9cff9640 1 -- 172.21.15.134:0/3313034985 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7feb90043910 con 0x7feba009b3f0 2024-02-17T14:28:14.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.708+0000 7feb9cff9640 1 --2- 172.21.15.134:0/3313034985 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7feb8006b810 0x7feb8006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:14.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.709+0000 7feb97fff640 1 --2- 172.21.15.134:0/3313034985 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7feb8006b810 0x7feb8006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:14.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.709+0000 7feb9cff9640 1 -- 172.21.15.134:0/3313034985 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7feb9003e070 con 0x7feba009b3f0 2024-02-17T14:28:14.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.709+0000 7feb97fff640 1 --2- 172.21.15.134:0/3313034985 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7feb8006b810 0x7feb8006dcd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb88000f60 tx=0x7feb880079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:14.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.713+0000 7feb9cff9640 1 -- 172.21.15.134:0/3313034985 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feb90077d90 con 0x7feba009b3f0 2024-02-17T14:28:14.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.886+0000 7feba580e640 1 -- 172.21.15.134:0/3313034985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feba0067b70 con 0x7feba009b3f0 2024-02-17T14:28:14.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.887+0000 7feb9cff9640 1 -- 172.21.15.134:0/3313034985 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7feb9007b450 con 0x7feba009b3f0 2024-02-17T14:28:14.886 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:07.990271+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:14.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.889+0000 7feba580e640 1 -- 172.21.15.134:0/3313034985 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7feb8006b810 msgr2=0x7feb8006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.889+0000 7feba580e640 1 --2- 172.21.15.134:0/3313034985 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7feb8006b810 0x7feb8006dcd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb88000f60 tx=0x7feb880079d0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.889+0000 7feba580e640 1 -- 172.21.15.134:0/3313034985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feba009b3f0 msgr2=0x7feba01dca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:14.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.889+0000 7feba580e640 1 --2- 172.21.15.134:0/3313034985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feba009b3f0 0x7feba01dca90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb9002b9e0 tx=0x7feb90004730 comp rx=0 tx=0).stop 2024-02-17T14:28:14.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.889+0000 7feba580e640 1 -- 172.21.15.134:0/3313034985 shutdown_connections 2024-02-17T14:28:14.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.889+0000 7feba580e640 1 --2- 172.21.15.134:0/3313034985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba014f7b0 0x7feba00a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.889 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.889+0000 7feba580e640 1 --2- 172.21.15.134:0/3313034985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba0146f20 0x7feba01416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.889+0000 7feba580e640 1 --2- 172.21.15.134:0/3313034985 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7feb8006b810 0x7feb8006dcd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.889+0000 7feba580e640 1 --2- 172.21.15.134:0/3313034985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feba009b3f0 0x7feba01dca90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:14.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.889+0000 7feba580e640 1 -- 172.21.15.134:0/3313034985 >> 172.21.15.134:0/3313034985 conn(0x7feba00bc630 msgr2=0x7feba0147380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:14.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.889+0000 7feba580e640 1 -- 172.21.15.134:0/3313034985 shutdown_connections 2024-02-17T14:28:14.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:14.889+0000 7feba580e640 1 -- 172.21.15.134:0/3313034985 wait complete. 2024-02-17T14:28:14.900 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T14:27:58.602268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T14:28:01.178917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T14:28:02.371936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T14:28:05.647194+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T14:28:14.900 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T14:28:15.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.005+0000 7f012a7e2640 1 Processor -- start 2024-02-17T14:28:15.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.005+0000 7f012a7e2640 1 -- start start 2024-02-17T14:28:15.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.005+0000 7f012a7e2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f01240b56c0 0x7f01240b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.005+0000 7f012a7e2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f012409cc70 0x7f01240b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.005+0000 7f012a7e2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01240afc10 con 0x7f0124140bd0 2024-02-17T14:28:15.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.005+0000 7f012a7e2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01240b5aa0 con 0x7f012409cc70 2024-02-17T14:28:15.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.005+0000 7f012a7e2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01240b6010 con 0x7f01240b56c0 2024-02-17T14:28:15.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.005+0000 7f01237fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f012409cc70 0x7f01240b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.005+0000 7f01237fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f012409cc70 0x7f01240b09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51826/0 (socket says 172.21.15.134:51826) 2024-02-17T14:28:15.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.005+0000 7f01237fe640 1 -- 172.21.15.134:0/3579019155 learned_addr learned my addr 172.21.15.134:0/3579019155 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:15.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.006+0000 7f0123fff640 1 --2- 172.21.15.134:0/3579019155 >> v2:172.21.15.142:3300/0 conn(0x7f01240b56c0 0x7f01240b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.006+0000 7f01237fe640 1 -- 172.21.15.134:0/3579019155 >> v2:172.21.15.142:3300/0 conn(0x7f01240b56c0 msgr2=0x7f01240b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:15.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.006+0000 7f01237fe640 1 --2- 172.21.15.134:0/3579019155 >> v2:172.21.15.142:3300/0 conn(0x7f01240b56c0 0x7f01240b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.006+0000 7f01237fe640 1 -- 172.21.15.134:0/3579019155 >> v1:172.21.15.142:6789/0 conn(0x7f0124140bd0 legacy=0x7f0124141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:15.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.006+0000 7f01237fe640 1 -- 172.21.15.134:0/3579019155 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01240b62f0 con 0x7f012409cc70 2024-02-17T14:28:15.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.006+0000 7f01237fe640 1 --2- 172.21.15.134:0/3579019155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f012409cc70 0x7f01240b09e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0124074720 tx=0x7f011802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29905cbee3313a25 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:15.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.006+0000 7f0122ffd640 1 -- 172.21.15.134:0/3579019155 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0118031640 con 0x7f012409cc70 2024-02-17T14:28:15.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.006+0000 7f0122ffd640 1 -- 172.21.15.134:0/3579019155 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01180317a0 con 0x7f012409cc70 2024-02-17T14:28:15.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.006+0000 7f0122ffd640 1 -- 172.21.15.134:0/3579019155 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0118031b30 con 0x7f012409cc70 2024-02-17T14:28:15.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.007+0000 7f012a7e2640 1 -- 172.21.15.134:0/3579019155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f012409cc70 msgr2=0x7f01240b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.007+0000 7f012a7e2640 1 --2- 172.21.15.134:0/3579019155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f012409cc70 0x7f01240b09e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0124074720 tx=0x7f011802b8f0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.007+0000 7f012a7e2640 1 -- 172.21.15.134:0/3579019155 shutdown_connections 2024-02-17T14:28:15.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.007+0000 7f012a7e2640 1 --2- 172.21.15.134:0/3579019155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f012409cc70 0x7f01240b09e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.007+0000 7f012a7e2640 1 --2- 172.21.15.134:0/3579019155 >> v2:172.21.15.142:3300/0 conn(0x7f01240b56c0 0x7f01240b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.007+0000 7f012a7e2640 1 -- 172.21.15.134:0/3579019155 >> 172.21.15.134:0/3579019155 conn(0x7f01240b6e70 msgr2=0x7f01240b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:15.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.007+0000 7f012a7e2640 1 -- 172.21.15.134:0/3579019155 shutdown_connections 2024-02-17T14:28:15.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.007+0000 7f012a7e2640 1 -- 172.21.15.134:0/3579019155 wait complete. 2024-02-17T14:28:15.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.008+0000 7f012a7e2640 1 Processor -- start 2024-02-17T14:28:15.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.008+0000 7f012a7e2640 1 -- start start 2024-02-17T14:28:15.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f012a7e2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f012409cc70 0x7f012406cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f012a7e2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01240b56c0 0x7f01241465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f012a7e2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0124140bd0 0x7f0124137bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f012a7e2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0124145e70 con 0x7f01240b56c0 2024-02-17T14:28:15.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f012a7e2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0124146150 con 0x7f012409cc70 2024-02-17T14:28:15.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f012a7e2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0124099a30 con 0x7f0124140bd0 2024-02-17T14:28:15.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f01237fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01240b56c0 0x7f01241465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f01237fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01240b56c0 0x7f01241465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51840/0 (socket says 172.21.15.134:51840) 2024-02-17T14:28:15.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f01237fe640 1 -- 172.21.15.134:0/3197935157 learned_addr learned my addr 172.21.15.134:0/3197935157 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:15.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f0123fff640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f012409cc70 0x7f012406cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f0128d7f640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0124140bd0 0x7f0124137bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f01237fe640 1 -- 172.21.15.134:0/3197935157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0124140bd0 msgr2=0x7f0124137bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f01237fe640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0124140bd0 0x7f0124137bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f01237fe640 1 -- 172.21.15.134:0/3197935157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f012409cc70 msgr2=0x7f012406cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f01237fe640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f012409cc70 0x7f012406cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f01237fe640 1 -- 172.21.15.134:0/3197935157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01180094d0 con 0x7f01240b56c0 2024-02-17T14:28:15.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f01237fe640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01240b56c0 0x7f01241465e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0118000c00 tx=0x7f01180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:15.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f0120ff9640 1 -- 172.21.15.134:0/3197935157 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011803ac60 con 0x7f01240b56c0 2024-02-17T14:28:15.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f0120ff9640 1 -- 172.21.15.134:0/3197935157 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011803adc0 con 0x7f01240b56c0 2024-02-17T14:28:15.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f012a7e2640 1 -- 172.21.15.134:0/3197935157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0124099d10 con 0x7f01240b56c0 2024-02-17T14:28:15.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.009+0000 7f0120ff9640 1 -- 172.21.15.134:0/3197935157 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0118044610 con 0x7f01240b56c0 2024-02-17T14:28:15.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.010+0000 7f012a7e2640 1 -- 172.21.15.134:0/3197935157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012409a2d0 con 0x7f01240b56c0 2024-02-17T14:28:15.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.010+0000 7f012a7e2640 1 -- 172.21.15.134:0/3197935157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0124067110 con 0x7f01240b56c0 2024-02-17T14:28:15.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.011+0000 7f0120ff9640 1 -- 172.21.15.134:0/3197935157 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f011802f050 con 0x7f01240b56c0 2024-02-17T14:28:15.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.011+0000 7f0120ff9640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f011006b810 0x7f011006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.011+0000 7f0120ff9640 1 -- 172.21.15.134:0/3197935157 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f01180ac240 con 0x7f01240b56c0 2024-02-17T14:28:15.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.011+0000 7f0123fff640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f011006b810 0x7f011006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.012+0000 7f0123fff640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f011006b810 0x7f011006dcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0114006fd0 tx=0x7f0114008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:15.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.015+0000 7f0120ff9640 1 -- 172.21.15.134:0/3197935157 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0118076a60 con 0x7f01240b56c0 2024-02-17T14:28:15.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.185+0000 7f012a7e2640 1 -- 172.21.15.134:0/3197935157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f012409a4c0 con 0x7f01240b56c0 2024-02-17T14:28:15.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.186+0000 7f0120ff9640 1 -- 172.21.15.134:0/3197935157 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f011807a120 con 0x7f01240b56c0 2024-02-17T14:28:15.185 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-02-17T14:28:15.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.188+0000 7f012a7e2640 1 -- 172.21.15.134:0/3197935157 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f011006b810 msgr2=0x7f011006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.188+0000 7f012a7e2640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f011006b810 0x7f011006dcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0114006fd0 tx=0x7f0114008040 comp rx=0 tx=0).stop 2024-02-17T14:28:15.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.188+0000 7f012a7e2640 1 -- 172.21.15.134:0/3197935157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01240b56c0 msgr2=0x7f01241465e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.188+0000 7f012a7e2640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01240b56c0 0x7f01241465e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0118000c00 tx=0x7f01180046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.188+0000 7f012a7e2640 1 -- 172.21.15.134:0/3197935157 shutdown_connections 2024-02-17T14:28:15.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.188+0000 7f012a7e2640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0124140bd0 0x7f0124137bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.188+0000 7f012a7e2640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f011006b810 0x7f011006dcd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.188+0000 7f012a7e2640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01240b56c0 0x7f01241465e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.188+0000 7f012a7e2640 1 --2- 172.21.15.134:0/3197935157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f012409cc70 0x7f012406cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.188+0000 7f012a7e2640 1 -- 172.21.15.134:0/3197935157 >> 172.21.15.134:0/3197935157 conn(0x7f01240b6e70 msgr2=0x7f01240b7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:15.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.188+0000 7f012a7e2640 1 -- 172.21.15.134:0/3197935157 shutdown_connections 2024-02-17T14:28:15.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.188+0000 7f012a7e2640 1 -- 172.21.15.134:0/3197935157 wait complete. 2024-02-17T14:28:15.198 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T14:28:15.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.303+0000 7fde9f8ae640 1 Processor -- start 2024-02-17T14:28:15.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.304+0000 7fde9f8ae640 1 -- start start 2024-02-17T14:28:15.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.304+0000 7fde9f8ae640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fde9806ae10 0x7fde980b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.304+0000 7fde9f8ae640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fde98070ef0 0x7fde980afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.304+0000 7fde9f8ae640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde98071360 con 0x7fde98140a90 2024-02-17T14:28:15.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.304+0000 7fde9f8ae640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde98071850 con 0x7fde9806ae10 2024-02-17T14:28:15.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.304+0000 7fde9f8ae640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde98073240 con 0x7fde98070ef0 2024-02-17T14:28:15.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.304+0000 7fde9d64a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fde9806ae10 0x7fde980b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.304+0000 7fde9de4b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fde98140a90 0x7fde98140e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52802/0 (socket says 172.21.15.134:52802) 2024-02-17T14:28:15.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.304+0000 7fde9de4b640 1 -- 172.21.15.134:0/1810312105 learned_addr learned my addr 172.21.15.134:0/1810312105 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:15.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.305+0000 7fde9ce49640 1 --2- 172.21.15.134:0/1810312105 >> v2:172.21.15.142:3300/0 conn(0x7fde98070ef0 0x7fde980afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.305+0000 7fde9d64a640 1 -- 172.21.15.134:0/1810312105 >> v2:172.21.15.142:3300/0 conn(0x7fde98070ef0 msgr2=0x7fde980afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:15.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.305+0000 7fde9d64a640 1 --2- 172.21.15.134:0/1810312105 >> v2:172.21.15.142:3300/0 conn(0x7fde98070ef0 0x7fde980afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.305+0000 7fde9d64a640 1 -- 172.21.15.134:0/1810312105 >> v1:172.21.15.134:6789/0 conn(0x7fde98140a90 legacy=0x7fde98140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.305+0000 7fde9d64a640 1 -- 172.21.15.134:0/1810312105 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98141580 con 0x7fde9806ae10 2024-02-17T14:28:15.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.305+0000 7fde97fff640 1 -- 172.21.15.134:0/1810312105 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093217416 0 0) 0x7fde98071360 con 0x7fde98140a90 2024-02-17T14:28:15.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.305+0000 7fde9d64a640 1 --2- 172.21.15.134:0/1810312105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9806ae10 0x7fde980b4de0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fde98070320 tx=0x7fde9002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dce7405430cba51 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:15.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.305+0000 7fde97fff640 1 -- 172.21.15.134:0/1810312105 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90031830 con 0x7fde9806ae10 2024-02-17T14:28:15.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.306+0000 7fde97fff640 1 -- 172.21.15.134:0/1810312105 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde90031990 con 0x7fde9806ae10 2024-02-17T14:28:15.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.306+0000 7fde97fff640 1 -- 172.21.15.134:0/1810312105 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90031d20 con 0x7fde9806ae10 2024-02-17T14:28:15.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.306+0000 7fde9f8ae640 1 -- 172.21.15.134:0/1810312105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9806ae10 msgr2=0x7fde980b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.306+0000 7fde9f8ae640 1 --2- 172.21.15.134:0/1810312105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9806ae10 0x7fde980b4de0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fde98070320 tx=0x7fde9002b8d0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.306+0000 7fde9f8ae640 1 -- 172.21.15.134:0/1810312105 shutdown_connections 2024-02-17T14:28:15.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.306+0000 7fde9f8ae640 1 --2- 172.21.15.134:0/1810312105 >> v2:172.21.15.142:3300/0 conn(0x7fde98070ef0 0x7fde980afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.306+0000 7fde9f8ae640 1 --2- 172.21.15.134:0/1810312105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9806ae10 0x7fde980b4de0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.306+0000 7fde9f8ae640 1 -- 172.21.15.134:0/1810312105 >> 172.21.15.134:0/1810312105 conn(0x7fde980b9350 msgr2=0x7fde980b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.306+0000 7fde9f8ae640 1 -- 172.21.15.134:0/1810312105 shutdown_connections 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.306+0000 7fde9f8ae640 1 -- 172.21.15.134:0/1810312105 wait complete. 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.307+0000 7fde9f8ae640 1 Processor -- start 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.307+0000 7fde9f8ae640 1 -- start start 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9f8ae640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde9806ae10 0x7fde981dc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9f8ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde98070ef0 0x7fde9814a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9f8ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde98140a90 0x7fde980b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9f8ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde981455b0 con 0x7fde98140a90 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9f8ae640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde98145890 con 0x7fde98070ef0 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9f8ae640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde98145b70 con 0x7fde9806ae10 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9de4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde98140a90 0x7fde980b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9de4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde98140a90 0x7fde980b1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51850/0 (socket says 172.21.15.134:51850) 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9de4b640 1 -- 172.21.15.134:0/2373566122 learned_addr learned my addr 172.21.15.134:0/2373566122 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9ce49640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde98070ef0 0x7fde9814a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9d64a640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde9806ae10 0x7fde981dc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9de4b640 1 -- 172.21.15.134:0/2373566122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde9806ae10 msgr2=0x7fde981dc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9de4b640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde9806ae10 0x7fde981dc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9de4b640 1 -- 172.21.15.134:0/2373566122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde98070ef0 msgr2=0x7fde9814a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9de4b640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde98070ef0 0x7fde9814a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9de4b640 1 -- 172.21.15.134:0/2373566122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde90009400 con 0x7fde98140a90 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9de4b640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde98140a90 0x7fde980b1dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fde8800c800 tx=0x7fde8800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde95ffb640 1 -- 172.21.15.134:0/2373566122 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88004d60 con 0x7fde98140a90 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde95ffb640 1 -- 172.21.15.134:0/2373566122 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8800a640 con 0x7fde98140a90 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde9f8ae640 1 -- 172.21.15.134:0/2373566122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde98147070 con 0x7fde98140a90 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.308+0000 7fde95ffb640 1 -- 172.21.15.134:0/2373566122 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8800aa30 con 0x7fde98140a90 2024-02-17T14:28:15.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.309+0000 7fde9f8ae640 1 -- 172.21.15.134:0/2373566122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde98146090 con 0x7fde98140a90 2024-02-17T14:28:15.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.310+0000 7fde9f8ae640 1 -- 172.21.15.134:0/2373566122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde98145d90 con 0x7fde98140a90 2024-02-17T14:28:15.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.310+0000 7fde95ffb640 1 -- 172.21.15.134:0/2373566122 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fde8800ab90 con 0x7fde98140a90 2024-02-17T14:28:15.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.310+0000 7fde95ffb640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fde8406b840 0x7fde8406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.310+0000 7fde95ffb640 1 -- 172.21.15.134:0/2373566122 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fde88089ae0 con 0x7fde98140a90 2024-02-17T14:28:15.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.310+0000 7fde9d64a640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fde8406b840 0x7fde8406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.311+0000 7fde9d64a640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fde8406b840 0x7fde8406dd00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fde90036000 tx=0x7fde9003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:15.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.315+0000 7fde95ffb640 1 -- 172.21.15.134:0/2373566122 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fde880543c0 con 0x7fde98140a90 2024-02-17T14:28:15.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.485+0000 7fde9f8ae640 1 -- 172.21.15.134:0/2373566122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde981456f0 con 0x7fde98140a90 2024-02-17T14:28:15.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.486+0000 7fde95ffb640 1 -- 172.21.15.134:0/2373566122 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde981456f0 con 0x7fde98140a90 2024-02-17T14:28:15.485 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-17T14:28:15.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.488+0000 7fde9f8ae640 1 -- 172.21.15.134:0/2373566122 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fde8406b840 msgr2=0x7fde8406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.488+0000 7fde9f8ae640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fde8406b840 0x7fde8406dd00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fde90036000 tx=0x7fde9003d040 comp rx=0 tx=0).stop 2024-02-17T14:28:15.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.488+0000 7fde9f8ae640 1 -- 172.21.15.134:0/2373566122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde98140a90 msgr2=0x7fde980b1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.488+0000 7fde9f8ae640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde98140a90 0x7fde980b1dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fde8800c800 tx=0x7fde8800ccc0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.488+0000 7fde9f8ae640 1 -- 172.21.15.134:0/2373566122 shutdown_connections 2024-02-17T14:28:15.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.488+0000 7fde9f8ae640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fde8406b840 0x7fde8406dd00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.488+0000 7fde9f8ae640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde98140a90 0x7fde980b1dd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.488+0000 7fde9f8ae640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde98070ef0 0x7fde9814a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.488+0000 7fde9f8ae640 1 --2- 172.21.15.134:0/2373566122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde9806ae10 0x7fde981dc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.488+0000 7fde9f8ae640 1 -- 172.21.15.134:0/2373566122 >> 172.21.15.134:0/2373566122 conn(0x7fde980b9350 msgr2=0x7fde980b9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:15.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.488+0000 7fde9f8ae640 1 -- 172.21.15.134:0/2373566122 shutdown_connections 2024-02-17T14:28:15.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.488+0000 7fde9f8ae640 1 -- 172.21.15.134:0/2373566122 wait complete. 2024-02-17T14:28:15.498 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T14:28:15.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.602+0000 7f6fb6ae1640 1 Processor -- start 2024-02-17T14:28:15.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.602+0000 7f6fb6ae1640 1 -- start start 2024-02-17T14:28:15.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.603+0000 7f6fb6ae1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6fb0146ea0 0x7f6fb01472e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.603+0000 7f6fb6ae1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6fb0071a70 0x7f6fb0071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.603+0000 7f6fb6ae1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb0147820 con 0x7f6fb00b5020 2024-02-17T14:28:15.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.603+0000 7f6fb6ae1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb00715e0 con 0x7f6fb0071a70 2024-02-17T14:28:15.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.603+0000 7f6fb6ae1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb006ddb0 con 0x7f6fb0146ea0 2024-02-17T14:28:15.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.603+0000 7f6fb507e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6fb0071a70 0x7f6fb0071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.603+0000 7f6fb507e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6fb0071a70 0x7f6fb0071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51858/0 (socket says 172.21.15.134:51858) 2024-02-17T14:28:15.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.603+0000 7f6fb507e640 1 -- 172.21.15.134:0/731955871 learned_addr learned my addr 172.21.15.134:0/731955871 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:15.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.603+0000 7f6faffff640 1 --2- 172.21.15.134:0/731955871 >> v2:172.21.15.142:3300/0 conn(0x7f6fb0146ea0 0x7f6fb01472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.603+0000 7f6fb507e640 1 -- 172.21.15.134:0/731955871 >> v2:172.21.15.142:3300/0 conn(0x7f6fb0146ea0 msgr2=0x7f6fb01472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:15.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.603+0000 7f6fb507e640 1 --2- 172.21.15.134:0/731955871 >> v2:172.21.15.142:3300/0 conn(0x7f6fb0146ea0 0x7f6fb01472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.603+0000 7f6fb507e640 1 -- 172.21.15.134:0/731955871 >> v1:172.21.15.142:6789/0 conn(0x7f6fb00b5020 legacy=0x7f6fb006d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:15.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.603+0000 7f6fb507e640 1 -- 172.21.15.134:0/731955871 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb0072440 con 0x7f6fb0071a70 2024-02-17T14:28:15.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.604+0000 7f6fb507e640 1 --2- 172.21.15.134:0/731955871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb0071a70 0x7f6fb0071f00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00b5b60 tx=0x7f6fa802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e012ad5a541f23b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:15.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.604+0000 7f6faf7fe640 1 -- 172.21.15.134:0/731955871 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa802cb20 con 0x7f6fb0071a70 2024-02-17T14:28:15.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.604+0000 7f6faf7fe640 1 -- 172.21.15.134:0/731955871 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa802cc80 con 0x7f6fb0071a70 2024-02-17T14:28:15.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.604+0000 7f6faf7fe640 1 -- 172.21.15.134:0/731955871 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80343f0 con 0x7f6fb0071a70 2024-02-17T14:28:15.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.604+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/731955871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb0071a70 msgr2=0x7f6fb0071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.604+0000 7f6fb6ae1640 1 --2- 172.21.15.134:0/731955871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb0071a70 0x7f6fb0071f00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00b5b60 tx=0x7f6fa802bf80 comp rx=0 tx=0).stop 2024-02-17T14:28:15.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.604+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/731955871 shutdown_connections 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.605+0000 7f6fb6ae1640 1 --2- 172.21.15.134:0/731955871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb0071a70 0x7f6fb0071f00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.605+0000 7f6fb6ae1640 1 --2- 172.21.15.134:0/731955871 >> v2:172.21.15.142:3300/0 conn(0x7f6fb0146ea0 0x7f6fb01472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.605+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/731955871 >> 172.21.15.134:0/731955871 conn(0x7f6fb00ba430 msgr2=0x7f6fb00ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.605+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/731955871 shutdown_connections 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.605+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/731955871 wait complete. 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.605+0000 7f6fb6ae1640 1 Processor -- start 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.606+0000 7f6fb6ae1640 1 -- start start 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.606+0000 7f6fb6ae1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fb0071a70 0x7f6fb0144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.606+0000 7f6fb6ae1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fb00b5020 0x7f6fb0141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.606+0000 7f6fb6ae1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb0146ea0 0x7f6fb01422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.606+0000 7f6fb6ae1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb01418d0 con 0x7f6fb0146ea0 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.606+0000 7f6fb6ae1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00b3e50 con 0x7f6fb00b5020 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.606+0000 7f6fb6ae1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb0143610 con 0x7f6fb0071a70 2024-02-17T14:28:15.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.606+0000 7f6fb507e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb0146ea0 0x7f6fb01422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.606+0000 7f6fb507e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb0146ea0 0x7f6fb01422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51872/0 (socket says 172.21.15.134:51872) 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.606+0000 7f6fb507e640 1 -- 172.21.15.134:0/2602451388 learned_addr learned my addr 172.21.15.134:0/2602451388 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6faffff640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fb00b5020 0x7f6fb0141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6fb487d640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fb0071a70 0x7f6fb0144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6fb507e640 1 -- 172.21.15.134:0/2602451388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fb0071a70 msgr2=0x7f6fb0144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6fb507e640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fb0071a70 0x7f6fb0144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6fb507e640 1 -- 172.21.15.134:0/2602451388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fb00b5020 msgr2=0x7f6fb0141d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6fb507e640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fb00b5020 0x7f6fb0141d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6fb507e640 1 -- 172.21.15.134:0/2602451388 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa8009b30 con 0x7f6fb0146ea0 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6fb487d640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fb0071a70 0x7f6fb0144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6fb507e640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb0146ea0 0x7f6fb01422a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8036040 tx=0x7f6fa8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6fad7fa640 1 -- 172.21.15.134:0/2602451388 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8007e70 con 0x7f6fb0146ea0 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6fad7fa640 1 -- 172.21.15.134:0/2602451388 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8009510 con 0x7f6fb0146ea0 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/2602451388 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb01438f0 con 0x7f6fb0146ea0 2024-02-17T14:28:15.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6fad7fa640 1 -- 172.21.15.134:0/2602451388 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa803e690 con 0x7f6fb0146ea0 2024-02-17T14:28:15.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.607+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/2602451388 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb00b4390 con 0x7f6fb0146ea0 2024-02-17T14:28:15.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.608+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/2602451388 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb0141a80 con 0x7f6fb0146ea0 2024-02-17T14:28:15.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.608+0000 7f6fad7fa640 1 -- 172.21.15.134:0/2602451388 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6fa803e7f0 con 0x7f6fb0146ea0 2024-02-17T14:28:15.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.609+0000 7f6fad7fa640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6f9406b810 0x7f6f9406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.609+0000 7f6fad7fa640 1 -- 172.21.15.134:0/2602451388 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6fa80ad070 con 0x7f6fb0146ea0 2024-02-17T14:28:15.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.609+0000 7f6fb487d640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6f9406b810 0x7f6f9406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.609+0000 7f6fb487d640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6f9406b810 0x7f6f9406dcd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4003eb0 tx=0x7f6fa4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:15.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.613+0000 7f6fad7fa640 1 -- 172.21.15.134:0/2602451388 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6fa80777e0 con 0x7f6fb0146ea0 2024-02-17T14:28:15.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.786+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/2602451388 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6fb00b5400 con 0x7f6fb0146ea0 2024-02-17T14:28:15.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.786+0000 7f6fad7fa640 1 -- 172.21.15.134:0/2602451388 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6fa807aea0 con 0x7f6fb0146ea0 2024-02-17T14:28:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 64 2024-02-17T14:28:15.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.788+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/2602451388 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6f9406b810 msgr2=0x7f6f9406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.788+0000 7f6fb6ae1640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6f9406b810 0x7f6f9406dcd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4003eb0 tx=0x7f6fa4009040 comp rx=0 tx=0).stop 2024-02-17T14:28:15.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.788+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/2602451388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb0146ea0 msgr2=0x7f6fb01422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.788+0000 7f6fb6ae1640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb0146ea0 0x7f6fb01422a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8036040 tx=0x7f6fa8004a40 comp rx=0 tx=0).stop 2024-02-17T14:28:15.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.788+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/2602451388 shutdown_connections 2024-02-17T14:28:15.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.788+0000 7f6fb6ae1640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6f9406b810 0x7f6f9406dcd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.788+0000 7f6fb6ae1640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fb0146ea0 0x7f6fb01422a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.788+0000 7f6fb6ae1640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fb00b5020 0x7f6fb0141d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.788+0000 7f6fb6ae1640 1 --2- 172.21.15.134:0/2602451388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fb0071a70 0x7f6fb0144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.788+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/2602451388 >> 172.21.15.134:0/2602451388 conn(0x7f6fb00ba430 msgr2=0x7f6fb00ba810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:15.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.788+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/2602451388 shutdown_connections 2024-02-17T14:28:15.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.788+0000 7f6fb6ae1640 1 -- 172.21.15.134:0/2602451388 wait complete. 2024-02-17T14:28:15.798 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T14:28:15.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.903+0000 7f37588d4640 1 Processor -- start 2024-02-17T14:28:15.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.903+0000 7f37588d4640 1 -- start start 2024-02-17T14:28:15.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.904+0000 7f37588d4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f375414a780 0x7f375409aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.904+0000 7f37588d4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f375414f830 0x7f3754151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.904+0000 7f37588d4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375409aa20 con 0x7f375409b3f0 2024-02-17T14:28:15.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.904+0000 7f37588d4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375409c7d0 con 0x7f375414f830 2024-02-17T14:28:15.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.904+0000 7f37588d4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375414b420 con 0x7f375414a780 2024-02-17T14:28:15.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.904+0000 7f3752d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f375414f830 0x7f3754151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.904+0000 7f3752d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f375414f830 0x7f3754151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51876/0 (socket says 172.21.15.134:51876) 2024-02-17T14:28:15.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.904+0000 7f3752d9d640 1 -- 172.21.15.134:0/3837701506 learned_addr learned my addr 172.21.15.134:0/3837701506 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:15.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.905+0000 7f3752d9d640 1 -- 172.21.15.134:0/3837701506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f375414a780 msgr2=0x7f375409aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:15.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.905+0000 7f375259c640 1 --2- 172.21.15.134:0/3837701506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f375414a780 0x7f375409aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.905+0000 7f3752d9d640 1 --2- 172.21.15.134:0/3837701506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f375414a780 0x7f375409aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.905+0000 7f3752d9d640 1 -- 172.21.15.134:0/3837701506 >> v1:172.21.15.142:6789/0 conn(0x7f375409b3f0 legacy=0x7f37541443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:15.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.905+0000 7f3752d9d640 1 -- 172.21.15.134:0/3837701506 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375414ab60 con 0x7f375414f830 2024-02-17T14:28:15.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.905+0000 7f3752d9d640 1 --2- 172.21.15.134:0/3837701506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f375414f830 0x7f3754151c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3744009870 tx=0x7f374402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dca7c305a1a078 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:15.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.905+0000 7f375159a640 1 -- 172.21.15.134:0/3837701506 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440317c0 con 0x7f375414f830 2024-02-17T14:28:15.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.905+0000 7f375159a640 1 -- 172.21.15.134:0/3837701506 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3744031920 con 0x7f375414f830 2024-02-17T14:28:15.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.905+0000 7f375159a640 1 -- 172.21.15.134:0/3837701506 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3744031cb0 con 0x7f375414f830 2024-02-17T14:28:15.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.906+0000 7f37588d4640 1 -- 172.21.15.134:0/3837701506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f375414f830 msgr2=0x7f3754151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.906+0000 7f37588d4640 1 --2- 172.21.15.134:0/3837701506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f375414f830 0x7f3754151c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3744009870 tx=0x7f374402b860 comp rx=0 tx=0).stop 2024-02-17T14:28:15.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.906+0000 7f37588d4640 1 -- 172.21.15.134:0/3837701506 shutdown_connections 2024-02-17T14:28:15.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.906+0000 7f37588d4640 1 --2- 172.21.15.134:0/3837701506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f375414f830 0x7f3754151c20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.906+0000 7f37588d4640 1 --2- 172.21.15.134:0/3837701506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f375414a780 0x7f375409aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.906+0000 7f37588d4640 1 -- 172.21.15.134:0/3837701506 >> 172.21.15.134:0/3837701506 conn(0x7f37540b90c0 msgr2=0x7f37540b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:15.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.906+0000 7f37588d4640 1 -- 172.21.15.134:0/3837701506 shutdown_connections 2024-02-17T14:28:15.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.906+0000 7f37588d4640 1 -- 172.21.15.134:0/3837701506 wait complete. 2024-02-17T14:28:15.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.907+0000 7f37588d4640 1 Processor -- start 2024-02-17T14:28:15.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.907+0000 7f37588d4640 1 -- start start 2024-02-17T14:28:15.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f37588d4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f375409b3f0 0x7f37541e03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f37588d4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f375414a780 0x7f375413ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f37588d4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f375414f830 0x7f37540b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f37588d4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37540b1dd0 con 0x7f375414a780 2024-02-17T14:28:15.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f37588d4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37541466b0 con 0x7f375414f830 2024-02-17T14:28:15.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f37588d4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3754145770 con 0x7f375409b3f0 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f3751d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f375414a780 0x7f375413ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f3751d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f375414a780 0x7f375413ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51890/0 (socket says 172.21.15.134:51890) 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f3751d9b640 1 -- 172.21.15.134:0/1374941414 learned_addr learned my addr 172.21.15.134:0/1374941414 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f375259c640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f375409b3f0 0x7f37541e03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f3752d9d640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f375414f830 0x7f37540b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f3751d9b640 1 -- 172.21.15.134:0/1374941414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f375409b3f0 msgr2=0x7f37541e03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f3751d9b640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f375409b3f0 0x7f37541e03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f3751d9b640 1 -- 172.21.15.134:0/1374941414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f375414f830 msgr2=0x7f37540b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f3751d9b640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f375414f830 0x7f37540b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f3751d9b640 1 -- 172.21.15.134:0/1374941414 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37440094d0 con 0x7f375414a780 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.908+0000 7f3751d9b640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f375414a780 0x7f375413ec70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f374800c400 tx=0x7f374800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.909+0000 7f3742ffd640 1 -- 172.21.15.134:0/1374941414 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480035f0 con 0x7f375414a780 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.909+0000 7f3742ffd640 1 -- 172.21.15.134:0/1374941414 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3748003750 con 0x7f375414a780 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.909+0000 7f37588d4640 1 -- 172.21.15.134:0/1374941414 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3754144c80 con 0x7f375414a780 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.909+0000 7f3742ffd640 1 -- 172.21.15.134:0/1374941414 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3748003b40 con 0x7f375414a780 2024-02-17T14:28:15.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.909+0000 7f37588d4640 1 -- 172.21.15.134:0/1374941414 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37540b1210 con 0x7f375414a780 2024-02-17T14:28:15.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.910+0000 7f37588d4640 1 -- 172.21.15.134:0/1374941414 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3754145990 con 0x7f375414a780 2024-02-17T14:28:15.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.910+0000 7f3742ffd640 1 -- 172.21.15.134:0/1374941414 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3748003ca0 con 0x7f375414a780 2024-02-17T14:28:15.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.910+0000 7f3742ffd640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f373406b840 0x7f373406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:15.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.910+0000 7f3742ffd640 1 -- 172.21.15.134:0/1374941414 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3748089980 con 0x7f375414a780 2024-02-17T14:28:15.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.910+0000 7f375259c640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f373406b840 0x7f373406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:15.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.911+0000 7f375259c640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f373406b840 0x7f373406dd00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f374c0070b0 tx=0x7f374c007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:15.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:15.915+0000 7f3742ffd640 1 -- 172.21.15.134:0/1374941414 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3754145990 con 0x7f375414a780 2024-02-17T14:28:16.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.082+0000 7f37588d4640 1 -- 172.21.15.134:0/1374941414 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3754145990 con 0x7f375414a780 2024-02-17T14:28:16.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.083+0000 7f3742ffd640 1 -- 172.21.15.134:0/1374941414 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3748017020 con 0x7f375414a780 2024-02-17T14:28:16.082 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-17T14:28:16.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.084+0000 7f37588d4640 1 -- 172.21.15.134:0/1374941414 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f373406b840 msgr2=0x7f373406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:16.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.084+0000 7f37588d4640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f373406b840 0x7f373406dd00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f374c0070b0 tx=0x7f374c007040 comp rx=0 tx=0).stop 2024-02-17T14:28:16.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.084+0000 7f37588d4640 1 -- 172.21.15.134:0/1374941414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f375414a780 msgr2=0x7f375413ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:16.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.084+0000 7f37588d4640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f375414a780 0x7f375413ec70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f374800c400 tx=0x7f374800c8c0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.085+0000 7f37588d4640 1 -- 172.21.15.134:0/1374941414 shutdown_connections 2024-02-17T14:28:16.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.085+0000 7f37588d4640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f375414f830 0x7f37540b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.085+0000 7f37588d4640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f373406b840 0x7f373406dd00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.085+0000 7f37588d4640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f375414a780 0x7f375413ec70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.085+0000 7f37588d4640 1 --2- 172.21.15.134:0/1374941414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f375409b3f0 0x7f37541e03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.085+0000 7f37588d4640 1 -- 172.21.15.134:0/1374941414 >> 172.21.15.134:0/1374941414 conn(0x7f37540b90c0 msgr2=0x7f37541441c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:16.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.085+0000 7f37588d4640 1 -- 172.21.15.134:0/1374941414 shutdown_connections 2024-02-17T14:28:16.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.085+0000 7f37588d4640 1 -- 172.21.15.134:0/1374941414 wait complete. 2024-02-17T14:28:16.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T14:28:16.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.197+0000 7fb7856c0640 1 Processor -- start 2024-02-17T14:28:16.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.197+0000 7fb7856c0640 1 -- start start 2024-02-17T14:28:16.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb7856c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb78014a710 0x7fb7800b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:16.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb7856c0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb78009b190 0x7fb780144250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:16.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb7856c0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb780144790 0x7fb780146f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:16.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb7856c0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78009c280 con 0x7fb78009b190 2024-02-17T14:28:16.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb7856c0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78009b5f0 con 0x7fb780144790 2024-02-17T14:28:16.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb7856c0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78014aaf0 con 0x7fb78014a710 2024-02-17T14:28:16.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb777fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb78009b190 0x7fb780144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb777fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb78009b190 0x7fb780144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51904/0 (socket says 172.21.15.134:51904) 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb777fff640 1 -- 172.21.15.134:0/4034501466 learned_addr learned my addr 172.21.15.134:0/4034501466 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb77effd640 1 --2- 172.21.15.134:0/4034501466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb78014a710 0x7fb7800b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb777fff640 1 -- 172.21.15.134:0/4034501466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb78014a710 msgr2=0x7fb7800b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb777fff640 1 --2- 172.21.15.134:0/4034501466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb78014a710 0x7fb7800b6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb77f7fe640 1 --2- 172.21.15.134:0/4034501466 >> v2:172.21.15.142:3300/0 conn(0x7fb780144790 0x7fb780146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb777fff640 1 -- 172.21.15.134:0/4034501466 >> v2:172.21.15.142:3300/0 conn(0x7fb780144790 msgr2=0x7fb780146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb777fff640 1 --2- 172.21.15.134:0/4034501466 >> v2:172.21.15.142:3300/0 conn(0x7fb780144790 0x7fb780146f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb777fff640 1 -- 172.21.15.134:0/4034501466 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb780144be0 con 0x7fb78009b190 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.198+0000 7fb77f7fe640 1 --2- 172.21.15.134:0/4034501466 >> v2:172.21.15.142:3300/0 conn(0x7fb780144790 0x7fb780146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.199+0000 7fb777fff640 1 --2- 172.21.15.134:0/4034501466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb78009b190 0x7fb780144250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb780099e40 tx=0x7fb76802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1191d64ab4d2f54 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.199+0000 7fb77e7fc640 1 -- 172.21.15.134:0/4034501466 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680317e0 con 0x7fb78009b190 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.199+0000 7fb77e7fc640 1 -- 172.21.15.134:0/4034501466 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb768031940 con 0x7fb78009b190 2024-02-17T14:28:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.199+0000 7fb77e7fc640 1 -- 172.21.15.134:0/4034501466 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768031cd0 con 0x7fb78009b190 2024-02-17T14:28:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.199+0000 7fb7856c0640 1 -- 172.21.15.134:0/4034501466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb78009b190 msgr2=0x7fb780144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.199+0000 7fb7856c0640 1 --2- 172.21.15.134:0/4034501466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb78009b190 0x7fb780144250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb780099e40 tx=0x7fb76802b880 comp rx=0 tx=0).stop 2024-02-17T14:28:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.199+0000 7fb7856c0640 1 -- 172.21.15.134:0/4034501466 shutdown_connections 2024-02-17T14:28:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.199+0000 7fb7856c0640 1 --2- 172.21.15.134:0/4034501466 >> v2:172.21.15.142:3300/0 conn(0x7fb780144790 0x7fb780146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.199+0000 7fb7856c0640 1 --2- 172.21.15.134:0/4034501466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb78009b190 0x7fb780144250 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.199+0000 7fb7856c0640 1 --2- 172.21.15.134:0/4034501466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb78014a710 0x7fb7800b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.199+0000 7fb7856c0640 1 -- 172.21.15.134:0/4034501466 >> 172.21.15.134:0/4034501466 conn(0x7fb7800b90c0 msgr2=0x7fb7800b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.200+0000 7fb7856c0640 1 -- 172.21.15.134:0/4034501466 shutdown_connections 2024-02-17T14:28:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.200+0000 7fb7856c0640 1 -- 172.21.15.134:0/4034501466 wait complete. 2024-02-17T14:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.200+0000 7fb7856c0640 1 Processor -- start 2024-02-17T14:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb7856c0640 1 -- start start 2024-02-17T14:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb7856c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb78009b190 0x7fb7801dff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb7856c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb780144790 0x7fb780147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb7856c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb78014a710 0x7fb7800b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb7856c0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800b2c40 con 0x7fb780144790 2024-02-17T14:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb7856c0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800b39f0 con 0x7fb78014a710 2024-02-17T14:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb7856c0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800b46d0 con 0x7fb78009b190 2024-02-17T14:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb777fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb780144790 0x7fb780147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb777fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb780144790 0x7fb780147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51920/0 (socket says 172.21.15.134:51920) 2024-02-17T14:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb777fff640 1 -- 172.21.15.134:0/98784319 learned_addr learned my addr 172.21.15.134:0/98784319 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb777fff640 1 -- 172.21.15.134:0/98784319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb78009b190 msgr2=0x7fb7801dff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb77effd640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb78009b190 0x7fb7801dff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb77f7fe640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb78014a710 0x7fb7800b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb777fff640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb78009b190 0x7fb7801dff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb777fff640 1 -- 172.21.15.134:0/98784319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb78014a710 msgr2=0x7fb7800b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb777fff640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb78014a710 0x7fb7800b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb777fff640 1 -- 172.21.15.134:0/98784319 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7680094d0 con 0x7fb780144790 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.201+0000 7fb77f7fe640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb78014a710 0x7fb7800b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.202+0000 7fb777fff640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb780144790 0x7fb780147600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb76802b8c0 tx=0x7fb7680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.202+0000 7fb7777fe640 1 -- 172.21.15.134:0/98784319 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768032900 con 0x7fb780144790 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.202+0000 7fb7777fe640 1 -- 172.21.15.134:0/98784319 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb768032a60 con 0x7fb780144790 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.202+0000 7fb7856c0640 1 -- 172.21.15.134:0/98784319 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7801df790 con 0x7fb780144790 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.202+0000 7fb7777fe640 1 -- 172.21.15.134:0/98784319 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768032e10 con 0x7fb780144790 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.202+0000 7fb7856c0640 1 -- 172.21.15.134:0/98784319 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7801e04d0 con 0x7fb780144790 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.203+0000 7fb7856c0640 1 -- 172.21.15.134:0/98784319 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb780067b70 con 0x7fb780144790 2024-02-17T14:28:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.203+0000 7fb7777fe640 1 -- 172.21.15.134:0/98784319 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb7680453f0 con 0x7fb780144790 2024-02-17T14:28:16.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.203+0000 7fb7777fe640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb76006b810 0x7fb76006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:16.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.204+0000 7fb7777fe640 1 -- 172.21.15.134:0/98784319 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb7680ac7b0 con 0x7fb780144790 2024-02-17T14:28:16.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.204+0000 7fb77effd640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb76006b810 0x7fb76006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:16.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.204+0000 7fb77effd640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb76006b810 0x7fb76006dcd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb77000b740 tx=0x7fb770008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.208+0000 7fb7777fe640 1 -- 172.21.15.134:0/98784319 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb768076f20 con 0x7fb780144790 2024-02-17T14:28:16.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.391+0000 7fb7856c0640 1 -- 172.21.15.134:0/98784319 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb7800a25c0 con 0x7fb780144790 2024-02-17T14:28:16.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.391+0000 7fb7777fe640 1 -- 172.21.15.134:0/98784319 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb76807a5e0 con 0x7fb780144790 2024-02-17T14:28:16.391 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-02-17T14:28:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.393+0000 7fb7856c0640 1 -- 172.21.15.134:0/98784319 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb76006b810 msgr2=0x7fb76006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.393+0000 7fb7856c0640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb76006b810 0x7fb76006dcd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb77000b740 tx=0x7fb770008040 comp rx=0 tx=0).stop 2024-02-17T14:28:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.393+0000 7fb7856c0640 1 -- 172.21.15.134:0/98784319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb780144790 msgr2=0x7fb780147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.393+0000 7fb7856c0640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb780144790 0x7fb780147600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb76802b8c0 tx=0x7fb7680046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.393+0000 7fb7856c0640 1 -- 172.21.15.134:0/98784319 shutdown_connections 2024-02-17T14:28:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.393+0000 7fb7856c0640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb78014a710 0x7fb7800b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.393+0000 7fb7856c0640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb76006b810 0x7fb76006dcd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.393+0000 7fb7856c0640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb780144790 0x7fb780147600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.393+0000 7fb7856c0640 1 --2- 172.21.15.134:0/98784319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb78009b190 0x7fb7801dff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.393+0000 7fb7856c0640 1 -- 172.21.15.134:0/98784319 >> 172.21.15.134:0/98784319 conn(0x7fb7800b90c0 msgr2=0x7fb780148310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.393+0000 7fb7856c0640 1 -- 172.21.15.134:0/98784319 shutdown_connections 2024-02-17T14:28:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:16.393+0000 7fb7856c0640 1 -- 172.21.15.134:0/98784319 wait complete. 2024-02-17T14:28:16.403 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi134.front.sepia.ceph.com... 2024-02-17T14:28:16.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:16.403 DEBUG:teuthology.orchestra.run.smithi134:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-02-17T14:28:16.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi134.stderr:ceph-fuse[43089]: fuse finished with error 0 and tester_r 0 2024-02-17T14:28:16.431 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:28:22.532 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-02-17T14:28:22.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:22.532 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-02-17T14:28:22.560 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.713+0000 7fa02b89a640 1 Processor -- start 2024-02-17T14:28:22.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.713+0000 7fa02b89a640 1 -- start start 2024-02-17T14:28:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.714+0000 7fa02b89a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa024141250 0x7fa024152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.714+0000 7fa02b89a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa024072210 con 0x7fa024066b20 2024-02-17T14:28:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.714+0000 7fa02b89a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa024071aa0 con 0x7fa024140dd0 2024-02-17T14:28:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.714+0000 7fa02b89a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa024072960 con 0x7fa024141250 2024-02-17T14:28:22.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.714+0000 7fa029e37640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa024141250 0x7fa024152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.714+0000 7fa029e37640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa024141250 0x7fa024152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51936/0 (socket says 172.21.15.134:51936) 2024-02-17T14:28:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.714+0000 7fa029e37640 1 -- 172.21.15.134:0/3251682866 learned_addr learned my addr 172.21.15.134:0/3251682866 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.714+0000 7fa029636640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa024066b20 0x7fa0240b7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52808/0 (socket says 172.21.15.134:52808) 2024-02-17T14:28:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.714+0000 7fa029e37640 1 -- 172.21.15.134:0/3251682866 >> v1:172.21.15.142:6789/0 conn(0x7fa024140dd0 legacy=0x7fa02414f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.714+0000 7fa029e37640 1 -- 172.21.15.134:0/3251682866 >> v1:172.21.15.134:6789/0 conn(0x7fa024066b20 legacy=0x7fa0240b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.714+0000 7fa01bfff640 1 -- 172.21.15.134:0/3251682866 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286710774 0 0) 0x7fa024072210 con 0x7fa024066b20 2024-02-17T14:28:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.714+0000 7fa029e37640 1 -- 172.21.15.134:0/3251682866 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa024066f00 con 0x7fa024141250 2024-02-17T14:28:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.715+0000 7fa029e37640 1 --2- 172.21.15.134:0/3251682866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa024141250 0x7fa024152ee0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009e50 tx=0x7fa01c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33790ac3d1adc63 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:22.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.715+0000 7fa01bfff640 1 -- 172.21.15.134:0/3251682866 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c02ca80 con 0x7fa024141250 2024-02-17T14:28:22.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.715+0000 7fa01bfff640 1 -- 172.21.15.134:0/3251682866 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c02cbe0 con 0x7fa024141250 2024-02-17T14:28:22.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.715+0000 7fa01bfff640 1 -- 172.21.15.134:0/3251682866 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c0343f0 con 0x7fa024141250 2024-02-17T14:28:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.715+0000 7fa02b89a640 1 -- 172.21.15.134:0/3251682866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa024141250 msgr2=0x7fa024152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.715+0000 7fa02b89a640 1 --2- 172.21.15.134:0/3251682866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa024141250 0x7fa024152ee0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009e50 tx=0x7fa01c02bee0 comp rx=0 tx=0).stop 2024-02-17T14:28:22.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.716+0000 7fa02b89a640 1 -- 172.21.15.134:0/3251682866 shutdown_connections 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.716+0000 7fa02b89a640 1 --2- 172.21.15.134:0/3251682866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa024141250 0x7fa024152ee0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.716+0000 7fa02b89a640 1 -- 172.21.15.134:0/3251682866 >> 172.21.15.134:0/3251682866 conn(0x7fa0240b5fe0 msgr2=0x7fa0240b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.716+0000 7fa02b89a640 1 -- 172.21.15.134:0/3251682866 shutdown_connections 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.716+0000 7fa02b89a640 1 -- 172.21.15.134:0/3251682866 wait complete. 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.717+0000 7fa02b89a640 1 Processor -- start 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.717+0000 7fa02b89a640 1 -- start start 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.717+0000 7fa02b89a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa024066b20 0x7fa024145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.717+0000 7fa02b89a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa024140dd0 0x7fa02413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.717+0000 7fa02b89a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa024141250 0x7fa02413d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.717+0000 7fa02b89a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa024147ae0 con 0x7fa024066b20 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.717+0000 7fa02b89a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0240ae720 con 0x7fa024140dd0 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.717+0000 7fa02b89a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa024147d10 con 0x7fa024141250 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.717+0000 7fa029636640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa024066b20 0x7fa024145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:22.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.717+0000 7fa029636640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa024066b20 0x7fa024145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51952/0 (socket says 172.21.15.134:51952) 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.717+0000 7fa029636640 1 -- 172.21.15.134:0/1278088814 learned_addr learned my addr 172.21.15.134:0/1278088814 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.718+0000 7fa029636640 1 -- 172.21.15.134:0/1278088814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa024141250 msgr2=0x7fa02413d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.718+0000 7fa028e35640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa024140dd0 0x7fa02413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.718+0000 7fa029e37640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa024141250 0x7fa02413d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.718+0000 7fa029636640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa024141250 0x7fa02413d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.718+0000 7fa029636640 1 -- 172.21.15.134:0/1278088814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa024140dd0 msgr2=0x7fa02413cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.718+0000 7fa029636640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa024140dd0 0x7fa02413cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.718+0000 7fa029636640 1 -- 172.21.15.134:0/1278088814 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c009b30 con 0x7fa024066b20 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.718+0000 7fa029636640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa024066b20 0x7fa024145000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa01400c4d0 tx=0x7fa01400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.718+0000 7fa019ffb640 1 -- 172.21.15.134:0/1278088814 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0140074e0 con 0x7fa024066b20 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.718+0000 7fa019ffb640 1 -- 172.21.15.134:0/1278088814 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa014007660 con 0x7fa024066b20 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.718+0000 7fa02b89a640 1 -- 172.21.15.134:0/1278088814 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa024146100 con 0x7fa024066b20 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.718+0000 7fa019ffb640 1 -- 172.21.15.134:0/1278088814 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014004a20 con 0x7fa024066b20 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.718+0000 7fa02b89a640 1 -- 172.21.15.134:0/1278088814 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa024147650 con 0x7fa024066b20 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.719+0000 7fa02b89a640 1 -- 172.21.15.134:0/1278088814 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0240b2ff0 con 0x7fa024066b20 2024-02-17T14:28:22.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.719+0000 7fa019ffb640 1 -- 172.21.15.134:0/1278088814 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa014004b80 con 0x7fa024066b20 2024-02-17T14:28:22.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.720+0000 7fa019ffb640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa00806b840 0x7fa00806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:22.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.720+0000 7fa019ffb640 1 -- 172.21.15.134:0/1278088814 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa014089940 con 0x7fa024066b20 2024-02-17T14:28:22.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.720+0000 7fa028e35640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa00806b840 0x7fa00806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:22.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.720+0000 7fa028e35640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa00806b840 0x7fa00806dd00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa0240b5240 tx=0x7fa020009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:22.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.724+0000 7fa019ffb640 1 -- 172.21.15.134:0/1278088814 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0140540b0 con 0x7fa024066b20 2024-02-17T14:28:22.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.898+0000 7fa02b89a640 1 -- 172.21.15.134:0/1278088814 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa024147ed0 con 0x7fa024066b20 2024-02-17T14:28:22.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.899+0000 7fa019ffb640 1 -- 172.21.15.134:0/1278088814 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7fa014057770 con 0x7fa024066b20 2024-02-17T14:28:22.900 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:22.900 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:07.990271+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:22.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.901+0000 7fa02b89a640 1 -- 172.21.15.134:0/1278088814 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa00806b840 msgr2=0x7fa00806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:22.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.901+0000 7fa02b89a640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa00806b840 0x7fa00806dd00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa0240b5240 tx=0x7fa020009040 comp rx=0 tx=0).stop 2024-02-17T14:28:22.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.901+0000 7fa02b89a640 1 -- 172.21.15.134:0/1278088814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa024066b20 msgr2=0x7fa024145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:22.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.901+0000 7fa02b89a640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa024066b20 0x7fa024145000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa01400c4d0 tx=0x7fa01400c990 comp rx=0 tx=0).stop 2024-02-17T14:28:22.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.901+0000 7fa02b89a640 1 -- 172.21.15.134:0/1278088814 shutdown_connections 2024-02-17T14:28:22.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.901+0000 7fa02b89a640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa024141250 0x7fa02413d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:22.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.901+0000 7fa02b89a640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa024140dd0 0x7fa02413cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:22.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.901+0000 7fa02b89a640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa00806b840 0x7fa00806dd00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:22.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.901+0000 7fa02b89a640 1 --2- 172.21.15.134:0/1278088814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa024066b20 0x7fa024145000 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:22.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.901+0000 7fa02b89a640 1 -- 172.21.15.134:0/1278088814 >> 172.21.15.134:0/1278088814 conn(0x7fa0240b5fe0 msgr2=0x7fa02413e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:22.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.901+0000 7fa02b89a640 1 -- 172.21.15.134:0/1278088814 shutdown_connections 2024-02-17T14:28:22.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:22.901+0000 7fa02b89a640 1 -- 172.21.15.134:0/1278088814 wait complete. 2024-02-17T14:28:22.913 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.012+0000 7f4d422db640 1 Processor -- start 2024-02-17T14:28:23.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.012+0000 7f4d422db640 1 -- start start 2024-02-17T14:28:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.013+0000 7f4d422db640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4d3c072810 0x7f4d3c0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.013+0000 7f4d422db640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d3c148100 0x7f4d3c13e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.013+0000 7f4d422db640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3c0b1ad0 con 0x7f4d3c0b0750 2024-02-17T14:28:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.013+0000 7f4d422db640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3c13f200 con 0x7f4d3c072810 2024-02-17T14:28:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.013+0000 7f4d422db640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c0b1860 con 0x7f4d3c148100 2024-02-17T14:28:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.013+0000 7f4d3bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4d3c072810 0x7f4d3c0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.013+0000 7f4d40878640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4d3c0b0750 0x7f4d3c13eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:57232/0 (socket says 172.21.15.134:57232) 2024-02-17T14:28:23.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.013+0000 7f4d40878640 1 -- 172.21.15.134:0/3514753521 learned_addr learned my addr 172.21.15.134:0/3514753521 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.013+0000 7f4d3b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d3c148100 0x7f4d3c13e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.014+0000 7f4d3bfff640 1 -- 172.21.15.134:0/3514753521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d3c148100 msgr2=0x7f4d3c13e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.014+0000 7f4d3bfff640 1 --2- 172.21.15.134:0/3514753521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d3c148100 0x7f4d3c13e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.014+0000 7f4d3bfff640 1 -- 172.21.15.134:0/3514753521 >> v1:172.21.15.142:6789/0 conn(0x7f4d3c0b0750 legacy=0x7f4d3c13eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.014+0000 7f4d3bfff640 1 -- 172.21.15.134:0/3514753521 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c0b1f60 con 0x7f4d3c072810 2024-02-17T14:28:23.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.014+0000 7f4d3b7fe640 1 --2- 172.21.15.134:0/3514753521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d3c148100 0x7f4d3c13e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.015+0000 7f4d3bfff640 1 --2- 172.21.15.134:0/3514753521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d3c072810 0x7f4d3c0b2420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d300097a0 tx=0x7f4d3002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=493795431b73c011 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:23.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.015+0000 7f4d3affd640 1 -- 172.21.15.134:0/3514753521 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3002e070 con 0x7f4d3c072810 2024-02-17T14:28:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.015+0000 7f4d3affd640 1 -- 172.21.15.134:0/3514753521 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d300315a0 con 0x7f4d3c072810 2024-02-17T14:28:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.015+0000 7f4d3affd640 1 -- 172.21.15.134:0/3514753521 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30031930 con 0x7f4d3c072810 2024-02-17T14:28:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.015+0000 7f4d422db640 1 -- 172.21.15.134:0/3514753521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d3c072810 msgr2=0x7f4d3c0b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.015+0000 7f4d422db640 1 --2- 172.21.15.134:0/3514753521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d3c072810 0x7f4d3c0b2420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d300097a0 tx=0x7f4d3002b840 comp rx=0 tx=0).stop 2024-02-17T14:28:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.015+0000 7f4d422db640 1 -- 172.21.15.134:0/3514753521 shutdown_connections 2024-02-17T14:28:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.015+0000 7f4d422db640 1 --2- 172.21.15.134:0/3514753521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d3c148100 0x7f4d3c13e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.015+0000 7f4d422db640 1 --2- 172.21.15.134:0/3514753521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d3c072810 0x7f4d3c0b2420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.015+0000 7f4d422db640 1 -- 172.21.15.134:0/3514753521 >> 172.21.15.134:0/3514753521 conn(0x7f4d3c0b9350 msgr2=0x7f4d3c0b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.016+0000 7f4d422db640 1 -- 172.21.15.134:0/3514753521 shutdown_connections 2024-02-17T14:28:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.016+0000 7f4d422db640 1 -- 172.21.15.134:0/3514753521 wait complete. 2024-02-17T14:28:23.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.016+0000 7f4d422db640 1 Processor -- start 2024-02-17T14:28:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.017+0000 7f4d422db640 1 -- start start 2024-02-17T14:28:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.017+0000 7f4d422db640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d3c072810 0x7f4d3c141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.017+0000 7f4d422db640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d3c0b0750 0x7f4d3c141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.017+0000 7f4d422db640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d3c148100 0x7f4d3c1dfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.017+0000 7f4d422db640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c147910 con 0x7f4d3c0b0750 2024-02-17T14:28:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.017+0000 7f4d422db640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c146230 con 0x7f4d3c148100 2024-02-17T14:28:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.017+0000 7f4d422db640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c13fff0 con 0x7f4d3c072810 2024-02-17T14:28:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.017+0000 7f4d3b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d3c0b0750 0x7f4d3c141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.017+0000 7f4d3b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d3c0b0750 0x7f4d3c141cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51966/0 (socket says 172.21.15.134:51966) 2024-02-17T14:28:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.017+0000 7f4d3b7fe640 1 -- 172.21.15.134:0/2346894636 learned_addr learned my addr 172.21.15.134:0/2346894636 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.018+0000 7f4d3bfff640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d3c072810 0x7f4d3c141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.018+0000 7f4d40878640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d3c148100 0x7f4d3c1dfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.018+0000 7f4d3b7fe640 1 -- 172.21.15.134:0/2346894636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d3c072810 msgr2=0x7f4d3c141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.018+0000 7f4d3b7fe640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d3c072810 0x7f4d3c141790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.018+0000 7f4d3b7fe640 1 -- 172.21.15.134:0/2346894636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d3c148100 msgr2=0x7f4d3c1dfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.018+0000 7f4d3b7fe640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d3c148100 0x7f4d3c1dfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.018+0000 7f4d3b7fe640 1 -- 172.21.15.134:0/2346894636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c009400 con 0x7f4d3c0b0750 2024-02-17T14:28:23.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.018+0000 7f4d3b7fe640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d3c0b0750 0x7f4d3c141cd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00ec10 tx=0x7f4d2c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:23.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.018+0000 7f4d38ff9640 1 -- 172.21.15.134:0/2346894636 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00cc30 con 0x7f4d3c0b0750 2024-02-17T14:28:23.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.018+0000 7f4d38ff9640 1 -- 172.21.15.134:0/2346894636 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c00cd90 con 0x7f4d3c0b0750 2024-02-17T14:28:23.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.018+0000 7f4d422db640 1 -- 172.21.15.134:0/2346894636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d30009400 con 0x7f4d3c0b0750 2024-02-17T14:28:23.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.018+0000 7f4d38ff9640 1 -- 172.21.15.134:0/2346894636 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c013670 con 0x7f4d3c0b0750 2024-02-17T14:28:23.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.018+0000 7f4d422db640 1 -- 172.21.15.134:0/2346894636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3c147e40 con 0x7f4d3c0b0750 2024-02-17T14:28:23.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.019+0000 7f4d422db640 1 -- 172.21.15.134:0/2346894636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3c1463c0 con 0x7f4d3c0b0750 2024-02-17T14:28:23.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.019+0000 7f4d38ff9640 1 -- 172.21.15.134:0/2346894636 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4d2c0137d0 con 0x7f4d3c0b0750 2024-02-17T14:28:23.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.020+0000 7f4d38ff9640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4d2806b840 0x7f4d2806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.020+0000 7f4d3bfff640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4d2806b840 0x7f4d2806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.020+0000 7f4d38ff9640 1 -- 172.21.15.134:0/2346894636 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4d2c08a6d0 con 0x7f4d3c0b0750 2024-02-17T14:28:23.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.020+0000 7f4d3bfff640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4d2806b840 0x7f4d2806dd00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d30036000 tx=0x7f4d3003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:23.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.024+0000 7f4d38ff9640 1 -- 172.21.15.134:0/2346894636 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4d2c054e40 con 0x7f4d3c0b0750 2024-02-17T14:28:23.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.195+0000 7f4d422db640 1 -- 172.21.15.134:0/2346894636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d3c068280 con 0x7f4d3c0b0750 2024-02-17T14:28:23.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.196+0000 7f4d38ff9640 1 -- 172.21.15.134:0/2346894636 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f4d2c058500 con 0x7f4d3c0b0750 2024-02-17T14:28:23.197 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:23.197 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:07.990271+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:23.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.198+0000 7f4d422db640 1 -- 172.21.15.134:0/2346894636 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4d2806b840 msgr2=0x7f4d2806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.198+0000 7f4d422db640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4d2806b840 0x7f4d2806dd00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d30036000 tx=0x7f4d3003d040 comp rx=0 tx=0).stop 2024-02-17T14:28:23.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.198+0000 7f4d422db640 1 -- 172.21.15.134:0/2346894636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d3c0b0750 msgr2=0x7f4d3c141cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.198+0000 7f4d422db640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d3c0b0750 0x7f4d3c141cd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00ec10 tx=0x7f4d2c00c520 comp rx=0 tx=0).stop 2024-02-17T14:28:23.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.198+0000 7f4d422db640 1 -- 172.21.15.134:0/2346894636 shutdown_connections 2024-02-17T14:28:23.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.198+0000 7f4d422db640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d3c148100 0x7f4d3c1dfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.198+0000 7f4d422db640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4d2806b840 0x7f4d2806dd00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.198+0000 7f4d422db640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d3c0b0750 0x7f4d3c141cd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.198+0000 7f4d422db640 1 --2- 172.21.15.134:0/2346894636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d3c072810 0x7f4d3c141790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.198+0000 7f4d422db640 1 -- 172.21.15.134:0/2346894636 >> 172.21.15.134:0/2346894636 conn(0x7f4d3c0b9350 msgr2=0x7f4d3c0b9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:23.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.199+0000 7f4d422db640 1 -- 172.21.15.134:0/2346894636 shutdown_connections 2024-02-17T14:28:23.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.199+0000 7f4d422db640 1 -- 172.21.15.134:0/2346894636 wait complete. 2024-02-17T14:28:23.210 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-17T14:28:23.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.313+0000 7fa0e7076640 1 Processor -- start 2024-02-17T14:28:23.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.313+0000 7fa0e7076640 1 -- start start 2024-02-17T14:28:23.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.313+0000 7fa0e7076640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0e01449b0 0x7fa0e009b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0e7076640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e009ac60 con 0x7fa0e00b6fa0 2024-02-17T14:28:23.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0e7076640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e014aad0 con 0x7fa0e014a6f0 2024-02-17T14:28:23.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0e7076640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e00b3440 con 0x7fa0e01449b0 2024-02-17T14:28:23.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0e5613640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa0e00b6fa0 0x7fa0e01517b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52814/0 (socket says 172.21.15.134:52814) 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0e5613640 1 -- 172.21.15.134:0/476221605 learned_addr learned my addr 172.21.15.134:0/476221605 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0d7fff640 1 --2- 172.21.15.134:0/476221605 >> v2:172.21.15.142:3300/0 conn(0x7fa0e01449b0 0x7fa0e009b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0d77fe640 1 -- 172.21.15.134:0/476221605 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162142859 0 0) 0x7fa0e009ac60 con 0x7fa0e00b6fa0 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0d77fe640 1 -- 172.21.15.134:0/476221605 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c8003520 con 0x7fa0e00b6fa0 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0d77fe640 1 -- 172.21.15.134:0/476221605 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825350217 0 0) 0x7fa0e014aad0 con 0x7fa0e014a6f0 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0d77fe640 1 -- 172.21.15.134:0/476221605 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0e009ac60 con 0x7fa0e014a6f0 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0d7fff640 1 -- 172.21.15.134:0/476221605 >> v1:172.21.15.142:6789/0 conn(0x7fa0e014a6f0 legacy=0x7fa0e01442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0d77fe640 1 -- 172.21.15.134:0/476221605 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1839076164 0 0) 0x7fa0c8003520 con 0x7fa0e00b6fa0 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0d7fff640 1 -- 172.21.15.134:0/476221605 >> v1:172.21.15.134:6789/0 conn(0x7fa0e00b6fa0 legacy=0x7fa0e01517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.314+0000 7fa0d7fff640 1 -- 172.21.15.134:0/476221605 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e009a610 con 0x7fa0e01449b0 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.315+0000 7fa0d7fff640 1 --2- 172.21.15.134:0/476221605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0e01449b0 0x7fa0e009b0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00097a0 tx=0x7fa0d002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b005a3bc446d8bbc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.315+0000 7fa0d77fe640 1 -- 172.21.15.134:0/476221605 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d80019f0 con 0x7fa0e01449b0 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.315+0000 7fa0d77fe640 1 -- 172.21.15.134:0/476221605 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d002e050 con 0x7fa0e01449b0 2024-02-17T14:28:23.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.315+0000 7fa0d77fe640 1 -- 172.21.15.134:0/476221605 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0030730 con 0x7fa0e01449b0 2024-02-17T14:28:23.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.316+0000 7fa0e7076640 1 -- 172.21.15.134:0/476221605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0e01449b0 msgr2=0x7fa0e009b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.316+0000 7fa0e7076640 1 --2- 172.21.15.134:0/476221605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0e01449b0 0x7fa0e009b0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00097a0 tx=0x7fa0d002b790 comp rx=0 tx=0).stop 2024-02-17T14:28:23.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.316+0000 7fa0e7076640 1 -- 172.21.15.134:0/476221605 shutdown_connections 2024-02-17T14:28:23.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.316+0000 7fa0e7076640 1 --2- 172.21.15.134:0/476221605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0e01449b0 0x7fa0e009b0f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.316+0000 7fa0e7076640 1 -- 172.21.15.134:0/476221605 >> 172.21.15.134:0/476221605 conn(0x7fa0e00b90a0 msgr2=0x7fa0e00b94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:23.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.316+0000 7fa0e7076640 1 -- 172.21.15.134:0/476221605 shutdown_connections 2024-02-17T14:28:23.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.316+0000 7fa0e7076640 1 -- 172.21.15.134:0/476221605 wait complete. 2024-02-17T14:28:23.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.317+0000 7fa0e7076640 1 Processor -- start 2024-02-17T14:28:23.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.317+0000 7fa0e7076640 1 -- start start 2024-02-17T14:28:23.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.317+0000 7fa0e7076640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0e00b6fa0 0x7fa0e01dc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.317+0000 7fa0e7076640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e01449b0 0x7fa0e0140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.317+0000 7fa0e7076640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0e014a6f0 0x7fa0e00ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.317+0000 7fa0e7076640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e01dfd90 con 0x7fa0e01449b0 2024-02-17T14:28:23.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.317+0000 7fa0e7076640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e01dcb00 con 0x7fa0e00b6fa0 2024-02-17T14:28:23.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.317+0000 7fa0e7076640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e0145270 con 0x7fa0e014a6f0 2024-02-17T14:28:23.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.317+0000 7fa0d7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e01449b0 0x7fa0e0140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.317+0000 7fa0d7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e01449b0 0x7fa0e0140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51968/0 (socket says 172.21.15.134:51968) 2024-02-17T14:28:23.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.317+0000 7fa0d7fff640 1 -- 172.21.15.134:0/2132501929 learned_addr learned my addr 172.21.15.134:0/2132501929 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:23.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0e5613640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0e014a6f0 0x7fa0e00ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0e4e12640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0e00b6fa0 0x7fa0e01dc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0d7fff640 1 -- 172.21.15.134:0/2132501929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0e014a6f0 msgr2=0x7fa0e00ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0d7fff640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0e014a6f0 0x7fa0e00ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0d7fff640 1 -- 172.21.15.134:0/2132501929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0e00b6fa0 msgr2=0x7fa0e01dc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0d7fff640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0e00b6fa0 0x7fa0e01dc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0d7fff640 1 -- 172.21.15.134:0/2132501929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d0009400 con 0x7fa0e01449b0 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0e4e12640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0e00b6fa0 0x7fa0e01dc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0d7fff640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e01449b0 0x7fa0e0140890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00098c0 tx=0x7fa0d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0d57fa640 1 -- 172.21.15.134:0/2132501929 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d003b810 con 0x7fa0e01449b0 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0d57fa640 1 -- 172.21.15.134:0/2132501929 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d003b970 con 0x7fa0e01449b0 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0e7076640 1 -- 172.21.15.134:0/2132501929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e01dff70 con 0x7fa0e01449b0 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0d57fa640 1 -- 172.21.15.134:0/2132501929 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d003bd20 con 0x7fa0e01449b0 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.318+0000 7fa0e7076640 1 -- 172.21.15.134:0/2132501929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e01e0300 con 0x7fa0e01449b0 2024-02-17T14:28:23.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.319+0000 7fa0e7076640 1 -- 172.21.15.134:0/2132501929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e01e0490 con 0x7fa0e01449b0 2024-02-17T14:28:23.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.320+0000 7fa0d57fa640 1 -- 172.21.15.134:0/2132501929 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa0d0039040 con 0x7fa0e01449b0 2024-02-17T14:28:23.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.320+0000 7fa0d57fa640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa0cc06b810 0x7fa0cc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.320+0000 7fa0d57fa640 1 -- 172.21.15.134:0/2132501929 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa0d00abaf0 con 0x7fa0e01449b0 2024-02-17T14:28:23.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.320+0000 7fa0e4e12640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa0cc06b810 0x7fa0cc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.320+0000 7fa0e4e12640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa0cc06b810 0x7fa0cc06dcd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0011e0 tx=0x7fa0dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:23.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.324+0000 7fa0d57fa640 1 -- 172.21.15.134:0/2132501929 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0e01e0490 con 0x7fa0e01449b0 2024-02-17T14:28:23.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.531+0000 7fa0e7076640 1 -- 172.21.15.134:0/2132501929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa0e01e0490 con 0x7fa0e01449b0 2024-02-17T14:28:23.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.692+0000 7fa0d57fa640 1 -- 172.21.15.134:0/2132501929 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa0e01e0490 con 0x7fa0e01449b0 2024-02-17T14:28:23.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.694+0000 7fa0e7076640 1 -- 172.21.15.134:0/2132501929 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa0cc06b810 msgr2=0x7fa0cc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.694+0000 7fa0e7076640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa0cc06b810 0x7fa0cc06dcd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0011e0 tx=0x7fa0dc009040 comp rx=0 tx=0).stop 2024-02-17T14:28:23.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.694+0000 7fa0e7076640 1 -- 172.21.15.134:0/2132501929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e01449b0 msgr2=0x7fa0e0140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.694+0000 7fa0e7076640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e01449b0 0x7fa0e0140890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00098c0 tx=0x7fa0d00046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.694+0000 7fa0e7076640 1 -- 172.21.15.134:0/2132501929 shutdown_connections 2024-02-17T14:28:23.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.694+0000 7fa0e7076640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0e014a6f0 0x7fa0e00ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.694+0000 7fa0e7076640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa0cc06b810 0x7fa0cc06dcd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.694+0000 7fa0e7076640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0e01449b0 0x7fa0e0140890 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.694+0000 7fa0e7076640 1 --2- 172.21.15.134:0/2132501929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0e00b6fa0 0x7fa0e01dc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.694+0000 7fa0e7076640 1 -- 172.21.15.134:0/2132501929 >> 172.21.15.134:0/2132501929 conn(0x7fa0e00b90a0 msgr2=0x7fa0e00bad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:23.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.694+0000 7fa0e7076640 1 -- 172.21.15.134:0/2132501929 shutdown_connections 2024-02-17T14:28:23.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.694+0000 7fa0e7076640 1 -- 172.21.15.134:0/2132501929 wait complete. 2024-02-17T14:28:23.706 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-02-17T14:28:23.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-17T14:28:23.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.808+0000 7ffbd9d65640 1 Processor -- start 2024-02-17T14:28:23.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.808+0000 7ffbd9d65640 1 -- start start 2024-02-17T14:28:23.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.809+0000 7ffbd9d65640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffbd4144960 0x7ffbd40b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.809+0000 7ffbd9d65640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd414aaf0 con 0x7ffbd409b190 2024-02-17T14:28:23.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.809+0000 7ffbd9d65640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd409c4f0 con 0x7ffbd414a710 2024-02-17T14:28:23.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.809+0000 7ffbd9d65640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd409c280 con 0x7ffbd4144960 2024-02-17T14:28:23.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.809+0000 7ffbd3fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ffbd409b190 0x7ffbd41517d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50978/0 (socket says 172.21.15.134:50978) 2024-02-17T14:28:23.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.809+0000 7ffbd3fff640 1 -- 172.21.15.134:0/720136356 learned_addr learned my addr 172.21.15.134:0/720136356 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:23.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.809+0000 7ffbd2ffd640 1 --2- 172.21.15.134:0/720136356 >> v2:172.21.15.142:3300/0 conn(0x7ffbd4144960 0x7ffbd40b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.810+0000 7ffbd27fc640 1 -- 172.21.15.134:0/720136356 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879110436 0 0) 0x7ffbd414aaf0 con 0x7ffbd409b190 2024-02-17T14:28:23.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.810+0000 7ffbd27fc640 1 -- 172.21.15.134:0/720136356 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbbc003520 con 0x7ffbd409b190 2024-02-17T14:28:23.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.810+0000 7ffbd2ffd640 1 -- 172.21.15.134:0/720136356 >> v1:172.21.15.142:6789/0 conn(0x7ffbd414a710 legacy=0x7ffbd4144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.810+0000 7ffbd27fc640 1 -- 172.21.15.134:0/720136356 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 332264058 0 0) 0x7ffbbc003520 con 0x7ffbd409b190 2024-02-17T14:28:23.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.810+0000 7ffbd2ffd640 1 -- 172.21.15.134:0/720136356 >> v1:172.21.15.134:6789/0 conn(0x7ffbd409b190 legacy=0x7ffbd41517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.810+0000 7ffbd2ffd640 1 -- 172.21.15.134:0/720136356 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd409a6b0 con 0x7ffbd4144960 2024-02-17T14:28:23.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.810+0000 7ffbd2ffd640 1 --2- 172.21.15.134:0/720136356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd4144960 0x7ffbd40b6fc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80097a0 tx=0x7ffbc802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7d3d1f747afc5eb server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.811+0000 7ffbd27fc640 1 -- 172.21.15.134:0/720136356 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc0019f0 con 0x7ffbd4144960 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.811+0000 7ffbd27fc640 1 -- 172.21.15.134:0/720136356 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc802e050 con 0x7ffbd4144960 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.811+0000 7ffbd27fc640 1 -- 172.21.15.134:0/720136356 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8030730 con 0x7ffbd4144960 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.811+0000 7ffbd9d65640 1 -- 172.21.15.134:0/720136356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd4144960 msgr2=0x7ffbd40b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.811+0000 7ffbd9d65640 1 --2- 172.21.15.134:0/720136356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd4144960 0x7ffbd40b6fc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80097a0 tx=0x7ffbc802b790 comp rx=0 tx=0).stop 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.811+0000 7ffbd9d65640 1 -- 172.21.15.134:0/720136356 shutdown_connections 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.811+0000 7ffbd9d65640 1 --2- 172.21.15.134:0/720136356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd4144960 0x7ffbd40b6fc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.811+0000 7ffbd9d65640 1 -- 172.21.15.134:0/720136356 >> 172.21.15.134:0/720136356 conn(0x7ffbd40b90c0 msgr2=0x7ffbd40b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.811+0000 7ffbd9d65640 1 -- 172.21.15.134:0/720136356 shutdown_connections 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.811+0000 7ffbd9d65640 1 -- 172.21.15.134:0/720136356 wait complete. 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.812+0000 7ffbd9d65640 1 Processor -- start 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.812+0000 7ffbd9d65640 1 -- start start 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd9d65640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffbd409b190 0x7ffbd4146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd9d65640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd4144960 0x7ffbd40b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd9d65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbd414a710 0x7ffbd40b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd9d65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40b6480 con 0x7ffbd414a710 2024-02-17T14:28:23.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd9d65640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd41473a0 con 0x7ffbd4144960 2024-02-17T14:28:23.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd9d65640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40b0a20 con 0x7ffbd409b190 2024-02-17T14:28:23.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbd414a710 0x7ffbd40b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbd414a710 0x7ffbd40b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46002/0 (socket says 172.21.15.134:46002) 2024-02-17T14:28:23.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd3fff640 1 -- 172.21.15.134:0/3792682075 learned_addr learned my addr 172.21.15.134:0/3792682075 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:23.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd37fe640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffbd409b190 0x7ffbd4146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd2ffd640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd4144960 0x7ffbd40b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd3fff640 1 -- 172.21.15.134:0/3792682075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffbd409b190 msgr2=0x7ffbd4146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd3fff640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffbd409b190 0x7ffbd4146d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd3fff640 1 -- 172.21.15.134:0/3792682075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd4144960 msgr2=0x7ffbd40b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:23.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd3fff640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd4144960 0x7ffbd40b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:23.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.813+0000 7ffbd3fff640 1 -- 172.21.15.134:0/3792682075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc8009400 con 0x7ffbd414a710 2024-02-17T14:28:23.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.814+0000 7ffbd3fff640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbd414a710 0x7ffbd40b1460 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc001830 tx=0x7ffbcc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:23.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.814+0000 7ffbbbfff640 1 -- 172.21.15.134:0/3792682075 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc012400 con 0x7ffbd414a710 2024-02-17T14:28:23.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.814+0000 7ffbd9d65640 1 -- 172.21.15.134:0/3792682075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd40b0cf0 con 0x7ffbd414a710 2024-02-17T14:28:23.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.814+0000 7ffbbbfff640 1 -- 172.21.15.134:0/3792682075 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc012560 con 0x7ffbd414a710 2024-02-17T14:28:23.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.814+0000 7ffbbbfff640 1 -- 172.21.15.134:0/3792682075 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc012910 con 0x7ffbd414a710 2024-02-17T14:28:23.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.814+0000 7ffbd9d65640 1 -- 172.21.15.134:0/3792682075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd40b5dc0 con 0x7ffbd414a710 2024-02-17T14:28:23.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.815+0000 7ffbd9d65640 1 -- 172.21.15.134:0/3792682075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd40b65c0 con 0x7ffbd414a710 2024-02-17T14:28:23.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.815+0000 7ffbbbfff640 1 -- 172.21.15.134:0/3792682075 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ffbcc012a70 con 0x7ffbd414a710 2024-02-17T14:28:23.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.816+0000 7ffbbbfff640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ffbc006b810 0x7ffbc006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:23.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.816+0000 7ffbbbfff640 1 -- 172.21.15.134:0/3792682075 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ffbcc08ab60 con 0x7ffbd414a710 2024-02-17T14:28:23.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.816+0000 7ffbd37fe640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ffbc006b810 0x7ffbc006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:23.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.816+0000 7ffbd37fe640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ffbc006b810 0x7ffbc006dcd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4000f60 tx=0x7ffbc4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:23.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:23.820+0000 7ffbbbfff640 1 -- 172.21.15.134:0/3792682075 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffbcc055300 con 0x7ffbd414a710 2024-02-17T14:28:24.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.030+0000 7ffbd9d65640 1 -- 172.21.15.134:0/3792682075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffbd40b67a0 con 0x7ffbd414a710 2024-02-17T14:28:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.696+0000 7ffbbbfff640 1 -- 172.21.15.134:0/3792682075 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffbcc08a070 con 0x7ffbd414a710 2024-02-17T14:28:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.699+0000 7ffbd9d65640 1 -- 172.21.15.134:0/3792682075 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ffbc006b810 msgr2=0x7ffbc006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.699+0000 7ffbd9d65640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ffbc006b810 0x7ffbc006dcd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4000f60 tx=0x7ffbc4009040 comp rx=0 tx=0).stop 2024-02-17T14:28:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.699+0000 7ffbd9d65640 1 -- 172.21.15.134:0/3792682075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbd414a710 msgr2=0x7ffbd40b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.699+0000 7ffbd9d65640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbd414a710 0x7ffbd40b1460 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc001830 tx=0x7ffbcc00a430 comp rx=0 tx=0).stop 2024-02-17T14:28:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.699+0000 7ffbd9d65640 1 -- 172.21.15.134:0/3792682075 shutdown_connections 2024-02-17T14:28:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.699+0000 7ffbd9d65640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ffbc006b810 0x7ffbc006dcd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.699+0000 7ffbd9d65640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbd414a710 0x7ffbd40b1460 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.699+0000 7ffbd9d65640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd4144960 0x7ffbd40b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.699+0000 7ffbd9d65640 1 --2- 172.21.15.134:0/3792682075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffbd409b190 0x7ffbd4146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.699+0000 7ffbd9d65640 1 -- 172.21.15.134:0/3792682075 >> 172.21.15.134:0/3792682075 conn(0x7ffbd40b90c0 msgr2=0x7ffbd40b94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.699+0000 7ffbd9d65640 1 -- 172.21.15.134:0/3792682075 shutdown_connections 2024-02-17T14:28:24.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.699+0000 7ffbd9d65640 1 -- 172.21.15.134:0/3792682075 wait complete. 2024-02-17T14:28:24.711 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-17T14:28:24.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T14:28:24.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.812+0000 7f4332dc7640 1 Processor -- start 2024-02-17T14:28:24.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.812+0000 7f4332dc7640 1 -- start start 2024-02-17T14:28:24.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.813+0000 7f4332dc7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f432c150810 0x7f432c152c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:24.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.813+0000 7f4332dc7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c0b51f0 con 0x7f432c0ada50 2024-02-17T14:28:24.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.813+0000 7f4332dc7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c1475a0 con 0x7f432c0acb20 2024-02-17T14:28:24.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.813+0000 7f4332dc7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432c0b6640 con 0x7f432c150810 2024-02-17T14:28:24.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.813+0000 7f4331364640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f432c150810 0x7f432c152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:24.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.813+0000 7f432bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f432c0ada50 0x7f432c140b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50982/0 (socket says 172.21.15.134:50982) 2024-02-17T14:28:24.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.813+0000 7f4331364640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f432c150810 0x7f432c152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46016/0 (socket says 172.21.15.134:46016) 2024-02-17T14:28:24.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.813+0000 7f432bfff640 1 -- 172.21.15.134:0/2331165780 learned_addr learned my addr 172.21.15.134:0/2331165780 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:24.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.813+0000 7f4331364640 1 -- 172.21.15.134:0/2331165780 >> v1:172.21.15.142:6789/0 conn(0x7f432c0acb20 legacy=0x7f432c146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:24.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.813+0000 7f4331364640 1 -- 172.21.15.134:0/2331165780 >> v1:172.21.15.134:6789/0 conn(0x7f432c0ada50 legacy=0x7f432c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:24.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.813+0000 7f432b7fe640 1 -- 172.21.15.134:0/2331165780 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836696577 0 0) 0x7f432c0b51f0 con 0x7f432c0ada50 2024-02-17T14:28:24.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.813+0000 7f4331364640 1 -- 172.21.15.134:0/2331165780 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c0ad2b0 con 0x7f432c150810 2024-02-17T14:28:24.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.814+0000 7f4331364640 1 --2- 172.21.15.134:0/2331165780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432c150810 0x7f432c152c00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f431c0097a0 tx=0x7f431c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ca2cf049722641 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:24.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.814+0000 7f432b7fe640 1 -- 172.21.15.134:0/2331165780 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c031830 con 0x7f432c150810 2024-02-17T14:28:24.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.814+0000 7f432b7fe640 1 -- 172.21.15.134:0/2331165780 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c031990 con 0x7f432c150810 2024-02-17T14:28:24.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.814+0000 7f432b7fe640 1 -- 172.21.15.134:0/2331165780 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c031d20 con 0x7f432c150810 2024-02-17T14:28:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.815+0000 7f4332dc7640 1 -- 172.21.15.134:0/2331165780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432c150810 msgr2=0x7f432c152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.815+0000 7f4332dc7640 1 --2- 172.21.15.134:0/2331165780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432c150810 0x7f432c152c00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f431c0097a0 tx=0x7f431c02b8d0 comp rx=0 tx=0).stop 2024-02-17T14:28:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.815+0000 7f4332dc7640 1 -- 172.21.15.134:0/2331165780 shutdown_connections 2024-02-17T14:28:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.815+0000 7f4332dc7640 1 --2- 172.21.15.134:0/2331165780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432c150810 0x7f432c152c00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.815+0000 7f4332dc7640 1 -- 172.21.15.134:0/2331165780 >> 172.21.15.134:0/2331165780 conn(0x7f432c0ba420 msgr2=0x7f432c0ba830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.815+0000 7f4332dc7640 1 -- 172.21.15.134:0/2331165780 shutdown_connections 2024-02-17T14:28:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.815+0000 7f4332dc7640 1 -- 172.21.15.134:0/2331165780 wait complete. 2024-02-17T14:28:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.816+0000 7f4332dc7640 1 Processor -- start 2024-02-17T14:28:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.816+0000 7f4332dc7640 1 -- start start 2024-02-17T14:28:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f4332dc7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f432c0acb20 0x7f432c0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f4332dc7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432c0ada50 0x7f432c1dfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:24.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f4332dc7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f432c150810 0x7f432c1e0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f4332dc7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c1df7b0 con 0x7f432c0ada50 2024-02-17T14:28:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f4332dc7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0b3480 con 0x7f432c0acb20 2024-02-17T14:28:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f4332dc7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c14a9b0 con 0x7f432c150810 2024-02-17T14:28:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f432bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432c0ada50 0x7f432c1dfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f432bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432c0ada50 0x7f432c1dfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46022/0 (socket says 172.21.15.134:46022) 2024-02-17T14:28:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f432bfff640 1 -- 172.21.15.134:0/1569558710 learned_addr learned my addr 172.21.15.134:0/1569558710 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f4330b63640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f432c0acb20 0x7f432c0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f4331364640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f432c150810 0x7f432c1e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f432bfff640 1 -- 172.21.15.134:0/1569558710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f432c150810 msgr2=0x7f432c1e0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f432bfff640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f432c150810 0x7f432c1e0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f432bfff640 1 -- 172.21.15.134:0/1569558710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f432c0acb20 msgr2=0x7f432c0b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f432bfff640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f432c0acb20 0x7f432c0b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:24.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f432bfff640 1 -- 172.21.15.134:0/1569558710 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c009400 con 0x7f432c0ada50 2024-02-17T14:28:24.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f432bfff640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432c0ada50 0x7f432c1dfbd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f432000c4a0 tx=0x7f432000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:24.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f43297fa640 1 -- 172.21.15.134:0/1569558710 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43200074e0 con 0x7f432c0ada50 2024-02-17T14:28:24.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f43297fa640 1 -- 172.21.15.134:0/1569558710 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4320007640 con 0x7f432c0ada50 2024-02-17T14:28:24.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f4332dc7640 1 -- 172.21.15.134:0/1569558710 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c14ac90 con 0x7f432c0ada50 2024-02-17T14:28:24.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f43297fa640 1 -- 172.21.15.134:0/1569558710 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320004a00 con 0x7f432c0ada50 2024-02-17T14:28:24.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.817+0000 7f4332dc7640 1 -- 172.21.15.134:0/1569558710 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c0b1190 con 0x7f432c0ada50 2024-02-17T14:28:24.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.819+0000 7f4332dc7640 1 -- 172.21.15.134:0/1569558710 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c1df8f0 con 0x7f432c0ada50 2024-02-17T14:28:24.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.819+0000 7f43297fa640 1 -- 172.21.15.134:0/1569558710 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4320004b60 con 0x7f432c0ada50 2024-02-17T14:28:24.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.819+0000 7f43297fa640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f431806b810 0x7f431806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:24.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.819+0000 7f43297fa640 1 -- 172.21.15.134:0/1569558710 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4320089900 con 0x7f432c0ada50 2024-02-17T14:28:24.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.819+0000 7f4330b63640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f431806b810 0x7f431806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:24.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.820+0000 7f4330b63640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f431806b810 0x7f431806dcd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4324007fd0 tx=0x7f4324003e00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:24.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:24.824+0000 7f43297fa640 1 -- 172.21.15.134:0/1569558710 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f432c1df8f0 con 0x7f432c0ada50 2024-02-17T14:28:25.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.029+0000 7f4332dc7640 1 -- 172.21.15.134:0/1569558710 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f432c1df8f0 con 0x7f432c0ada50 2024-02-17T14:28:25.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.029+0000 7f43297fa640 1 -- 172.21.15.134:0/1569558710 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3354 (secure 0 0 0) 0x7f432c1df8f0 con 0x7f432c0ada50 2024-02-17T14:28:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:25.030 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/137239145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":137239145},{"type":"v1","addr":"172.21.15.134:6835","nonce":137239145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T14:28:03.523163+0000","modified":"2024-02-17T14:28:24.032729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/177127534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":177127534},{"type":"v1","addr":"172.21.15.142:6833","nonce":177127534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T14:28:25.031 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 9 2024-02-17T14:28:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.031+0000 7f4332dc7640 1 -- 172.21.15.134:0/1569558710 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f431806b810 msgr2=0x7f431806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.031+0000 7f4332dc7640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f431806b810 0x7f431806dcd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4324007fd0 tx=0x7f4324003e00 comp rx=0 tx=0).stop 2024-02-17T14:28:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.031+0000 7f4332dc7640 1 -- 172.21.15.134:0/1569558710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432c0ada50 msgr2=0x7f432c1dfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.031+0000 7f4332dc7640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432c0ada50 0x7f432c1dfbd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f432000c4a0 tx=0x7f432000c960 comp rx=0 tx=0).stop 2024-02-17T14:28:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.031+0000 7f4332dc7640 1 -- 172.21.15.134:0/1569558710 shutdown_connections 2024-02-17T14:28:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.031+0000 7f4332dc7640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f432c150810 0x7f432c1e0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.031+0000 7f4332dc7640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f431806b810 0x7f431806dcd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.031+0000 7f4332dc7640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f432c0ada50 0x7f432c1dfbd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.031+0000 7f4332dc7640 1 --2- 172.21.15.134:0/1569558710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f432c0acb20 0x7f432c0b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.031+0000 7f4332dc7640 1 -- 172.21.15.134:0/1569558710 >> 172.21.15.134:0/1569558710 conn(0x7f432c0ba420 msgr2=0x7f432c071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.031+0000 7f4332dc7640 1 -- 172.21.15.134:0/1569558710 shutdown_connections 2024-02-17T14:28:25.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.032+0000 7f4332dc7640 1 -- 172.21.15.134:0/1569558710 wait complete. 2024-02-17T14:28:25.043 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.142+0000 7f8d2a7d0640 1 Processor -- start 2024-02-17T14:28:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.142+0000 7f8d2a7d0640 1 -- start start 2024-02-17T14:28:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.143+0000 7f8d2a7d0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8d2406ae10 0x7f8d24072a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.143+0000 7f8d2a7d0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d240b57b0 con 0x7f8d240afe40 2024-02-17T14:28:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.143+0000 7f8d2a7d0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2406b1f0 con 0x7f8d24072f90 2024-02-17T14:28:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.143+0000 7f8d2a7d0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d240703f0 con 0x7f8d2406ae10 2024-02-17T14:28:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.143+0000 7f8d23fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8d2406ae10 0x7f8d24072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.143+0000 7f8d28d6d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8d240afe40 0x7f8d240b43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:50996/0 (socket says 172.21.15.134:50996) 2024-02-17T14:28:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.143+0000 7f8d28d6d640 1 -- 172.21.15.134:0/2147196392 learned_addr learned my addr 172.21.15.134:0/2147196392 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.143+0000 7f8d23fff640 1 -- 172.21.15.134:0/2147196392 >> v1:172.21.15.142:6789/0 conn(0x7f8d24072f90 legacy=0x7f8d240b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.143+0000 7f8d23fff640 1 -- 172.21.15.134:0/2147196392 >> v1:172.21.15.134:6789/0 conn(0x7f8d240afe40 legacy=0x7f8d240b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.143+0000 7f8d22ffd640 1 -- 172.21.15.134:0/2147196392 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496917759 0 0) 0x7f8d240b57b0 con 0x7f8d240afe40 2024-02-17T14:28:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.143+0000 7f8d23fff640 1 -- 172.21.15.134:0/2147196392 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d240b4ab0 con 0x7f8d2406ae10 2024-02-17T14:28:25.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.144+0000 7f8d23fff640 1 --2- 172.21.15.134:0/2147196392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d2406ae10 0x7f8d24072a50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8d140097a0 tx=0x7f8d1402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62b79c527e4afc4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:25.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.144+0000 7f8d22ffd640 1 -- 172.21.15.134:0/2147196392 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14031830 con 0x7f8d2406ae10 2024-02-17T14:28:25.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.144+0000 7f8d22ffd640 1 -- 172.21.15.134:0/2147196392 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d14031990 con 0x7f8d2406ae10 2024-02-17T14:28:25.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.144+0000 7f8d22ffd640 1 -- 172.21.15.134:0/2147196392 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14031d20 con 0x7f8d2406ae10 2024-02-17T14:28:25.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.145+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2147196392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d2406ae10 msgr2=0x7f8d24072a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.145+0000 7f8d2a7d0640 1 --2- 172.21.15.134:0/2147196392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d2406ae10 0x7f8d24072a50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8d140097a0 tx=0x7f8d1402b8d0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.145+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2147196392 shutdown_connections 2024-02-17T14:28:25.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.145+0000 7f8d2a7d0640 1 --2- 172.21.15.134:0/2147196392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d2406ae10 0x7f8d24072a50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.145+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2147196392 >> 172.21.15.134:0/2147196392 conn(0x7f8d240b9310 msgr2=0x7f8d240b9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:25.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.145+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2147196392 shutdown_connections 2024-02-17T14:28:25.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.145+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2147196392 wait complete. 2024-02-17T14:28:25.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.146+0000 7f8d2a7d0640 1 Processor -- start 2024-02-17T14:28:25.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.146+0000 7f8d2a7d0640 1 -- start start 2024-02-17T14:28:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.146+0000 7f8d2a7d0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d2406ae10 0x7f8d240ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.146+0000 7f8d2a7d0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d24072f90 0x7f8d241e0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.146+0000 7f8d2a7d0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d240afe40 0x7f8d241dcca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.146+0000 7f8d2a7d0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d241d6d80 con 0x7f8d240afe40 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.146+0000 7f8d2a7d0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d24142f90 con 0x7f8d24072f90 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.146+0000 7f8d2a7d0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d24142cf0 con 0x7f8d2406ae10 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.146+0000 7f8d28d6d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d240afe40 0x7f8d241dcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.146+0000 7f8d28d6d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d240afe40 0x7f8d241dcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46038/0 (socket says 172.21.15.134:46038) 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.146+0000 7f8d28d6d640 1 -- 172.21.15.134:0/2703881705 learned_addr learned my addr 172.21.15.134:0/2703881705 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d23fff640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d2406ae10 0x7f8d240ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d237fe640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d24072f90 0x7f8d241e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d28d6d640 1 -- 172.21.15.134:0/2703881705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d2406ae10 msgr2=0x7f8d240ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d28d6d640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d2406ae10 0x7f8d240ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d28d6d640 1 -- 172.21.15.134:0/2703881705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d24072f90 msgr2=0x7f8d241e0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d28d6d640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d24072f90 0x7f8d241e0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d28d6d640 1 -- 172.21.15.134:0/2703881705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d14009400 con 0x7f8d240afe40 2024-02-17T14:28:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d237fe640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d24072f90 0x7f8d241e0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d28d6d640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d240afe40 0x7f8d241dcca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00c6d0 tx=0x7f8d1c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d20ff9640 1 -- 172.21.15.134:0/2703881705 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c004d60 con 0x7f8d240afe40 2024-02-17T14:28:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d20ff9640 1 -- 172.21.15.134:0/2703881705 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c00a640 con 0x7f8d240afe40 2024-02-17T14:28:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2703881705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d241dfd60 con 0x7f8d240afe40 2024-02-17T14:28:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d20ff9640 1 -- 172.21.15.134:0/2703881705 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c00aa70 con 0x7f8d240afe40 2024-02-17T14:28:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.147+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2703881705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d24124ca0 con 0x7f8d240afe40 2024-02-17T14:28:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.148+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2703881705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d241e0280 con 0x7f8d240afe40 2024-02-17T14:28:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.148+0000 7f8d20ff9640 1 -- 172.21.15.134:0/2703881705 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8d1c0070d0 con 0x7f8d240afe40 2024-02-17T14:28:25.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.149+0000 7f8d20ff9640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f8d1006b810 0x7f8d1006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.149+0000 7f8d20ff9640 1 -- 172.21.15.134:0/2703881705 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8d1c089e20 con 0x7f8d240afe40 2024-02-17T14:28:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.149+0000 7f8d23fff640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f8d1006b810 0x7f8d1006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.149+0000 7f8d23fff640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f8d1006b810 0x7f8d1006dcd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d14036000 tx=0x7f8d14008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:25.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.153+0000 7f8d20ff9640 1 -- 172.21.15.134:0/2703881705 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d241e0280 con 0x7f8d240afe40 2024-02-17T14:28:25.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.324+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2703881705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d241e0280 con 0x7f8d240afe40 2024-02-17T14:28:25.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.325+0000 7f8d20ff9640 1 -- 172.21.15.134:0/2703881705 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f8d241e0280 con 0x7f8d240afe40 2024-02-17T14:28:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:25.326 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:07.990271+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:25.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.327+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2703881705 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f8d1006b810 msgr2=0x7f8d1006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.327+0000 7f8d2a7d0640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f8d1006b810 0x7f8d1006dcd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d14036000 tx=0x7f8d14008030 comp rx=0 tx=0).stop 2024-02-17T14:28:25.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.327+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2703881705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d240afe40 msgr2=0x7f8d241dcca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.327+0000 7f8d2a7d0640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d240afe40 0x7f8d241dcca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00c6d0 tx=0x7f8d1c00cb90 comp rx=0 tx=0).stop 2024-02-17T14:28:25.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.327+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2703881705 shutdown_connections 2024-02-17T14:28:25.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.327+0000 7f8d2a7d0640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f8d1006b810 0x7f8d1006dcd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.327+0000 7f8d2a7d0640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d240afe40 0x7f8d241dcca0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.327+0000 7f8d2a7d0640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d24072f90 0x7f8d241e0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.327+0000 7f8d2a7d0640 1 --2- 172.21.15.134:0/2703881705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d2406ae10 0x7f8d240ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.327+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2703881705 >> 172.21.15.134:0/2703881705 conn(0x7f8d240b9310 msgr2=0x7f8d240b7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:25.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.327+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2703881705 shutdown_connections 2024-02-17T14:28:25.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.327+0000 7f8d2a7d0640 1 -- 172.21.15.134:0/2703881705 wait complete. 2024-02-17T14:28:25.339 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-17T14:28:25.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T14:28:25.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.438+0000 7f3481a2e640 1 Processor -- start 2024-02-17T14:28:25.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.438+0000 7f3481a2e640 1 -- start start 2024-02-17T14:28:25.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.439+0000 7f3481a2e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c070e20 0x7f347c0b5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.439+0000 7f3481a2e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347c1474e0 con 0x7f347c0b3440 2024-02-17T14:28:25.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.439+0000 7f3481a2e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347c147720 con 0x7f347c0720e0 2024-02-17T14:28:25.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.439+0000 7f3481a2e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347c0b5c60 con 0x7f347c070e20 2024-02-17T14:28:25.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.439+0000 7f347b7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f347c0b3440 0x7f347c0b5550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51006/0 (socket says 172.21.15.134:51006) 2024-02-17T14:28:25.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.439+0000 7f347b7fe640 1 -- 172.21.15.134:0/1310282199 learned_addr learned my addr 172.21.15.134:0/1310282199 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:25.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.439+0000 7f347a7fc640 1 --2- 172.21.15.134:0/1310282199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c070e20 0x7f347c0b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.439+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365746619 0 0) 0x7f3474001490 con 0x7f347c0b3440 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.439+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3464003520 con 0x7f347c0b3440 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 952866104 0 0) 0x7f3464003520 con 0x7f347c0b3440 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c070e20 msgr2=0x7f347c0b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f3479ffb640 1 --2- 172.21.15.134:0/1310282199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c070e20 0x7f347c0b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 >> v1:172.21.15.142:6789/0 conn(0x7f347c0720e0 legacy=0x7f347c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c147a00 con 0x7f347c0b3440 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f3474001b80 con 0x7f347c0b3440 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 >> v1:172.21.15.134:6789/0 conn(0x7f347c0b3440 legacy=0x7f347c0b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f3479ffb640 1 --2- 172.21.15.134:0/1310282199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c070e20 0x7f34640039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f3479ffb640 1 --2- 172.21.15.134:0/1310282199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3464003ee0 0x7f34640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f3479ffb640 1 --2- 172.21.15.134:0/1310282199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3464004d00 0x7f3464005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c0b5c60 con 0x7f3464003ee0 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346400ba90 con 0x7f3464004d00 2024-02-17T14:28:25.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346400bc50 con 0x7f347c070e20 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f347a7fc640 1 --2- 172.21.15.134:0/1310282199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3464003ee0 0x7f34640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f347affd640 1 --2- 172.21.15.134:0/1310282199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c070e20 0x7f34640039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f347b7fe640 1 --2- 172.21.15.134:0/1310282199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3464004d00 0x7f3464005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f347a7fc640 1 -- 172.21.15.134:0/1310282199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c070e20 msgr2=0x7f34640039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f347a7fc640 1 --2- 172.21.15.134:0/1310282199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c070e20 0x7f34640039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f347a7fc640 1 -- 172.21.15.134:0/1310282199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3464004d00 msgr2=0x7f3464005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f347a7fc640 1 --2- 172.21.15.134:0/1310282199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3464004d00 0x7f3464005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.440+0000 7f347a7fc640 1 -- 172.21.15.134:0/1310282199 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464003520 con 0x7f3464003ee0 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.441+0000 7f347a7fc640 1 --2- 172.21.15.134:0/1310282199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3464003ee0 0x7f34640047c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3470009ac0 tx=0x7f34640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1599ca86f117f7d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.441+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347002c6b0 con 0x7f3464003ee0 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.441+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347002c810 con 0x7f3464003ee0 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.441+0000 7f3479ffb640 1 -- 172.21.15.134:0/1310282199 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347002cba0 con 0x7f3464003ee0 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.441+0000 7f3481a2e640 1 -- 172.21.15.134:0/1310282199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3464003ee0 msgr2=0x7f34640047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.441+0000 7f3481a2e640 1 --2- 172.21.15.134:0/1310282199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3464003ee0 0x7f34640047c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3470009ac0 tx=0x7f34640057f0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.441+0000 7f347b7fe640 1 -- 172.21.15.134:0/1310282199 reap_dead start 2024-02-17T14:28:25.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.442+0000 7f3481a2e640 1 -- 172.21.15.134:0/1310282199 shutdown_connections 2024-02-17T14:28:25.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.442+0000 7f3481a2e640 1 -- 172.21.15.134:0/1310282199 >> 172.21.15.134:0/1310282199 conn(0x7f347c0b9350 msgr2=0x7f347c0b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:25.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.442+0000 7f3481a2e640 1 -- 172.21.15.134:0/1310282199 shutdown_connections 2024-02-17T14:28:25.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.442+0000 7f3481a2e640 1 -- 172.21.15.134:0/1310282199 wait complete. 2024-02-17T14:28:25.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.443+0000 7f3481a2e640 1 Processor -- start 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.443+0000 7f3481a2e640 1 -- start start 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.443+0000 7f3481a2e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3464003ee0 0x7f347c140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.443+0000 7f3481a2e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347c1da6c0 0x7f347c1dab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.443+0000 7f3481a2e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c1ddcb0 0x7f347c1de130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.443+0000 7f3481a2e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c1cda20 con 0x7f347c1ddcb0 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.443+0000 7f3481a2e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c1cee20 con 0x7f347c1da6c0 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.443+0000 7f3481a2e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347c1d1b70 con 0x7f3464003ee0 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.443+0000 7f347b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c1ddcb0 0x7f347c1de130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.443+0000 7f347b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c1ddcb0 0x7f347c1de130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46052/0 (socket says 172.21.15.134:46052) 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.443+0000 7f347b7fe640 1 -- 172.21.15.134:0/1140598462 learned_addr learned my addr 172.21.15.134:0/1140598462 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.444+0000 7f347affd640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3464003ee0 0x7f347c140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.444+0000 7f347a7fc640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347c1da6c0 0x7f347c1dab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.444+0000 7f347b7fe640 1 -- 172.21.15.134:0/1140598462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3464003ee0 msgr2=0x7f347c140b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.444+0000 7f347b7fe640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3464003ee0 0x7f347c140b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.444+0000 7f347b7fe640 1 -- 172.21.15.134:0/1140598462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347c1da6c0 msgr2=0x7f347c1dab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.444+0000 7f347b7fe640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347c1da6c0 0x7f347c1dab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.444+0000 7f347b7fe640 1 -- 172.21.15.134:0/1140598462 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c1ccfc0 con 0x7f347c1ddcb0 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.444+0000 7f347b7fe640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c1ddcb0 0x7f347c1de130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f347c144a80 tx=0x7f347400af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.444+0000 7f3463fff640 1 -- 172.21.15.134:0/1140598462 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34740076a0 con 0x7f347c1ddcb0 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.444+0000 7f3463fff640 1 -- 172.21.15.134:0/1140598462 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3474007840 con 0x7f347c1ddcb0 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.444+0000 7f3481a2e640 1 -- 172.21.15.134:0/1140598462 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347c1cdc80 con 0x7f347c1ddcb0 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.444+0000 7f3463fff640 1 -- 172.21.15.134:0/1140598462 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34740133f0 con 0x7f347c1ddcb0 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.444+0000 7f3481a2e640 1 -- 172.21.15.134:0/1140598462 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347c1db080 con 0x7f347c1ddcb0 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.445+0000 7f3481a2e640 1 -- 172.21.15.134:0/1140598462 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347c1cd1b0 con 0x7f347c1ddcb0 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.446+0000 7f3463fff640 1 -- 172.21.15.134:0/1140598462 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3474013550 con 0x7f347c1ddcb0 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.446+0000 7f3463fff640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f346806b810 0x7f346806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.446+0000 7f3463fff640 1 -- 172.21.15.134:0/1140598462 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f347408a600 con 0x7f347c1ddcb0 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.446+0000 7f347affd640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f346806b810 0x7f346806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.446+0000 7f347affd640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f346806b810 0x7f346806dcd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f346c001910 tx=0x7f346c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.450+0000 7f3463fff640 1 -- 172.21.15.134:0/1140598462 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f347c1cd1b0 con 0x7f347c1ddcb0 2024-02-17T14:28:25.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.617+0000 7f3481a2e640 1 -- 172.21.15.134:0/1140598462 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f347c1474e0 con 0x7f346806b810 2024-02-17T14:28:25.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.626+0000 7f3463fff640 1 -- 172.21.15.134:0/1140598462 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345395 (secure 0 0 0) 0x7f347c1474e0 con 0x7f346806b810 2024-02-17T14:28:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:25.633 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-02-17T14:28:25.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.630+0000 7f3481a2e640 1 -- 172.21.15.134:0/1140598462 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f346806b810 msgr2=0x7f346806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.630+0000 7f3481a2e640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f346806b810 0x7f346806dcd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f346c001910 tx=0x7f346c009040 comp rx=0 tx=0).stop 2024-02-17T14:28:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.630+0000 7f3481a2e640 1 -- 172.21.15.134:0/1140598462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c1ddcb0 msgr2=0x7f347c1de130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.630+0000 7f3481a2e640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c1ddcb0 0x7f347c1de130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f347c144a80 tx=0x7f347400af10 comp rx=0 tx=0).stop 2024-02-17T14:28:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.630+0000 7f3481a2e640 1 -- 172.21.15.134:0/1140598462 shutdown_connections 2024-02-17T14:28:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.630+0000 7f3481a2e640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f346806b810 0x7f346806dcd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.630+0000 7f3481a2e640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c1ddcb0 0x7f347c1de130 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.630+0000 7f3481a2e640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347c1da6c0 0x7f347c1dab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.630+0000 7f3481a2e640 1 --2- 172.21.15.134:0/1140598462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3464003ee0 0x7f347c140b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.630+0000 7f3481a2e640 1 -- 172.21.15.134:0/1140598462 >> 172.21.15.134:0/1140598462 conn(0x7f347c0b9350 msgr2=0x7f347c0b5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.630+0000 7f3481a2e640 1 -- 172.21.15.134:0/1140598462 shutdown_connections 2024-02-17T14:28:25.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.630+0000 7f3481a2e640 1 -- 172.21.15.134:0/1140598462 wait complete. 2024-02-17T14:28:25.641 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-02-17T14:28:24.564547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218448,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756272,"statfs":{"total":773094113280,"available":772870422528,"internally_reserved":0,"allocated":2326528,"data_stored":2029432,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003100"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231617+0000","last_change":"2024-02-17T14:28:03.069069+0000","last_active":"2024-02-17T14:28:10.231617+0000","last_peered":"2024-02-17T14:28:10.231617+0000","last_clean":"2024-02-17T14:28:10.231617+0000","last_became_active":"2024-02-17T14:28:03.068714+0000","last_became_peered":"2024-02-17T14:28:03.068714+0000","last_unstale":"2024-02-17T14:28:10.231617+0000","last_undegraded":"2024-02-17T14:28:10.231617+0000","last_fullsized":"2024-02-17T14:28:10.231617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:49:37.606508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659580+0000","last_change":"2024-02-17T14:28:03.633277+0000","last_active":"2024-02-17T14:28:08.659580+0000","last_peered":"2024-02-17T14:28:08.659580+0000","last_clean":"2024-02-17T14:28:08.659580+0000","last_became_active":"2024-02-17T14:28:03.631462+0000","last_became_peered":"2024-02-17T14:28:03.631462+0000","last_unstale":"2024-02-17T14:28:08.659580+0000","last_undegraded":"2024-02-17T14:28:08.659580+0000","last_fullsized":"2024-02-17T14:28:08.659580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659129+0000","last_change":"2024-02-17T14:28:07.850214+0000","last_active":"2024-02-17T14:28:08.659129+0000","last_peered":"2024-02-17T14:28:08.659129+0000","last_clean":"2024-02-17T14:28:08.659129+0000","last_became_active":"2024-02-17T14:28:07.849871+0000","last_became_peered":"2024-02-17T14:28:07.849871+0000","last_unstale":"2024-02-17T14:28:08.659129+0000","last_undegraded":"2024-02-17T14:28:08.659129+0000","last_fullsized":"2024-02-17T14:28:08.659129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:46:12.614434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659755+0000","last_change":"2024-02-17T14:28:03.069234+0000","last_active":"2024-02-17T14:28:08.659755+0000","last_peered":"2024-02-17T14:28:08.659755+0000","last_clean":"2024-02-17T14:28:08.659755+0000","last_became_active":"2024-02-17T14:28:03.068978+0000","last_became_peered":"2024-02-17T14:28:03.068978+0000","last_unstale":"2024-02-17T14:28:08.659755+0000","last_undegraded":"2024-02-17T14:28:08.659755+0000","last_fullsized":"2024-02-17T14:28:08.659755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231420+0000","last_change":"2024-02-17T14:28:03.630763+0000","last_active":"2024-02-17T14:28:10.231420+0000","last_peered":"2024-02-17T14:28:10.231420+0000","last_clean":"2024-02-17T14:28:10.231420+0000","last_became_active":"2024-02-17T14:28:03.630517+0000","last_became_peered":"2024-02-17T14:28:03.630517+0000","last_unstale":"2024-02-17T14:28:10.231420+0000","last_undegraded":"2024-02-17T14:28:10.231420+0000","last_fullsized":"2024-02-17T14:28:10.231420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664338+0000","last_change":"2024-02-17T14:28:07.644982+0000","last_active":"2024-02-17T14:28:08.664338+0000","last_peered":"2024-02-17T14:28:08.664338+0000","last_clean":"2024-02-17T14:28:08.664338+0000","last_became_active":"2024-02-17T14:28:07.644458+0000","last_became_peered":"2024-02-17T14:28:07.644458+0000","last_unstale":"2024-02-17T14:28:08.664338+0000","last_undegraded":"2024-02-17T14:28:08.664338+0000","last_fullsized":"2024-02-17T14:28:08.664338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:42.133618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653761+0000","last_change":"2024-02-17T14:28:03.071236+0000","last_active":"2024-02-17T14:28:10.653761+0000","last_peered":"2024-02-17T14:28:10.653761+0000","last_clean":"2024-02-17T14:28:10.653761+0000","last_became_active":"2024-02-17T14:28:03.070955+0000","last_became_peered":"2024-02-17T14:28:03.070955+0000","last_unstale":"2024-02-17T14:28:10.653761+0000","last_undegraded":"2024-02-17T14:28:10.653761+0000","last_fullsized":"2024-02-17T14:28:10.653761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664873+0000","last_change":"2024-02-17T14:28:03.628182+0000","last_active":"2024-02-17T14:28:08.664873+0000","last_peered":"2024-02-17T14:28:08.664873+0000","last_clean":"2024-02-17T14:28:08.664873+0000","last_became_active":"2024-02-17T14:28:03.627865+0000","last_became_peered":"2024-02-17T14:28:03.627865+0000","last_unstale":"2024-02-17T14:28:08.664873+0000","last_undegraded":"2024-02-17T14:28:08.664873+0000","last_fullsized":"2024-02-17T14:28:08.664873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665230+0000","last_change":"2024-02-17T14:28:07.649384+0000","last_active":"2024-02-17T14:28:08.665230+0000","last_peered":"2024-02-17T14:28:08.665230+0000","last_clean":"2024-02-17T14:28:08.665230+0000","last_became_active":"2024-02-17T14:28:07.648936+0000","last_became_peered":"2024-02-17T14:28:07.648936+0000","last_unstale":"2024-02-17T14:28:08.665230+0000","last_undegraded":"2024-02-17T14:28:08.665230+0000","last_fullsized":"2024-02-17T14:28:08.665230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:13.199365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653449+0000","last_change":"2024-02-17T14:28:03.074776+0000","last_active":"2024-02-17T14:28:10.653449+0000","last_peered":"2024-02-17T14:28:10.653449+0000","last_clean":"2024-02-17T14:28:10.653449+0000","last_became_active":"2024-02-17T14:28:03.074490+0000","last_became_peered":"2024-02-17T14:28:03.074490+0000","last_unstale":"2024-02-17T14:28:10.653449+0000","last_undegraded":"2024-02-17T14:28:10.653449+0000","last_fullsized":"2024-02-17T14:28:10.653449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.666004+0000","last_change":"2024-02-17T14:28:03.627957+0000","last_active":"2024-02-17T14:28:08.666004+0000","last_peered":"2024-02-17T14:28:08.666004+0000","last_clean":"2024-02-17T14:28:08.666004+0000","last_became_active":"2024-02-17T14:28:03.627675+0000","last_became_peered":"2024-02-17T14:28:03.627675+0000","last_unstale":"2024-02-17T14:28:08.666004+0000","last_undegraded":"2024-02-17T14:28:08.666004+0000","last_fullsized":"2024-02-17T14:28:08.666004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664955+0000","last_change":"2024-02-17T14:28:07.652422+0000","last_active":"2024-02-17T14:28:08.664955+0000","last_peered":"2024-02-17T14:28:08.664955+0000","last_clean":"2024-02-17T14:28:08.664955+0000","last_became_active":"2024-02-17T14:28:07.651946+0000","last_became_peered":"2024-02-17T14:28:07.651946+0000","last_unstale":"2024-02-17T14:28:08.664955+0000","last_undegraded":"2024-02-17T14:28:08.664955+0000","last_fullsized":"2024-02-17T14:28:08.664955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:21.967845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199578+0000","last_change":"2024-02-17T14:28:03.635059+0000","last_active":"2024-02-17T14:28:10.199578+0000","last_peered":"2024-02-17T14:28:10.199578+0000","last_clean":"2024-02-17T14:28:10.199578+0000","last_became_active":"2024-02-17T14:28:03.634759+0000","last_became_peered":"2024-02-17T14:28:03.634759+0000","last_unstale":"2024-02-17T14:28:10.199578+0000","last_undegraded":"2024-02-17T14:28:10.199578+0000","last_fullsized":"2024-02-17T14:28:10.199578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653581+0000","last_change":"2024-02-17T14:28:03.075604+0000","last_active":"2024-02-17T14:28:10.653581+0000","last_peered":"2024-02-17T14:28:10.653581+0000","last_clean":"2024-02-17T14:28:10.653581+0000","last_became_active":"2024-02-17T14:28:03.075329+0000","last_became_peered":"2024-02-17T14:28:03.075329+0000","last_unstale":"2024-02-17T14:28:10.653581+0000","last_undegraded":"2024-02-17T14:28:10.653581+0000","last_fullsized":"2024-02-17T14:28:10.653581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665134+0000","last_change":"2024-02-17T14:28:07.645791+0000","last_active":"2024-02-17T14:28:08.665134+0000","last_peered":"2024-02-17T14:28:08.665134+0000","last_clean":"2024-02-17T14:28:08.665134+0000","last_became_active":"2024-02-17T14:28:07.645418+0000","last_became_peered":"2024-02-17T14:28:07.645418+0000","last_unstale":"2024-02-17T14:28:08.665134+0000","last_undegraded":"2024-02-17T14:28:08.665134+0000","last_fullsized":"2024-02-17T14:28:08.665134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:26.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659629+0000","last_change":"2024-02-17T14:28:03.629378+0000","last_active":"2024-02-17T14:28:08.659629+0000","last_peered":"2024-02-17T14:28:08.659629+0000","last_clean":"2024-02-17T14:28:08.659629+0000","last_became_active":"2024-02-17T14:28:03.629097+0000","last_became_peered":"2024-02-17T14:28:03.629097+0000","last_unstale":"2024-02-17T14:28:08.659629+0000","last_undegraded":"2024-02-17T14:28:08.659629+0000","last_fullsized":"2024-02-17T14:28:08.659629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008740+0000","last_change":"2024-02-17T14:28:03.073579+0000","last_active":"2024-02-17T14:28:09.008740+0000","last_peered":"2024-02-17T14:28:09.008740+0000","last_clean":"2024-02-17T14:28:09.008740+0000","last_became_active":"2024-02-17T14:28:03.073167+0000","last_became_peered":"2024-02-17T14:28:03.073167+0000","last_unstale":"2024-02-17T14:28:09.008740+0000","last_undegraded":"2024-02-17T14:28:09.008740+0000","last_fullsized":"2024-02-17T14:28:09.008740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664544+0000","last_change":"2024-02-17T14:28:07.644972+0000","last_active":"2024-02-17T14:28:08.664544+0000","last_peered":"2024-02-17T14:28:08.664544+0000","last_clean":"2024-02-17T14:28:08.664544+0000","last_became_active":"2024-02-17T14:28:07.644523+0000","last_became_peered":"2024-02-17T14:28:07.644523+0000","last_unstale":"2024-02-17T14:28:08.664544+0000","last_undegraded":"2024-02-17T14:28:08.664544+0000","last_fullsized":"2024-02-17T14:28:08.664544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:25.221682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659355+0000","last_change":"2024-02-17T14:28:03.628527+0000","last_active":"2024-02-17T14:28:08.659355+0000","last_peered":"2024-02-17T14:28:08.659355+0000","last_clean":"2024-02-17T14:28:08.659355+0000","last_became_active":"2024-02-17T14:28:03.628274+0000","last_became_peered":"2024-02-17T14:28:03.628274+0000","last_unstale":"2024-02-17T14:28:08.659355+0000","last_undegraded":"2024-02-17T14:28:08.659355+0000","last_fullsized":"2024-02-17T14:28:08.659355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008406+0000","last_change":"2024-02-17T14:28:03.072317+0000","last_active":"2024-02-17T14:28:09.008406+0000","last_peered":"2024-02-17T14:28:09.008406+0000","last_clean":"2024-02-17T14:28:09.008406+0000","last_became_active":"2024-02-17T14:28:03.072016+0000","last_became_peered":"2024-02-17T14:28:03.072016+0000","last_unstale":"2024-02-17T14:28:09.008406+0000","last_undegraded":"2024-02-17T14:28:09.008406+0000","last_fullsized":"2024-02-17T14:28:09.008406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008870+0000","last_change":"2024-02-17T14:28:07.851022+0000","last_active":"2024-02-17T14:28:09.008870+0000","last_peered":"2024-02-17T14:28:09.008870+0000","last_clean":"2024-02-17T14:28:09.008870+0000","last_became_active":"2024-02-17T14:28:07.850379+0000","last_became_peered":"2024-02-17T14:28:07.850379+0000","last_unstale":"2024-02-17T14:28:09.008870+0000","last_undegraded":"2024-02-17T14:28:09.008870+0000","last_fullsized":"2024-02-17T14:28:09.008870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665771+0000","last_change":"2024-02-17T14:28:03.624798+0000","last_active":"2024-02-17T14:28:08.665771+0000","last_peered":"2024-02-17T14:28:08.665771+0000","last_clean":"2024-02-17T14:28:08.665771+0000","last_became_active":"2024-02-17T14:28:03.624517+0000","last_became_peered":"2024-02-17T14:28:03.624517+0000","last_unstale":"2024-02-17T14:28:08.665771+0000","last_undegraded":"2024-02-17T14:28:08.665771+0000","last_fullsized":"2024-02-17T14:28:08.665771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:40.637145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653091+0000","last_change":"2024-02-17T14:28:03.072806+0000","last_active":"2024-02-17T14:28:10.653091+0000","last_peered":"2024-02-17T14:28:10.653091+0000","last_clean":"2024-02-17T14:28:10.653091+0000","last_became_active":"2024-02-17T14:28:03.072490+0000","last_became_peered":"2024-02-17T14:28:03.072490+0000","last_unstale":"2024-02-17T14:28:10.653091+0000","last_undegraded":"2024-02-17T14:28:10.653091+0000","last_fullsized":"2024-02-17T14:28:10.653091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664603+0000","last_change":"2024-02-17T14:28:07.644959+0000","last_active":"2024-02-17T14:28:08.664603+0000","last_peered":"2024-02-17T14:28:08.664603+0000","last_clean":"2024-02-17T14:28:08.664603+0000","last_became_active":"2024-02-17T14:28:07.644524+0000","last_became_peered":"2024-02-17T14:28:07.644524+0000","last_unstale":"2024-02-17T14:28:08.664603+0000","last_undegraded":"2024-02-17T14:28:08.664603+0000","last_fullsized":"2024-02-17T14:28:08.664603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:02.122806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231643+0000","last_change":"2024-02-17T14:28:03.629190+0000","last_active":"2024-02-17T14:28:10.231643+0000","last_peered":"2024-02-17T14:28:10.231643+0000","last_clean":"2024-02-17T14:28:10.231643+0000","last_became_active":"2024-02-17T14:28:03.628777+0000","last_became_peered":"2024-02-17T14:28:03.628777+0000","last_unstale":"2024-02-17T14:28:10.231643+0000","last_undegraded":"2024-02-17T14:28:10.231643+0000","last_fullsized":"2024-02-17T14:28:10.231643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200259+0000","last_change":"2024-02-17T14:28:03.071097+0000","last_active":"2024-02-17T14:28:10.200259+0000","last_peered":"2024-02-17T14:28:10.200259+0000","last_clean":"2024-02-17T14:28:10.200259+0000","last_became_active":"2024-02-17T14:28:03.070790+0000","last_became_peered":"2024-02-17T14:28:03.070790+0000","last_unstale":"2024-02-17T14:28:10.200259+0000","last_undegraded":"2024-02-17T14:28:10.200259+0000","last_fullsized":"2024-02-17T14:28:10.200259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665566+0000","last_change":"2024-02-17T14:28:07.849764+0000","last_active":"2024-02-17T14:28:08.665566+0000","last_peered":"2024-02-17T14:28:08.665566+0000","last_clean":"2024-02-17T14:28:08.665566+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:08.665566+0000","last_undegraded":"2024-02-17T14:28:08.665566+0000","last_fullsized":"2024-02-17T14:28:08.665566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659802+0000","last_change":"2024-02-17T14:28:03.641818+0000","last_active":"2024-02-17T14:28:08.659802+0000","last_peered":"2024-02-17T14:28:08.659802+0000","last_clean":"2024-02-17T14:28:08.659802+0000","last_became_active":"2024-02-17T14:28:03.641577+0000","last_became_peered":"2024-02-17T14:28:03.641577+0000","last_unstale":"2024-02-17T14:28:08.659802+0000","last_undegraded":"2024-02-17T14:28:08.659802+0000","last_fullsized":"2024-02-17T14:28:08.659802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008983+0000","last_change":"2024-02-17T14:28:03.072074+0000","last_active":"2024-02-17T14:28:09.008983+0000","last_peered":"2024-02-17T14:28:09.008983+0000","last_clean":"2024-02-17T14:28:09.008983+0000","last_became_active":"2024-02-17T14:28:03.071850+0000","last_became_peered":"2024-02-17T14:28:03.071850+0000","last_unstale":"2024-02-17T14:28:09.008983+0000","last_undegraded":"2024-02-17T14:28:09.008983+0000","last_fullsized":"2024-02-17T14:28:09.008983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659047+0000","last_change":"2024-02-17T14:28:07.849616+0000","last_active":"2024-02-17T14:28:08.659047+0000","last_peered":"2024-02-17T14:28:08.659047+0000","last_clean":"2024-02-17T14:28:08.659047+0000","last_became_active":"2024-02-17T14:28:07.849022+0000","last_became_peered":"2024-02-17T14:28:07.849022+0000","last_unstale":"2024-02-17T14:28:08.659047+0000","last_undegraded":"2024-02-17T14:28:08.659047+0000","last_fullsized":"2024-02-17T14:28:08.659047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:18:22.630217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008626+0000","last_change":"2024-02-17T14:28:03.632265+0000","last_active":"2024-02-17T14:28:09.008626+0000","last_peered":"2024-02-17T14:28:09.008626+0000","last_clean":"2024-02-17T14:28:09.008626+0000","last_became_active":"2024-02-17T14:28:03.632020+0000","last_became_peered":"2024-02-17T14:28:03.632020+0000","last_unstale":"2024-02-17T14:28:09.008626+0000","last_undegraded":"2024-02-17T14:28:09.008626+0000","last_fullsized":"2024-02-17T14:28:09.008626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653833+0000","last_change":"2024-02-17T14:28:03.072252+0000","last_active":"2024-02-17T14:28:10.653833+0000","last_peered":"2024-02-17T14:28:10.653833+0000","last_clean":"2024-02-17T14:28:10.653833+0000","last_became_active":"2024-02-17T14:28:03.071830+0000","last_became_peered":"2024-02-17T14:28:03.071830+0000","last_unstale":"2024-02-17T14:28:10.653833+0000","last_undegraded":"2024-02-17T14:28:10.653833+0000","last_fullsized":"2024-02-17T14:28:10.653833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:24.870956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231494+0000","last_change":"2024-02-17T14:28:07.849579+0000","last_active":"2024-02-17T14:28:10.231494+0000","last_peered":"2024-02-17T14:28:10.231494+0000","last_clean":"2024-02-17T14:28:10.231494+0000","last_became_active":"2024-02-17T14:28:07.849212+0000","last_became_peered":"2024-02-17T14:28:07.849212+0000","last_unstale":"2024-02-17T14:28:10.231494+0000","last_undegraded":"2024-02-17T14:28:10.231494+0000","last_fullsized":"2024-02-17T14:28:10.231494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.666100+0000","last_change":"2024-02-17T14:28:03.626429+0000","last_active":"2024-02-17T14:28:08.666100+0000","last_peered":"2024-02-17T14:28:08.666100+0000","last_clean":"2024-02-17T14:28:08.666100+0000","last_became_active":"2024-02-17T14:28:03.626174+0000","last_became_peered":"2024-02-17T14:28:03.626174+0000","last_unstale":"2024-02-17T14:28:08.666100+0000","last_undegraded":"2024-02-17T14:28:08.666100+0000","last_fullsized":"2024-02-17T14:28:08.666100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008726+0000","last_change":"2024-02-17T14:28:03.068443+0000","last_active":"2024-02-17T14:28:09.008726+0000","last_peered":"2024-02-17T14:28:09.008726+0000","last_clean":"2024-02-17T14:28:09.008726+0000","last_became_active":"2024-02-17T14:28:03.068179+0000","last_became_peered":"2024-02-17T14:28:03.068179+0000","last_unstale":"2024-02-17T14:28:09.008726+0000","last_undegraded":"2024-02-17T14:28:09.008726+0000","last_fullsized":"2024-02-17T14:28:09.008726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008367+0000","last_change":"2024-02-17T14:28:07.650015+0000","last_active":"2024-02-17T14:28:09.008367+0000","last_peered":"2024-02-17T14:28:09.008367+0000","last_clean":"2024-02-17T14:28:09.008367+0000","last_became_active":"2024-02-17T14:28:07.647918+0000","last_became_peered":"2024-02-17T14:28:07.647918+0000","last_unstale":"2024-02-17T14:28:09.008367+0000","last_undegraded":"2024-02-17T14:28:09.008367+0000","last_fullsized":"2024-02-17T14:28:09.008367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665475+0000","last_change":"2024-02-17T14:28:03.629343+0000","last_active":"2024-02-17T14:28:08.665475+0000","last_peered":"2024-02-17T14:28:08.665475+0000","last_clean":"2024-02-17T14:28:08.665475+0000","last_became_active":"2024-02-17T14:28:03.629077+0000","last_became_peered":"2024-02-17T14:28:03.629077+0000","last_unstale":"2024-02-17T14:28:08.665475+0000","last_undegraded":"2024-02-17T14:28:08.665475+0000","last_fullsized":"2024-02-17T14:28:08.665475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:36.441335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664754+0000","last_change":"2024-02-17T14:28:03.069178+0000","last_active":"2024-02-17T14:28:08.664754+0000","last_peered":"2024-02-17T14:28:08.664754+0000","last_clean":"2024-02-17T14:28:08.664754+0000","last_became_active":"2024-02-17T14:28:03.068923+0000","last_became_peered":"2024-02-17T14:28:03.068923+0000","last_unstale":"2024-02-17T14:28:08.664754+0000","last_undegraded":"2024-02-17T14:28:08.664754+0000","last_fullsized":"2024-02-17T14:28:08.664754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008675+0000","last_change":"2024-02-17T14:28:07.648757+0000","last_active":"2024-02-17T14:28:09.008675+0000","last_peered":"2024-02-17T14:28:09.008675+0000","last_clean":"2024-02-17T14:28:09.008675+0000","last_became_active":"2024-02-17T14:28:07.645156+0000","last_became_peered":"2024-02-17T14:28:07.645156+0000","last_unstale":"2024-02-17T14:28:09.008675+0000","last_undegraded":"2024-02-17T14:28:09.008675+0000","last_fullsized":"2024-02-17T14:28:09.008675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008415+0000","last_change":"2024-02-17T14:28:03.627479+0000","last_active":"2024-02-17T14:28:09.008415+0000","last_peered":"2024-02-17T14:28:09.008415+0000","last_clean":"2024-02-17T14:28:09.008415+0000","last_became_active":"2024-02-17T14:28:03.627165+0000","last_became_peered":"2024-02-17T14:28:03.627165+0000","last_unstale":"2024-02-17T14:28:09.008415+0000","last_undegraded":"2024-02-17T14:28:09.008415+0000","last_fullsized":"2024-02-17T14:28:09.008415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952042+0000","last_change":"2024-02-17T14:28:03.066452+0000","last_active":"2024-02-17T14:28:08.952042+0000","last_peered":"2024-02-17T14:28:08.952042+0000","last_clean":"2024-02-17T14:28:08.952042+0000","last_became_active":"2024-02-17T14:28:03.066156+0000","last_became_peered":"2024-02-17T14:28:03.066156+0000","last_unstale":"2024-02-17T14:28:08.952042+0000","last_undegraded":"2024-02-17T14:28:08.952042+0000","last_fullsized":"2024-02-17T14:28:08.952042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008897+0000","last_change":"2024-02-17T14:28:07.649765+0000","last_active":"2024-02-17T14:28:09.008897+0000","last_peered":"2024-02-17T14:28:09.008897+0000","last_clean":"2024-02-17T14:28:09.008897+0000","last_became_active":"2024-02-17T14:28:07.649403+0000","last_became_peered":"2024-02-17T14:28:07.649403+0000","last_unstale":"2024-02-17T14:28:09.008897+0000","last_undegraded":"2024-02-17T14:28:09.008897+0000","last_fullsized":"2024-02-17T14:28:09.008897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231133+0000","last_change":"2024-02-17T14:28:03.629628+0000","last_active":"2024-02-17T14:28:10.231133+0000","last_peered":"2024-02-17T14:28:10.231133+0000","last_clean":"2024-02-17T14:28:10.231133+0000","last_became_active":"2024-02-17T14:28:03.629247+0000","last_became_peered":"2024-02-17T14:28:03.629247+0000","last_unstale":"2024-02-17T14:28:10.231133+0000","last_undegraded":"2024-02-17T14:28:10.231133+0000","last_fullsized":"2024-02-17T14:28:10.231133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:00:51.336643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653093+0000","last_change":"2024-02-17T14:28:03.072090+0000","last_active":"2024-02-17T14:28:10.653093+0000","last_peered":"2024-02-17T14:28:10.653093+0000","last_clean":"2024-02-17T14:28:10.653093+0000","last_became_active":"2024-02-17T14:28:03.071778+0000","last_became_peered":"2024-02-17T14:28:03.071778+0000","last_unstale":"2024-02-17T14:28:10.653093+0000","last_undegraded":"2024-02-17T14:28:10.653093+0000","last_fullsized":"2024-02-17T14:28:10.653093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231592+0000","last_change":"2024-02-17T14:28:07.850472+0000","last_active":"2024-02-17T14:28:10.231592+0000","last_peered":"2024-02-17T14:28:10.231592+0000","last_clean":"2024-02-17T14:28:10.231592+0000","last_became_active":"2024-02-17T14:28:07.850106+0000","last_became_peered":"2024-02-17T14:28:07.850106+0000","last_unstale":"2024-02-17T14:28:10.231592+0000","last_undegraded":"2024-02-17T14:28:10.231592+0000","last_fullsized":"2024-02-17T14:28:10.231592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659235+0000","last_change":"2024-02-17T14:28:03.635109+0000","last_active":"2024-02-17T14:28:08.659235+0000","last_peered":"2024-02-17T14:28:08.659235+0000","last_clean":"2024-02-17T14:28:08.659235+0000","last_became_active":"2024-02-17T14:28:03.634570+0000","last_became_peered":"2024-02-17T14:28:03.634570+0000","last_unstale":"2024-02-17T14:28:08.659235+0000","last_undegraded":"2024-02-17T14:28:08.659235+0000","last_fullsized":"2024-02-17T14:28:08.659235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665733+0000","last_change":"2024-02-17T14:28:03.061647+0000","last_active":"2024-02-17T14:28:08.665733+0000","last_peered":"2024-02-17T14:28:08.665733+0000","last_clean":"2024-02-17T14:28:08.665733+0000","last_became_active":"2024-02-17T14:28:03.061026+0000","last_became_peered":"2024-02-17T14:28:03.061026+0000","last_unstale":"2024-02-17T14:28:08.665733+0000","last_undegraded":"2024-02-17T14:28:08.665733+0000","last_fullsized":"2024-02-17T14:28:08.665733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653276+0000","last_change":"2024-02-17T14:28:00.253131+0000","last_active":"2024-02-17T14:28:10.653276+0000","last_peered":"2024-02-17T14:28:10.653276+0000","last_clean":"2024-02-17T14:28:10.653276+0000","last_became_active":"2024-02-17T14:28:00.252180+0000","last_became_peered":"2024-02-17T14:28:00.252180+0000","last_unstale":"2024-02-17T14:28:10.653276+0000","last_undegraded":"2024-02-17T14:28:10.653276+0000","last_fullsized":"2024-02-17T14:28:10.653276+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_clean_scrub_stamp":"2024-02-17T14:27:59.037303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:48.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199982+0000","last_change":"2024-02-17T14:28:07.849676+0000","last_active":"2024-02-17T14:28:10.199982+0000","last_peered":"2024-02-17T14:28:10.199982+0000","last_clean":"2024-02-17T14:28:10.199982+0000","last_became_active":"2024-02-17T14:28:07.849264+0000","last_became_peered":"2024-02-17T14:28:07.849264+0000","last_unstale":"2024-02-17T14:28:10.199982+0000","last_undegraded":"2024-02-17T14:28:10.199982+0000","last_fullsized":"2024-02-17T14:28:10.199982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653536+0000","last_change":"2024-02-17T14:28:03.642433+0000","last_active":"2024-02-17T14:28:10.653536+0000","last_peered":"2024-02-17T14:28:10.653536+0000","last_clean":"2024-02-17T14:28:10.653536+0000","last_became_active":"2024-02-17T14:28:03.641815+0000","last_became_peered":"2024-02-17T14:28:03.641815+0000","last_unstale":"2024-02-17T14:28:10.653536+0000","last_undegraded":"2024-02-17T14:28:10.653536+0000","last_fullsized":"2024-02-17T14:28:10.653536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:38.398272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952264+0000","last_change":"2024-02-17T14:28:03.066483+0000","last_active":"2024-02-17T14:28:08.952264+0000","last_peered":"2024-02-17T14:28:08.952264+0000","last_clean":"2024-02-17T14:28:08.952264+0000","last_became_active":"2024-02-17T14:28:03.066169+0000","last_became_peered":"2024-02-17T14:28:03.066169+0000","last_unstale":"2024-02-17T14:28:08.952264+0000","last_undegraded":"2024-02-17T14:28:08.952264+0000","last_fullsized":"2024-02-17T14:28:08.952264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199590+0000","last_change":"2024-02-17T14:28:07.846685+0000","last_active":"2024-02-17T14:28:10.199590+0000","last_peered":"2024-02-17T14:28:10.199590+0000","last_clean":"2024-02-17T14:28:10.199590+0000","last_became_active":"2024-02-17T14:28:07.846265+0000","last_became_peered":"2024-02-17T14:28:07.846265+0000","last_unstale":"2024-02-17T14:28:10.199590+0000","last_undegraded":"2024-02-17T14:28:10.199590+0000","last_fullsized":"2024-02-17T14:28:10.199590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664990+0000","last_change":"2024-02-17T14:28:03.634574+0000","last_active":"2024-02-17T14:28:08.664990+0000","last_peered":"2024-02-17T14:28:08.664990+0000","last_clean":"2024-02-17T14:28:08.664990+0000","last_became_active":"2024-02-17T14:28:03.634290+0000","last_became_peered":"2024-02-17T14:28:03.634290+0000","last_unstale":"2024-02-17T14:28:08.664990+0000","last_undegraded":"2024-02-17T14:28:08.664990+0000","last_fullsized":"2024-02-17T14:28:08.664990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008900+0000","last_change":"2024-02-17T14:28:03.072793+0000","last_active":"2024-02-17T14:28:09.008900+0000","last_peered":"2024-02-17T14:28:09.008900+0000","last_clean":"2024-02-17T14:28:09.008900+0000","last_became_active":"2024-02-17T14:28:03.072497+0000","last_became_peered":"2024-02-17T14:28:03.072497+0000","last_unstale":"2024-02-17T14:28:09.008900+0000","last_undegraded":"2024-02-17T14:28:09.008900+0000","last_fullsized":"2024-02-17T14:28:09.008900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231646+0000","last_change":"2024-02-17T14:28:07.651730+0000","last_active":"2024-02-17T14:28:10.231646+0000","last_peered":"2024-02-17T14:28:10.231646+0000","last_clean":"2024-02-17T14:28:10.231646+0000","last_became_active":"2024-02-17T14:28:07.651144+0000","last_became_peered":"2024-02-17T14:28:07.651144+0000","last_unstale":"2024-02-17T14:28:10.231646+0000","last_undegraded":"2024-02-17T14:28:10.231646+0000","last_fullsized":"2024-02-17T14:28:10.231646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653784+0000","last_change":"2024-02-17T14:28:03.643461+0000","last_active":"2024-02-17T14:28:10.653784+0000","last_peered":"2024-02-17T14:28:10.653784+0000","last_clean":"2024-02-17T14:28:10.653784+0000","last_became_active":"2024-02-17T14:28:03.643033+0000","last_became_peered":"2024-02-17T14:28:03.643033+0000","last_unstale":"2024-02-17T14:28:10.653784+0000","last_undegraded":"2024-02-17T14:28:10.653784+0000","last_fullsized":"2024-02-17T14:28:10.653784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:01.946139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952270+0000","last_change":"2024-02-17T14:28:03.067046+0000","last_active":"2024-02-17T14:28:08.952270+0000","last_peered":"2024-02-17T14:28:08.952270+0000","last_clean":"2024-02-17T14:28:08.952270+0000","last_became_active":"2024-02-17T14:28:03.066797+0000","last_became_peered":"2024-02-17T14:28:03.066797+0000","last_unstale":"2024-02-17T14:28:08.952270+0000","last_undegraded":"2024-02-17T14:28:08.952270+0000","last_fullsized":"2024-02-17T14:28:08.952270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.663876+0000","last_change":"2024-02-17T14:28:07.850145+0000","last_active":"2024-02-17T14:28:08.663876+0000","last_peered":"2024-02-17T14:28:08.663876+0000","last_clean":"2024-02-17T14:28:08.663876+0000","last_became_active":"2024-02-17T14:28:07.849280+0000","last_became_peered":"2024-02-17T14:28:07.849280+0000","last_unstale":"2024-02-17T14:28:08.663876+0000","last_undegraded":"2024-02-17T14:28:08.663876+0000","last_fullsized":"2024-02-17T14:28:08.663876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653718+0000","last_change":"2024-02-17T14:28:03.641357+0000","last_active":"2024-02-17T14:28:10.653718+0000","last_peered":"2024-02-17T14:28:10.653718+0000","last_clean":"2024-02-17T14:28:10.653718+0000","last_became_active":"2024-02-17T14:28:03.640945+0000","last_became_peered":"2024-02-17T14:28:03.640945+0000","last_unstale":"2024-02-17T14:28:10.653718+0000","last_undegraded":"2024-02-17T14:28:10.653718+0000","last_fullsized":"2024-02-17T14:28:10.653718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664250+0000","last_change":"2024-02-17T14:28:03.066640+0000","last_active":"2024-02-17T14:28:08.664250+0000","last_peered":"2024-02-17T14:28:08.664250+0000","last_clean":"2024-02-17T14:28:08.664250+0000","last_became_active":"2024-02-17T14:28:03.066350+0000","last_became_peered":"2024-02-17T14:28:03.066350+0000","last_unstale":"2024-02-17T14:28:08.664250+0000","last_undegraded":"2024-02-17T14:28:08.664250+0000","last_fullsized":"2024-02-17T14:28:08.664250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:43.162911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665250+0000","last_change":"2024-02-17T14:28:07.652490+0000","last_active":"2024-02-17T14:28:08.665250+0000","last_peered":"2024-02-17T14:28:08.665250+0000","last_clean":"2024-02-17T14:28:08.665250+0000","last_became_active":"2024-02-17T14:28:07.652088+0000","last_became_peered":"2024-02-17T14:28:07.652088+0000","last_unstale":"2024-02-17T14:28:08.665250+0000","last_undegraded":"2024-02-17T14:28:08.665250+0000","last_fullsized":"2024-02-17T14:28:08.665250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:41.975941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653573+0000","last_change":"2024-02-17T14:28:03.641468+0000","last_active":"2024-02-17T14:28:10.653573+0000","last_peered":"2024-02-17T14:28:10.653573+0000","last_clean":"2024-02-17T14:28:10.653573+0000","last_became_active":"2024-02-17T14:28:03.640860+0000","last_became_peered":"2024-02-17T14:28:03.640860+0000","last_unstale":"2024-02-17T14:28:10.653573+0000","last_undegraded":"2024-02-17T14:28:10.653573+0000","last_fullsized":"2024-02-17T14:28:10.653573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.951937+0000","last_change":"2024-02-17T14:28:03.070146+0000","last_active":"2024-02-17T14:28:08.951937+0000","last_peered":"2024-02-17T14:28:08.951937+0000","last_clean":"2024-02-17T14:28:08.951937+0000","last_became_active":"2024-02-17T14:28:03.069867+0000","last_became_peered":"2024-02-17T14:28:03.069867+0000","last_unstale":"2024-02-17T14:28:08.951937+0000","last_undegraded":"2024-02-17T14:28:08.951937+0000","last_fullsized":"2024-02-17T14:28:08.951937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231421+0000","last_change":"2024-02-17T14:28:07.644792+0000","last_active":"2024-02-17T14:28:10.231421+0000","last_peered":"2024-02-17T14:28:10.231421+0000","last_clean":"2024-02-17T14:28:10.231421+0000","last_became_active":"2024-02-17T14:28:07.644452+0000","last_became_peered":"2024-02-17T14:28:07.644452+0000","last_unstale":"2024-02-17T14:28:10.231421+0000","last_undegraded":"2024-02-17T14:28:10.231421+0000","last_fullsized":"2024-02-17T14:28:10.231421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199598+0000","last_change":"2024-02-17T14:28:03.630962+0000","last_active":"2024-02-17T14:28:10.199598+0000","last_peered":"2024-02-17T14:28:10.199598+0000","last_clean":"2024-02-17T14:28:10.199598+0000","last_became_active":"2024-02-17T14:28:03.630239+0000","last_became_peered":"2024-02-17T14:28:03.630239+0000","last_unstale":"2024-02-17T14:28:10.199598+0000","last_undegraded":"2024-02-17T14:28:10.199598+0000","last_fullsized":"2024-02-17T14:28:10.199598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199658+0000","last_change":"2024-02-17T14:28:03.073091+0000","last_active":"2024-02-17T14:28:10.199658+0000","last_peered":"2024-02-17T14:28:10.199658+0000","last_clean":"2024-02-17T14:28:10.199658+0000","last_became_active":"2024-02-17T14:28:03.072801+0000","last_became_peered":"2024-02-17T14:28:03.072801+0000","last_unstale":"2024-02-17T14:28:10.199658+0000","last_undegraded":"2024-02-17T14:28:10.199658+0000","last_fullsized":"2024-02-17T14:28:10.199658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659664+0000","last_change":"2024-02-17T14:28:07.849362+0000","last_active":"2024-02-17T14:28:08.659664+0000","last_peered":"2024-02-17T14:28:08.659664+0000","last_clean":"2024-02-17T14:28:08.659664+0000","last_became_active":"2024-02-17T14:28:07.848991+0000","last_became_peered":"2024-02-17T14:28:07.848991+0000","last_unstale":"2024-02-17T14:28:08.659664+0000","last_undegraded":"2024-02-17T14:28:08.659664+0000","last_fullsized":"2024-02-17T14:28:08.659664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:52.959315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653518+0000","last_change":"2024-02-17T14:28:03.641810+0000","last_active":"2024-02-17T14:28:10.653518+0000","last_peered":"2024-02-17T14:28:10.653518+0000","last_clean":"2024-02-17T14:28:10.653518+0000","last_became_active":"2024-02-17T14:28:03.641501+0000","last_became_peered":"2024-02-17T14:28:03.641501+0000","last_unstale":"2024-02-17T14:28:10.653518+0000","last_undegraded":"2024-02-17T14:28:10.653518+0000","last_fullsized":"2024-02-17T14:28:10.653518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664665+0000","last_change":"2024-02-17T14:28:03.066989+0000","last_active":"2024-02-17T14:28:08.664665+0000","last_peered":"2024-02-17T14:28:08.664665+0000","last_clean":"2024-02-17T14:28:08.664665+0000","last_became_active":"2024-02-17T14:28:03.066538+0000","last_became_peered":"2024-02-17T14:28:03.066538+0000","last_unstale":"2024-02-17T14:28:08.664665+0000","last_undegraded":"2024-02-17T14:28:08.664665+0000","last_fullsized":"2024-02-17T14:28:08.664665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659889+0000","last_change":"2024-02-17T14:28:07.846885+0000","last_active":"2024-02-17T14:28:08.659889+0000","last_peered":"2024-02-17T14:28:08.659889+0000","last_clean":"2024-02-17T14:28:08.659889+0000","last_became_active":"2024-02-17T14:28:07.846413+0000","last_became_peered":"2024-02-17T14:28:07.846413+0000","last_unstale":"2024-02-17T14:28:08.659889+0000","last_undegraded":"2024-02-17T14:28:08.659889+0000","last_fullsized":"2024-02-17T14:28:08.659889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:00.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231324+0000","last_change":"2024-02-17T14:28:03.638054+0000","last_active":"2024-02-17T14:28:10.231324+0000","last_peered":"2024-02-17T14:28:10.231324+0000","last_clean":"2024-02-17T14:28:10.231324+0000","last_became_active":"2024-02-17T14:28:03.637831+0000","last_became_peered":"2024-02-17T14:28:03.637831+0000","last_unstale":"2024-02-17T14:28:10.231324+0000","last_undegraded":"2024-02-17T14:28:10.231324+0000","last_fullsized":"2024-02-17T14:28:10.231324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:11:23.521059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231733+0000","last_change":"2024-02-17T14:28:03.064510+0000","last_active":"2024-02-17T14:28:10.231733+0000","last_peered":"2024-02-17T14:28:10.231733+0000","last_clean":"2024-02-17T14:28:10.231733+0000","last_became_active":"2024-02-17T14:28:03.064226+0000","last_became_peered":"2024-02-17T14:28:03.064226+0000","last_unstale":"2024-02-17T14:28:10.231733+0000","last_undegraded":"2024-02-17T14:28:10.231733+0000","last_fullsized":"2024-02-17T14:28:10.231733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:26:19.467344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.666011+0000","last_change":"2024-02-17T14:28:07.849775+0000","last_active":"2024-02-17T14:28:08.666011+0000","last_peered":"2024-02-17T14:28:08.666011+0000","last_clean":"2024-02-17T14:28:08.666011+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:08.666011+0000","last_undegraded":"2024-02-17T14:28:08.666011+0000","last_fullsized":"2024-02-17T14:28:08.666011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653418+0000","last_change":"2024-02-17T14:28:03.642582+0000","last_active":"2024-02-17T14:28:10.653418+0000","last_peered":"2024-02-17T14:28:10.653418+0000","last_clean":"2024-02-17T14:28:10.653418+0000","last_became_active":"2024-02-17T14:28:03.642077+0000","last_became_peered":"2024-02-17T14:28:03.642077+0000","last_unstale":"2024-02-17T14:28:10.653418+0000","last_undegraded":"2024-02-17T14:28:10.653418+0000","last_fullsized":"2024-02-17T14:28:10.653418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:12.644402+0000","last_change":"2024-02-17T14:28:03.071791+0000","last_active":"2024-02-17T14:28:12.644402+0000","last_peered":"2024-02-17T14:28:12.644402+0000","last_clean":"2024-02-17T14:28:12.644402+0000","last_became_active":"2024-02-17T14:28:03.071303+0000","last_became_peered":"2024-02-17T14:28:03.071303+0000","last_unstale":"2024-02-17T14:28:12.644402+0000","last_undegraded":"2024-02-17T14:28:12.644402+0000","last_fullsized":"2024-02-17T14:28:12.644402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008512+0000","last_change":"2024-02-17T14:28:07.649531+0000","last_active":"2024-02-17T14:28:09.008512+0000","last_peered":"2024-02-17T14:28:09.008512+0000","last_clean":"2024-02-17T14:28:09.008512+0000","last_became_active":"2024-02-17T14:28:07.645313+0000","last_became_peered":"2024-02-17T14:28:07.645313+0000","last_unstale":"2024-02-17T14:28:09.008512+0000","last_undegraded":"2024-02-17T14:28:09.008512+0000","last_fullsized":"2024-02-17T14:28:09.008512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664873+0000","last_change":"2024-02-17T14:28:03.638812+0000","last_active":"2024-02-17T14:28:08.664873+0000","last_peered":"2024-02-17T14:28:08.664873+0000","last_clean":"2024-02-17T14:28:08.664873+0000","last_became_active":"2024-02-17T14:28:03.637937+0000","last_became_peered":"2024-02-17T14:28:03.637937+0000","last_unstale":"2024-02-17T14:28:08.664873+0000","last_undegraded":"2024-02-17T14:28:08.664873+0000","last_fullsized":"2024-02-17T14:28:08.664873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008758+0000","last_change":"2024-02-17T14:28:03.069972+0000","last_active":"2024-02-17T14:28:09.008758+0000","last_peered":"2024-02-17T14:28:09.008758+0000","last_clean":"2024-02-17T14:28:09.008758+0000","last_became_active":"2024-02-17T14:28:03.069690+0000","last_became_peered":"2024-02-17T14:28:03.069690+0000","last_unstale":"2024-02-17T14:28:09.008758+0000","last_undegraded":"2024-02-17T14:28:09.008758+0000","last_fullsized":"2024-02-17T14:28:09.008758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665294+0000","last_change":"2024-02-17T14:28:07.647825+0000","last_active":"2024-02-17T14:28:08.665294+0000","last_peered":"2024-02-17T14:28:08.665294+0000","last_clean":"2024-02-17T14:28:08.665294+0000","last_became_active":"2024-02-17T14:28:07.647420+0000","last_became_peered":"2024-02-17T14:28:07.647420+0000","last_unstale":"2024-02-17T14:28:08.665294+0000","last_undegraded":"2024-02-17T14:28:08.665294+0000","last_fullsized":"2024-02-17T14:28:08.665294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231519+0000","last_change":"2024-02-17T14:28:03.631000+0000","last_active":"2024-02-17T14:28:10.231519+0000","last_peered":"2024-02-17T14:28:10.231519+0000","last_clean":"2024-02-17T14:28:10.231519+0000","last_became_active":"2024-02-17T14:28:03.630169+0000","last_became_peered":"2024-02-17T14:28:03.630169+0000","last_unstale":"2024-02-17T14:28:10.231519+0000","last_undegraded":"2024-02-17T14:28:10.231519+0000","last_fullsized":"2024-02-17T14:28:10.231519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665258+0000","last_change":"2024-02-17T14:28:03.069911+0000","last_active":"2024-02-17T14:28:08.665258+0000","last_peered":"2024-02-17T14:28:08.665258+0000","last_clean":"2024-02-17T14:28:08.665258+0000","last_became_active":"2024-02-17T14:28:03.069617+0000","last_became_peered":"2024-02-17T14:28:03.069617+0000","last_unstale":"2024-02-17T14:28:08.665258+0000","last_undegraded":"2024-02-17T14:28:08.665258+0000","last_fullsized":"2024-02-17T14:28:08.665258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659211+0000","last_change":"2024-02-17T14:28:07.646742+0000","last_active":"2024-02-17T14:28:08.659211+0000","last_peered":"2024-02-17T14:28:08.659211+0000","last_clean":"2024-02-17T14:28:08.659211+0000","last_became_active":"2024-02-17T14:28:07.646403+0000","last_became_peered":"2024-02-17T14:28:07.646403+0000","last_unstale":"2024-02-17T14:28:08.659211+0000","last_undegraded":"2024-02-17T14:28:08.659211+0000","last_fullsized":"2024-02-17T14:28:08.659211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665170+0000","last_change":"2024-02-17T14:28:03.638522+0000","last_active":"2024-02-17T14:28:08.665170+0000","last_peered":"2024-02-17T14:28:08.665170+0000","last_clean":"2024-02-17T14:28:08.665170+0000","last_became_active":"2024-02-17T14:28:03.638281+0000","last_became_peered":"2024-02-17T14:28:03.638281+0000","last_unstale":"2024-02-17T14:28:08.665170+0000","last_undegraded":"2024-02-17T14:28:08.665170+0000","last_fullsized":"2024-02-17T14:28:08.665170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200162+0000","last_change":"2024-02-17T14:28:03.072855+0000","last_active":"2024-02-17T14:28:10.200162+0000","last_peered":"2024-02-17T14:28:10.200162+0000","last_clean":"2024-02-17T14:28:10.200162+0000","last_became_active":"2024-02-17T14:28:03.072571+0000","last_became_peered":"2024-02-17T14:28:03.072571+0000","last_unstale":"2024-02-17T14:28:10.200162+0000","last_undegraded":"2024-02-17T14:28:10.200162+0000","last_fullsized":"2024-02-17T14:28:10.200162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659178+0000","last_change":"2024-02-17T14:28:07.849448+0000","last_active":"2024-02-17T14:28:08.659178+0000","last_peered":"2024-02-17T14:28:08.659178+0000","last_clean":"2024-02-17T14:28:08.659178+0000","last_became_active":"2024-02-17T14:28:07.849096+0000","last_became_peered":"2024-02-17T14:28:07.849096+0000","last_unstale":"2024-02-17T14:28:08.659178+0000","last_undegraded":"2024-02-17T14:28:08.659178+0000","last_fullsized":"2024-02-17T14:28:08.659178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231420+0000","last_change":"2024-02-17T14:28:07.849485+0000","last_active":"2024-02-17T14:28:10.231420+0000","last_peered":"2024-02-17T14:28:10.231420+0000","last_clean":"2024-02-17T14:28:10.231420+0000","last_became_active":"2024-02-17T14:28:07.849053+0000","last_became_peered":"2024-02-17T14:28:07.849053+0000","last_unstale":"2024-02-17T14:28:10.231420+0000","last_undegraded":"2024-02-17T14:28:10.231420+0000","last_fullsized":"2024-02-17T14:28:10.231420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008242+0000","last_change":"2024-02-17T14:28:03.632467+0000","last_active":"2024-02-17T14:28:09.008242+0000","last_peered":"2024-02-17T14:28:09.008242+0000","last_clean":"2024-02-17T14:28:09.008242+0000","last_became_active":"2024-02-17T14:28:03.632204+0000","last_became_peered":"2024-02-17T14:28:03.632204+0000","last_unstale":"2024-02-17T14:28:09.008242+0000","last_undegraded":"2024-02-17T14:28:09.008242+0000","last_fullsized":"2024-02-17T14:28:09.008242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664021+0000","last_change":"2024-02-17T14:28:03.062682+0000","last_active":"2024-02-17T14:28:08.664021+0000","last_peered":"2024-02-17T14:28:08.664021+0000","last_clean":"2024-02-17T14:28:08.664021+0000","last_became_active":"2024-02-17T14:28:03.062390+0000","last_became_peered":"2024-02-17T14:28:03.062390+0000","last_unstale":"2024-02-17T14:28:08.664021+0000","last_undegraded":"2024-02-17T14:28:08.664021+0000","last_fullsized":"2024-02-17T14:28:08.664021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200129+0000","last_change":"2024-02-17T14:28:07.651004+0000","last_active":"2024-02-17T14:28:10.200129+0000","last_peered":"2024-02-17T14:28:10.200129+0000","last_clean":"2024-02-17T14:28:10.200129+0000","last_became_active":"2024-02-17T14:28:07.650627+0000","last_became_peered":"2024-02-17T14:28:07.650627+0000","last_unstale":"2024-02-17T14:28:10.200129+0000","last_undegraded":"2024-02-17T14:28:10.200129+0000","last_fullsized":"2024-02-17T14:28:10.200129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659217+0000","last_change":"2024-02-17T14:28:03.627978+0000","last_active":"2024-02-17T14:28:08.659217+0000","last_peered":"2024-02-17T14:28:08.659217+0000","last_clean":"2024-02-17T14:28:08.659217+0000","last_became_active":"2024-02-17T14:28:03.627708+0000","last_became_peered":"2024-02-17T14:28:03.627708+0000","last_unstale":"2024-02-17T14:28:08.659217+0000","last_undegraded":"2024-02-17T14:28:08.659217+0000","last_fullsized":"2024-02-17T14:28:08.659217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659359+0000","last_change":"2024-02-17T14:28:03.071479+0000","last_active":"2024-02-17T14:28:08.659359+0000","last_peered":"2024-02-17T14:28:08.659359+0000","last_clean":"2024-02-17T14:28:08.659359+0000","last_became_active":"2024-02-17T14:28:03.071170+0000","last_became_peered":"2024-02-17T14:28:03.071170+0000","last_unstale":"2024-02-17T14:28:08.659359+0000","last_undegraded":"2024-02-17T14:28:08.659359+0000","last_fullsized":"2024-02-17T14:28:08.659359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:03:44.733125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199746+0000","last_change":"2024-02-17T14:28:03.073225+0000","last_active":"2024-02-17T14:28:10.199746+0000","last_peered":"2024-02-17T14:28:10.199746+0000","last_clean":"2024-02-17T14:28:10.199746+0000","last_became_active":"2024-02-17T14:28:03.072928+0000","last_became_peered":"2024-02-17T14:28:03.072928+0000","last_unstale":"2024-02-17T14:28:10.199746+0000","last_undegraded":"2024-02-17T14:28:10.199746+0000","last_fullsized":"2024-02-17T14:28:10.199746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231675+0000","last_change":"2024-02-17T14:28:03.635534+0000","last_active":"2024-02-17T14:28:10.231675+0000","last_peered":"2024-02-17T14:28:10.231675+0000","last_clean":"2024-02-17T14:28:10.231675+0000","last_became_active":"2024-02-17T14:28:03.635362+0000","last_became_peered":"2024-02-17T14:28:03.635362+0000","last_unstale":"2024-02-17T14:28:10.231675+0000","last_undegraded":"2024-02-17T14:28:10.231675+0000","last_fullsized":"2024-02-17T14:28:10.231675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952161+0000","last_change":"2024-02-17T14:28:07.645087+0000","last_active":"2024-02-17T14:28:08.952161+0000","last_peered":"2024-02-17T14:28:08.952161+0000","last_clean":"2024-02-17T14:28:08.952161+0000","last_became_active":"2024-02-17T14:28:07.644637+0000","last_became_peered":"2024-02-17T14:28:07.644637+0000","last_unstale":"2024-02-17T14:28:08.952161+0000","last_undegraded":"2024-02-17T14:28:08.952161+0000","last_fullsized":"2024-02-17T14:28:08.952161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:39.175950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659718+0000","last_change":"2024-02-17T14:28:03.072162+0000","last_active":"2024-02-17T14:28:08.659718+0000","last_peered":"2024-02-17T14:28:08.659718+0000","last_clean":"2024-02-17T14:28:08.659718+0000","last_became_active":"2024-02-17T14:28:03.071112+0000","last_became_peered":"2024-02-17T14:28:03.071112+0000","last_unstale":"2024-02-17T14:28:08.659718+0000","last_undegraded":"2024-02-17T14:28:08.659718+0000","last_fullsized":"2024-02-17T14:28:08.659718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665058+0000","last_change":"2024-02-17T14:28:03.628403+0000","last_active":"2024-02-17T14:28:08.665058+0000","last_peered":"2024-02-17T14:28:08.665058+0000","last_clean":"2024-02-17T14:28:08.665058+0000","last_became_active":"2024-02-17T14:28:03.628144+0000","last_became_peered":"2024-02-17T14:28:03.628144+0000","last_unstale":"2024-02-17T14:28:08.665058+0000","last_undegraded":"2024-02-17T14:28:08.665058+0000","last_fullsized":"2024-02-17T14:28:08.665058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:01.247136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659662+0000","last_change":"2024-02-17T14:28:07.648376+0000","last_active":"2024-02-17T14:28:08.659662+0000","last_peered":"2024-02-17T14:28:08.659662+0000","last_clean":"2024-02-17T14:28:08.659662+0000","last_became_active":"2024-02-17T14:28:07.647491+0000","last_became_peered":"2024-02-17T14:28:07.647491+0000","last_unstale":"2024-02-17T14:28:08.659662+0000","last_undegraded":"2024-02-17T14:28:08.659662+0000","last_fullsized":"2024-02-17T14:28:08.659662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:12.810441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199485+0000","last_change":"2024-02-17T14:28:03.631191+0000","last_active":"2024-02-17T14:28:10.199485+0000","last_peered":"2024-02-17T14:28:10.199485+0000","last_clean":"2024-02-17T14:28:10.199485+0000","last_became_active":"2024-02-17T14:28:03.630662+0000","last_became_peered":"2024-02-17T14:28:03.630662+0000","last_unstale":"2024-02-17T14:28:10.199485+0000","last_undegraded":"2024-02-17T14:28:10.199485+0000","last_fullsized":"2024-02-17T14:28:10.199485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952028+0000","last_change":"2024-02-17T14:28:03.629028+0000","last_active":"2024-02-17T14:28:08.952028+0000","last_peered":"2024-02-17T14:28:08.952028+0000","last_clean":"2024-02-17T14:28:08.952028+0000","last_became_active":"2024-02-17T14:28:03.628781+0000","last_became_peered":"2024-02-17T14:28:03.628781+0000","last_unstale":"2024-02-17T14:28:08.952028+0000","last_undegraded":"2024-02-17T14:28:08.952028+0000","last_fullsized":"2024-02-17T14:28:08.952028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664578+0000","last_change":"2024-02-17T14:28:03.633531+0000","last_active":"2024-02-17T14:28:08.664578+0000","last_peered":"2024-02-17T14:28:08.664578+0000","last_clean":"2024-02-17T14:28:08.664578+0000","last_became_active":"2024-02-17T14:28:03.633248+0000","last_became_peered":"2024-02-17T14:28:03.633248+0000","last_unstale":"2024-02-17T14:28:08.664578+0000","last_undegraded":"2024-02-17T14:28:08.664578+0000","last_fullsized":"2024-02-17T14:28:08.664578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231592+0000","last_change":"2024-02-17T14:28:03.627122+0000","last_active":"2024-02-17T14:28:10.231592+0000","last_peered":"2024-02-17T14:28:10.231592+0000","last_clean":"2024-02-17T14:28:10.231592+0000","last_became_active":"2024-02-17T14:28:03.626738+0000","last_became_peered":"2024-02-17T14:28:03.626738+0000","last_unstale":"2024-02-17T14:28:10.231592+0000","last_undegraded":"2024-02-17T14:28:10.231592+0000","last_fullsized":"2024-02-17T14:28:10.231592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659986+0000","last_change":"2024-02-17T14:28:03.631182+0000","last_active":"2024-02-17T14:28:08.659986+0000","last_peered":"2024-02-17T14:28:08.659986+0000","last_clean":"2024-02-17T14:28:08.659986+0000","last_became_active":"2024-02-17T14:28:03.630705+0000","last_became_peered":"2024-02-17T14:28:03.630705+0000","last_unstale":"2024-02-17T14:28:08.659986+0000","last_undegraded":"2024-02-17T14:28:08.659986+0000","last_fullsized":"2024-02-17T14:28:08.659986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008574+0000","last_change":"2024-02-17T14:28:03.631731+0000","last_active":"2024-02-17T14:28:09.008574+0000","last_peered":"2024-02-17T14:28:09.008574+0000","last_clean":"2024-02-17T14:28:09.008574+0000","last_became_active":"2024-02-17T14:28:03.631476+0000","last_became_peered":"2024-02-17T14:28:03.631476+0000","last_unstale":"2024-02-17T14:28:09.008574+0000","last_undegraded":"2024-02-17T14:28:09.008574+0000","last_fullsized":"2024-02-17T14:28:09.008574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200191+0000","last_change":"2024-02-17T14:28:03.638716+0000","last_active":"2024-02-17T14:28:10.200191+0000","last_peered":"2024-02-17T14:28:10.200191+0000","last_clean":"2024-02-17T14:28:10.200191+0000","last_became_active":"2024-02-17T14:28:03.638442+0000","last_became_peered":"2024-02-17T14:28:03.638442+0000","last_unstale":"2024-02-17T14:28:10.200191+0000","last_undegraded":"2024-02-17T14:28:10.200191+0000","last_fullsized":"2024-02-17T14:28:10.200191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659705+0000","last_change":"2024-02-17T14:28:03.630945+0000","last_active":"2024-02-17T14:28:08.659705+0000","last_peered":"2024-02-17T14:28:08.659705+0000","last_clean":"2024-02-17T14:28:08.659705+0000","last_became_active":"2024-02-17T14:28:03.630676+0000","last_became_peered":"2024-02-17T14:28:03.630676+0000","last_unstale":"2024-02-17T14:28:08.659705+0000","last_undegraded":"2024-02-17T14:28:08.659705+0000","last_fullsized":"2024-02-17T14:28:08.659705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664109+0000","last_change":"2024-02-17T14:28:03.627202+0000","last_active":"2024-02-17T14:28:08.664109+0000","last_peered":"2024-02-17T14:28:08.664109+0000","last_clean":"2024-02-17T14:28:08.664109+0000","last_became_active":"2024-02-17T14:28:03.626848+0000","last_became_peered":"2024-02-17T14:28:03.626848+0000","last_unstale":"2024-02-17T14:28:08.664109+0000","last_undegraded":"2024-02-17T14:28:08.664109+0000","last_fullsized":"2024-02-17T14:28:08.664109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659335+0000","last_change":"2024-02-17T14:28:03.627493+0000","last_active":"2024-02-17T14:28:08.659335+0000","last_peered":"2024-02-17T14:28:08.659335+0000","last_clean":"2024-02-17T14:28:08.659335+0000","last_became_active":"2024-02-17T14:28:03.626450+0000","last_became_peered":"2024-02-17T14:28:03.626450+0000","last_unstale":"2024-02-17T14:28:08.659335+0000","last_undegraded":"2024-02-17T14:28:08.659335+0000","last_fullsized":"2024-02-17T14:28:08.659335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664490+0000","last_change":"2024-02-17T14:28:03.639610+0000","last_active":"2024-02-17T14:28:08.664490+0000","last_peered":"2024-02-17T14:28:08.664490+0000","last_clean":"2024-02-17T14:28:08.664490+0000","last_became_active":"2024-02-17T14:28:03.639330+0000","last_became_peered":"2024-02-17T14:28:03.639330+0000","last_unstale":"2024-02-17T14:28:08.664490+0000","last_undegraded":"2024-02-17T14:28:08.664490+0000","last_fullsized":"2024-02-17T14:28:08.664490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231482+0000","last_change":"2024-02-17T14:28:03.641774+0000","last_active":"2024-02-17T14:28:10.231482+0000","last_peered":"2024-02-17T14:28:10.231482+0000","last_clean":"2024-02-17T14:28:10.231482+0000","last_became_active":"2024-02-17T14:28:03.641485+0000","last_became_peered":"2024-02-17T14:28:03.641485+0000","last_unstale":"2024-02-17T14:28:10.231482+0000","last_undegraded":"2024-02-17T14:28:10.231482+0000","last_fullsized":"2024-02-17T14:28:10.231482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199910+0000","last_change":"2024-02-17T14:28:03.630129+0000","last_active":"2024-02-17T14:28:10.199910+0000","last_peered":"2024-02-17T14:28:10.199910+0000","last_clean":"2024-02-17T14:28:10.199910+0000","last_became_active":"2024-02-17T14:28:03.629841+0000","last_became_peered":"2024-02-17T14:28:03.629841+0000","last_unstale":"2024-02-17T14:28:10.199910+0000","last_undegraded":"2024-02-17T14:28:10.199910+0000","last_fullsized":"2024-02-17T14:28:10.199910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653773+0000","last_change":"2024-02-17T14:28:03.642676+0000","last_active":"2024-02-17T14:28:10.653773+0000","last_peered":"2024-02-17T14:28:10.653773+0000","last_clean":"2024-02-17T14:28:10.653773+0000","last_became_active":"2024-02-17T14:28:03.642150+0000","last_became_peered":"2024-02-17T14:28:03.642150+0000","last_unstale":"2024-02-17T14:28:10.653773+0000","last_undegraded":"2024-02-17T14:28:10.653773+0000","last_fullsized":"2024-02-17T14:28:10.653773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952216+0000","last_change":"2024-02-17T14:28:03.632127+0000","last_active":"2024-02-17T14:28:08.952216+0000","last_peered":"2024-02-17T14:28:08.952216+0000","last_clean":"2024-02-17T14:28:08.952216+0000","last_became_active":"2024-02-17T14:28:03.631844+0000","last_became_peered":"2024-02-17T14:28:03.631844+0000","last_unstale":"2024-02-17T14:28:08.952216+0000","last_undegraded":"2024-02-17T14:28:08.952216+0000","last_fullsized":"2024-02-17T14:28:08.952216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:07.756422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665733+0000","last_change":"2024-02-17T14:28:03.638703+0000","last_active":"2024-02-17T14:28:08.665733+0000","last_peered":"2024-02-17T14:28:08.665733+0000","last_clean":"2024-02-17T14:28:08.665733+0000","last_became_active":"2024-02-17T14:28:03.638427+0000","last_became_peered":"2024-02-17T14:28:03.638427+0000","last_unstale":"2024-02-17T14:28:08.665733+0000","last_undegraded":"2024-02-17T14:28:08.665733+0000","last_fullsized":"2024-02-17T14:28:08.665733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.663890+0000","last_change":"2024-02-17T14:28:03.628626+0000","last_active":"2024-02-17T14:28:08.663890+0000","last_peered":"2024-02-17T14:28:08.663890+0000","last_clean":"2024-02-17T14:28:08.663890+0000","last_became_active":"2024-02-17T14:28:03.628343+0000","last_became_peered":"2024-02-17T14:28:03.628343+0000","last_unstale":"2024-02-17T14:28:08.663890+0000","last_undegraded":"2024-02-17T14:28:08.663890+0000","last_fullsized":"2024-02-17T14:28:08.663890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008316+0000","last_change":"2024-02-17T14:28:03.635610+0000","last_active":"2024-02-17T14:28:09.008316+0000","last_peered":"2024-02-17T14:28:09.008316+0000","last_clean":"2024-02-17T14:28:09.008316+0000","last_became_active":"2024-02-17T14:28:03.635340+0000","last_became_peered":"2024-02-17T14:28:03.635340+0000","last_unstale":"2024-02-17T14:28:09.008316+0000","last_undegraded":"2024-02-17T14:28:09.008316+0000","last_fullsized":"2024-02-17T14:28:09.008316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231274+0000","last_change":"2024-02-17T14:28:03.632540+0000","last_active":"2024-02-17T14:28:10.231274+0000","last_peered":"2024-02-17T14:28:10.231274+0000","last_clean":"2024-02-17T14:28:10.231274+0000","last_became_active":"2024-02-17T14:28:03.632273+0000","last_became_peered":"2024-02-17T14:28:03.632273+0000","last_unstale":"2024-02-17T14:28:10.231274+0000","last_undegraded":"2024-02-17T14:28:10.231274+0000","last_fullsized":"2024-02-17T14:28:10.231274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:35.598281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659538+0000","last_change":"2024-02-17T14:28:03.631678+0000","last_active":"2024-02-17T14:28:08.659538+0000","last_peered":"2024-02-17T14:28:08.659538+0000","last_clean":"2024-02-17T14:28:08.659538+0000","last_became_active":"2024-02-17T14:28:03.631431+0000","last_became_peered":"2024-02-17T14:28:03.631431+0000","last_unstale":"2024-02-17T14:28:08.659538+0000","last_undegraded":"2024-02-17T14:28:08.659538+0000","last_fullsized":"2024-02-17T14:28:08.659538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664773+0000","last_change":"2024-02-17T14:28:03.631661+0000","last_active":"2024-02-17T14:28:08.664773+0000","last_peered":"2024-02-17T14:28:08.664773+0000","last_clean":"2024-02-17T14:28:08.664773+0000","last_became_active":"2024-02-17T14:28:03.631379+0000","last_became_peered":"2024-02-17T14:28:03.631379+0000","last_unstale":"2024-02-17T14:28:08.664773+0000","last_undegraded":"2024-02-17T14:28:08.664773+0000","last_fullsized":"2024-02-17T14:28:08.664773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:03.242976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199968+0000","last_change":"2024-02-17T14:28:03.635522+0000","last_active":"2024-02-17T14:28:10.199968+0000","last_peered":"2024-02-17T14:28:10.199968+0000","last_clean":"2024-02-17T14:28:10.199968+0000","last_became_active":"2024-02-17T14:28:03.635254+0000","last_became_peered":"2024-02-17T14:28:03.635254+0000","last_unstale":"2024-02-17T14:28:10.199968+0000","last_undegraded":"2024-02-17T14:28:10.199968+0000","last_fullsized":"2024-02-17T14:28:10.199968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200179+0000","last_change":"2024-02-17T14:28:03.635588+0000","last_active":"2024-02-17T14:28:10.200179+0000","last_peered":"2024-02-17T14:28:10.200179+0000","last_clean":"2024-02-17T14:28:10.200179+0000","last_became_active":"2024-02-17T14:28:03.635312+0000","last_became_peered":"2024-02-17T14:28:03.635312+0000","last_unstale":"2024-02-17T14:28:10.200179+0000","last_undegraded":"2024-02-17T14:28:10.200179+0000","last_fullsized":"2024-02-17T14:28:10.200179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653775+0000","last_change":"2024-02-17T14:28:03.646624+0000","last_active":"2024-02-17T14:28:10.653775+0000","last_peered":"2024-02-17T14:28:10.653775+0000","last_clean":"2024-02-17T14:28:10.653775+0000","last_became_active":"2024-02-17T14:28:03.646337+0000","last_became_peered":"2024-02-17T14:28:03.646337+0000","last_unstale":"2024-02-17T14:28:10.653775+0000","last_undegraded":"2024-02-17T14:28:10.653775+0000","last_fullsized":"2024-02-17T14:28:10.653775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:10.836577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659106+0000","last_change":"2024-02-17T14:28:03.635018+0000","last_active":"2024-02-17T14:28:08.659106+0000","last_peered":"2024-02-17T14:28:08.659106+0000","last_clean":"2024-02-17T14:28:08.659106+0000","last_became_active":"2024-02-17T14:28:03.634751+0000","last_became_peered":"2024-02-17T14:28:03.634751+0000","last_unstale":"2024-02-17T14:28:08.659106+0000","last_undegraded":"2024-02-17T14:28:08.659106+0000","last_fullsized":"2024-02-17T14:28:08.659106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653292+0000","last_change":"2024-02-17T14:28:03.641708+0000","last_active":"2024-02-17T14:28:10.653292+0000","last_peered":"2024-02-17T14:28:10.653292+0000","last_clean":"2024-02-17T14:28:10.653292+0000","last_became_active":"2024-02-17T14:28:03.641260+0000","last_became_peered":"2024-02-17T14:28:03.641260+0000","last_unstale":"2024-02-17T14:28:10.653292+0000","last_undegraded":"2024-02-17T14:28:10.653292+0000","last_fullsized":"2024-02-17T14:28:10.653292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664400+0000","last_change":"2024-02-17T14:28:03.628239+0000","last_active":"2024-02-17T14:28:08.664400+0000","last_peered":"2024-02-17T14:28:08.664400+0000","last_clean":"2024-02-17T14:28:08.664400+0000","last_became_active":"2024-02-17T14:28:03.627918+0000","last_became_peered":"2024-02-17T14:28:03.627918+0000","last_unstale":"2024-02-17T14:28:08.664400+0000","last_undegraded":"2024-02-17T14:28:08.664400+0000","last_fullsized":"2024-02-17T14:28:08.664400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653391+0000","last_change":"2024-02-17T14:28:03.641192+0000","last_active":"2024-02-17T14:28:10.653391+0000","last_peered":"2024-02-17T14:28:10.653391+0000","last_clean":"2024-02-17T14:28:10.653391+0000","last_became_active":"2024-02-17T14:28:03.640873+0000","last_became_peered":"2024-02-17T14:28:03.640873+0000","last_unstale":"2024-02-17T14:28:10.653391+0000","last_undegraded":"2024-02-17T14:28:10.653391+0000","last_fullsized":"2024-02-17T14:28:10.653391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664766+0000","last_change":"2024-02-17T14:28:03.634770+0000","last_active":"2024-02-17T14:28:08.664766+0000","last_peered":"2024-02-17T14:28:08.664766+0000","last_clean":"2024-02-17T14:28:08.664766+0000","last_became_active":"2024-02-17T14:28:03.634397+0000","last_became_peered":"2024-02-17T14:28:03.634397+0000","last_unstale":"2024-02-17T14:28:08.664766+0000","last_undegraded":"2024-02-17T14:28:08.664766+0000","last_fullsized":"2024-02-17T14:28:08.664766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:38.398272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231407+0000","last_change":"2024-02-17T14:28:03.628223+0000","last_active":"2024-02-17T14:28:10.231407+0000","last_peered":"2024-02-17T14:28:10.231407+0000","last_clean":"2024-02-17T14:28:10.231407+0000","last_became_active":"2024-02-17T14:28:03.627978+0000","last_became_peered":"2024-02-17T14:28:03.627978+0000","last_unstale":"2024-02-17T14:28:10.231407+0000","last_undegraded":"2024-02-17T14:28:10.231407+0000","last_fullsized":"2024-02-17T14:28:10.231407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008914+0000","last_change":"2024-02-17T14:28:03.631742+0000","last_active":"2024-02-17T14:28:09.008914+0000","last_peered":"2024-02-17T14:28:09.008914+0000","last_clean":"2024-02-17T14:28:09.008914+0000","last_became_active":"2024-02-17T14:28:03.631493+0000","last_became_peered":"2024-02-17T14:28:03.631493+0000","last_unstale":"2024-02-17T14:28:09.008914+0000","last_undegraded":"2024-02-17T14:28:09.008914+0000","last_fullsized":"2024-02-17T14:28:09.008914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653565+0000","last_change":"2024-02-17T14:28:03.641525+0000","last_active":"2024-02-17T14:28:10.653565+0000","last_peered":"2024-02-17T14:28:10.653565+0000","last_clean":"2024-02-17T14:28:10.653565+0000","last_became_active":"2024-02-17T14:28:03.641154+0000","last_became_peered":"2024-02-17T14:28:03.641154+0000","last_unstale":"2024-02-17T14:28:10.653565+0000","last_undegraded":"2024-02-17T14:28:10.653565+0000","last_fullsized":"2024-02-17T14:28:10.653565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":695877,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":695933,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T14:28:25.647 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T14:28:25.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.781+0000 7fb0f7081640 1 Processor -- start 2024-02-17T14:28:25.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.781+0000 7fb0f7081640 1 -- start start 2024-02-17T14:28:25.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f7081640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0f009b3f0 0x7fb0f00b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f7081640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0f014f7b0 0x7fb0f0151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f7081640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f006b530 con 0x7fb0f0146f20 2024-02-17T14:28:25.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f7081640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f00b85e0 con 0x7fb0f009b3f0 2024-02-17T14:28:25.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f7081640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f009b7d0 con 0x7fb0f014f7b0 2024-02-17T14:28:25.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f4e1d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0f009b3f0 0x7fb0f00b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f4e1d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0f009b3f0 0x7fb0f00b6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46060/0 (socket says 172.21.15.134:46060) 2024-02-17T14:28:25.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f4e1d640 1 -- 172.21.15.134:0/940965760 learned_addr learned my addr 172.21.15.134:0/940965760 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:25.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f561e640 1 --2- 172.21.15.134:0/940965760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0f014f7b0 0x7fb0f0151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f4e1d640 1 -- 172.21.15.134:0/940965760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0f014f7b0 msgr2=0x7fb0f0151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:25.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f4e1d640 1 --2- 172.21.15.134:0/940965760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0f014f7b0 0x7fb0f0151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f4e1d640 1 -- 172.21.15.134:0/940965760 >> v1:172.21.15.142:6789/0 conn(0x7fb0f0146f20 legacy=0x7fb0f0147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:25.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f4e1d640 1 -- 172.21.15.134:0/940965760 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f006af00 con 0x7fb0f009b3f0 2024-02-17T14:28:25.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.782+0000 7fb0f561e640 1 --2- 172.21.15.134:0/940965760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0f014f7b0 0x7fb0f0151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:25.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.783+0000 7fb0f4e1d640 1 --2- 172.21.15.134:0/940965760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f009b3f0 0x7fb0f00b6fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009870 tx=0x7fb0e802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01c731f5724d562 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:25.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.783+0000 7fb0ef7fe640 1 -- 172.21.15.134:0/940965760 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8031640 con 0x7fb0f009b3f0 2024-02-17T14:28:25.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.783+0000 7fb0ef7fe640 1 -- 172.21.15.134:0/940965760 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e80317a0 con 0x7fb0f009b3f0 2024-02-17T14:28:25.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.783+0000 7fb0ef7fe640 1 -- 172.21.15.134:0/940965760 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8031b30 con 0x7fb0f009b3f0 2024-02-17T14:28:25.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.783+0000 7fb0f7081640 1 -- 172.21.15.134:0/940965760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f009b3f0 msgr2=0x7fb0f00b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.783+0000 7fb0f7081640 1 --2- 172.21.15.134:0/940965760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f009b3f0 0x7fb0f00b6fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009870 tx=0x7fb0e802b8f0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.783+0000 7fb0f7081640 1 -- 172.21.15.134:0/940965760 shutdown_connections 2024-02-17T14:28:25.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.783+0000 7fb0f7081640 1 --2- 172.21.15.134:0/940965760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0f014f7b0 0x7fb0f0151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.783+0000 7fb0f7081640 1 --2- 172.21.15.134:0/940965760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f009b3f0 0x7fb0f00b6fb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.783+0000 7fb0f7081640 1 -- 172.21.15.134:0/940965760 >> 172.21.15.134:0/940965760 conn(0x7fb0f00bc630 msgr2=0x7fb0f00bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:25.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.784+0000 7fb0f7081640 1 -- 172.21.15.134:0/940965760 shutdown_connections 2024-02-17T14:28:25.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.784+0000 7fb0f7081640 1 -- 172.21.15.134:0/940965760 wait complete. 2024-02-17T14:28:25.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.784+0000 7fb0f7081640 1 Processor -- start 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.785+0000 7fb0f7081640 1 -- start start 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.785+0000 7fb0f7081640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f009b3f0 0x7fb0f00b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.785+0000 7fb0f7081640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f0146f20 0x7fb0f01dd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.785+0000 7fb0f7081640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0f014f7b0 0x7fb0f01dd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.785+0000 7fb0f7081640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f0141c90 con 0x7fb0f009b3f0 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.785+0000 7fb0f7081640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f01e1390 con 0x7fb0f0146f20 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.785+0000 7fb0f7081640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f01e0ac0 con 0x7fb0f014f7b0 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.785+0000 7fb0f4e1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f009b3f0 0x7fb0f00b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.785+0000 7fb0f4e1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f009b3f0 0x7fb0f00b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46070/0 (socket says 172.21.15.134:46070) 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.785+0000 7fb0f4e1d640 1 -- 172.21.15.134:0/2131331016 learned_addr learned my addr 172.21.15.134:0/2131331016 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0f561e640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0f014f7b0 0x7fb0f01dd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0effff640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f0146f20 0x7fb0f01dd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0f4e1d640 1 -- 172.21.15.134:0/2131331016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0f014f7b0 msgr2=0x7fb0f01dd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0f4e1d640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0f014f7b0 0x7fb0f01dd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0f4e1d640 1 -- 172.21.15.134:0/2131331016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f0146f20 msgr2=0x7fb0f01dd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0f4e1d640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f0146f20 0x7fb0f01dd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0f4e1d640 1 -- 172.21.15.134:0/2131331016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80094d0 con 0x7fb0f009b3f0 2024-02-17T14:28:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0effff640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f0146f20 0x7fb0f01dd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0f561e640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0f014f7b0 0x7fb0f01dd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0f4e1d640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f009b3f0 0x7fb0f00b3ba0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8000c00 tx=0x7fb0e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0ed7fa640 1 -- 172.21.15.134:0/2131331016 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e803ac60 con 0x7fb0f009b3f0 2024-02-17T14:28:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0ed7fa640 1 -- 172.21.15.134:0/2131331016 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e803ade0 con 0x7fb0f009b3f0 2024-02-17T14:28:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0f7081640 1 -- 172.21.15.134:0/2131331016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f0142340 con 0x7fb0f009b3f0 2024-02-17T14:28:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0ed7fa640 1 -- 172.21.15.134:0/2131331016 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8044630 con 0x7fb0f009b3f0 2024-02-17T14:28:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.786+0000 7fb0f7081640 1 -- 172.21.15.134:0/2131331016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f01e1020 con 0x7fb0f009b3f0 2024-02-17T14:28:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.787+0000 7fb0f7081640 1 -- 172.21.15.134:0/2131331016 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f0067b70 con 0x7fb0f009b3f0 2024-02-17T14:28:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.787+0000 7fb0ed7fa640 1 -- 172.21.15.134:0/2131331016 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb0e802f050 con 0x7fb0f009b3f0 2024-02-17T14:28:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.788+0000 7fb0ed7fa640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb0d006b840 0x7fb0d006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.788+0000 7fb0effff640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb0d006b840 0x7fb0d006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.788+0000 7fb0ed7fa640 1 -- 172.21.15.134:0/2131331016 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb0e80ac5a0 con 0x7fb0f009b3f0 2024-02-17T14:28:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.788+0000 7fb0effff640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb0d006b840 0x7fb0d006dd00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0146970 tx=0x7fb0e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:25.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.793+0000 7fb0ed7fa640 1 -- 172.21.15.134:0/2131331016 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb0e8076d10 con 0x7fb0f009b3f0 2024-02-17T14:28:25.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.959+0000 7fb0f7081640 1 -- 172.21.15.134:0/2131331016 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0f00b8d50 con 0x7fb0d006b840 2024-02-17T14:28:25.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.967+0000 7fb0ed7fa640 1 -- 172.21.15.134:0/2131331016 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345395 (secure 0 0 0) 0x7fb0e0004970 con 0x7fb0d006b840 2024-02-17T14:28:25.971 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:25.973 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-02-17T14:28:25.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.970+0000 7fb0f7081640 1 -- 172.21.15.134:0/2131331016 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb0d006b840 msgr2=0x7fb0d006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.970+0000 7fb0f7081640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb0d006b840 0x7fb0d006dd00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0146970 tx=0x7fb0e0009040 comp rx=0 tx=0).stop 2024-02-17T14:28:25.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.970+0000 7fb0f7081640 1 -- 172.21.15.134:0/2131331016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f009b3f0 msgr2=0x7fb0f00b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:25.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.970+0000 7fb0f7081640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f009b3f0 0x7fb0f00b3ba0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8000c00 tx=0x7fb0e80046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.970+0000 7fb0f7081640 1 -- 172.21.15.134:0/2131331016 shutdown_connections 2024-02-17T14:28:25.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.970+0000 7fb0f7081640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0f014f7b0 0x7fb0f01dd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.971+0000 7fb0f7081640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0f0146f20 0x7fb0f01dd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.971+0000 7fb0f7081640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb0d006b840 0x7fb0d006dd00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.971+0000 7fb0f7081640 1 --2- 172.21.15.134:0/2131331016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0f009b3f0 0x7fb0f00b3ba0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:25.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.971+0000 7fb0f7081640 1 -- 172.21.15.134:0/2131331016 >> 172.21.15.134:0/2131331016 conn(0x7fb0f00bc630 msgr2=0x7fb0f0147380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:25.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.971+0000 7fb0f7081640 1 -- 172.21.15.134:0/2131331016 shutdown_connections 2024-02-17T14:28:25.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:25.971+0000 7fb0f7081640 1 -- 172.21.15.134:0/2131331016 wait complete. 2024-02-17T14:28:25.982 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-02-17T14:28:24.564547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218448,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756272,"statfs":{"total":773094113280,"available":772870422528,"internally_reserved":0,"allocated":2326528,"data_stored":2029432,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003100"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231617+0000","last_change":"2024-02-17T14:28:03.069069+0000","last_active":"2024-02-17T14:28:10.231617+0000","last_peered":"2024-02-17T14:28:10.231617+0000","last_clean":"2024-02-17T14:28:10.231617+0000","last_became_active":"2024-02-17T14:28:03.068714+0000","last_became_peered":"2024-02-17T14:28:03.068714+0000","last_unstale":"2024-02-17T14:28:10.231617+0000","last_undegraded":"2024-02-17T14:28:10.231617+0000","last_fullsized":"2024-02-17T14:28:10.231617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:49:37.606508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659580+0000","last_change":"2024-02-17T14:28:03.633277+0000","last_active":"2024-02-17T14:28:08.659580+0000","last_peered":"2024-02-17T14:28:08.659580+0000","last_clean":"2024-02-17T14:28:08.659580+0000","last_became_active":"2024-02-17T14:28:03.631462+0000","last_became_peered":"2024-02-17T14:28:03.631462+0000","last_unstale":"2024-02-17T14:28:08.659580+0000","last_undegraded":"2024-02-17T14:28:08.659580+0000","last_fullsized":"2024-02-17T14:28:08.659580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659129+0000","last_change":"2024-02-17T14:28:07.850214+0000","last_active":"2024-02-17T14:28:08.659129+0000","last_peered":"2024-02-17T14:28:08.659129+0000","last_clean":"2024-02-17T14:28:08.659129+0000","last_became_active":"2024-02-17T14:28:07.849871+0000","last_became_peered":"2024-02-17T14:28:07.849871+0000","last_unstale":"2024-02-17T14:28:08.659129+0000","last_undegraded":"2024-02-17T14:28:08.659129+0000","last_fullsized":"2024-02-17T14:28:08.659129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:46:12.614434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659755+0000","last_change":"2024-02-17T14:28:03.069234+0000","last_active":"2024-02-17T14:28:08.659755+0000","last_peered":"2024-02-17T14:28:08.659755+0000","last_clean":"2024-02-17T14:28:08.659755+0000","last_became_active":"2024-02-17T14:28:03.068978+0000","last_became_peered":"2024-02-17T14:28:03.068978+0000","last_unstale":"2024-02-17T14:28:08.659755+0000","last_undegraded":"2024-02-17T14:28:08.659755+0000","last_fullsized":"2024-02-17T14:28:08.659755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231420+0000","last_change":"2024-02-17T14:28:03.630763+0000","last_active":"2024-02-17T14:28:10.231420+0000","last_peered":"2024-02-17T14:28:10.231420+0000","last_clean":"2024-02-17T14:28:10.231420+0000","last_became_active":"2024-02-17T14:28:03.630517+0000","last_became_peered":"2024-02-17T14:28:03.630517+0000","last_unstale":"2024-02-17T14:28:10.231420+0000","last_undegraded":"2024-02-17T14:28:10.231420+0000","last_fullsized":"2024-02-17T14:28:10.231420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664338+0000","last_change":"2024-02-17T14:28:07.644982+0000","last_active":"2024-02-17T14:28:08.664338+0000","last_peered":"2024-02-17T14:28:08.664338+0000","last_clean":"2024-02-17T14:28:08.664338+0000","last_became_active":"2024-02-17T14:28:07.644458+0000","last_became_peered":"2024-02-17T14:28:07.644458+0000","last_unstale":"2024-02-17T14:28:08.664338+0000","last_undegraded":"2024-02-17T14:28:08.664338+0000","last_fullsized":"2024-02-17T14:28:08.664338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:42.133618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653761+0000","last_change":"2024-02-17T14:28:03.071236+0000","last_active":"2024-02-17T14:28:10.653761+0000","last_peered":"2024-02-17T14:28:10.653761+0000","last_clean":"2024-02-17T14:28:10.653761+0000","last_became_active":"2024-02-17T14:28:03.070955+0000","last_became_peered":"2024-02-17T14:28:03.070955+0000","last_unstale":"2024-02-17T14:28:10.653761+0000","last_undegraded":"2024-02-17T14:28:10.653761+0000","last_fullsized":"2024-02-17T14:28:10.653761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664873+0000","last_change":"2024-02-17T14:28:03.628182+0000","last_active":"2024-02-17T14:28:08.664873+0000","last_peered":"2024-02-17T14:28:08.664873+0000","last_clean":"2024-02-17T14:28:08.664873+0000","last_became_active":"2024-02-17T14:28:03.627865+0000","last_became_peered":"2024-02-17T14:28:03.627865+0000","last_unstale":"2024-02-17T14:28:08.664873+0000","last_undegraded":"2024-02-17T14:28:08.664873+0000","last_fullsized":"2024-02-17T14:28:08.664873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665230+0000","last_change":"2024-02-17T14:28:07.649384+0000","last_active":"2024-02-17T14:28:08.665230+0000","last_peered":"2024-02-17T14:28:08.665230+0000","last_clean":"2024-02-17T14:28:08.665230+0000","last_became_active":"2024-02-17T14:28:07.648936+0000","last_became_peered":"2024-02-17T14:28:07.648936+0000","last_unstale":"2024-02-17T14:28:08.665230+0000","last_undegraded":"2024-02-17T14:28:08.665230+0000","last_fullsized":"2024-02-17T14:28:08.665230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:13.199365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653449+0000","last_change":"2024-02-17T14:28:03.074776+0000","last_active":"2024-02-17T14:28:10.653449+0000","last_peered":"2024-02-17T14:28:10.653449+0000","last_clean":"2024-02-17T14:28:10.653449+0000","last_became_active":"2024-02-17T14:28:03.074490+0000","last_became_peered":"2024-02-17T14:28:03.074490+0000","last_unstale":"2024-02-17T14:28:10.653449+0000","last_undegraded":"2024-02-17T14:28:10.653449+0000","last_fullsized":"2024-02-17T14:28:10.653449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.666004+0000","last_change":"2024-02-17T14:28:03.627957+0000","last_active":"2024-02-17T14:28:08.666004+0000","last_peered":"2024-02-17T14:28:08.666004+0000","last_clean":"2024-02-17T14:28:08.666004+0000","last_became_active":"2024-02-17T14:28:03.627675+0000","last_became_peered":"2024-02-17T14:28:03.627675+0000","last_unstale":"2024-02-17T14:28:08.666004+0000","last_undegraded":"2024-02-17T14:28:08.666004+0000","last_fullsized":"2024-02-17T14:28:08.666004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664955+0000","last_change":"2024-02-17T14:28:07.652422+0000","last_active":"2024-02-17T14:28:08.664955+0000","last_peered":"2024-02-17T14:28:08.664955+0000","last_clean":"2024-02-17T14:28:08.664955+0000","last_became_active":"2024-02-17T14:28:07.651946+0000","last_became_peered":"2024-02-17T14:28:07.651946+0000","last_unstale":"2024-02-17T14:28:08.664955+0000","last_undegraded":"2024-02-17T14:28:08.664955+0000","last_fullsized":"2024-02-17T14:28:08.664955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:21.967845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199578+0000","last_change":"2024-02-17T14:28:03.635059+0000","last_active":"2024-02-17T14:28:10.199578+0000","last_peered":"2024-02-17T14:28:10.199578+0000","last_clean":"2024-02-17T14:28:10.199578+0000","last_became_active":"2024-02-17T14:28:03.634759+0000","last_became_peered":"2024-02-17T14:28:03.634759+0000","last_unstale":"2024-02-17T14:28:10.199578+0000","last_undegraded":"2024-02-17T14:28:10.199578+0000","last_fullsized":"2024-02-17T14:28:10.199578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653581+0000","last_change":"2024-02-17T14:28:03.075604+0000","last_active":"2024-02-17T14:28:10.653581+0000","last_peered":"2024-02-17T14:28:10.653581+0000","last_clean":"2024-02-17T14:28:10.653581+0000","last_became_active":"2024-02-17T14:28:03.075329+0000","last_became_peered":"2024-02-17T14:28:03.075329+0000","last_unstale":"2024-02-17T14:28:10.653581+0000","last_undegraded":"2024-02-17T14:28:10.653581+0000","last_fullsized":"2024-02-17T14:28:10.653581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665134+0000","last_change":"2024-02-17T14:28:07.645791+0000","last_active":"2024-02-17T14:28:08.665134+0000","last_peered":"2024-02-17T14:28:08.665134+0000","last_clean":"2024-02-17T14:28:08.665134+0000","last_became_active":"2024-02-17T14:28:07.645418+0000","last_became_peered":"2024-02-17T14:28:07.645418+0000","last_unstale":"2024-02-17T14:28:08.665134+0000","last_undegraded":"2024-02-17T14:28:08.665134+0000","last_fullsized":"2024-02-17T14:28:08.665134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:26.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659629+0000","last_change":"2024-02-17T14:28:03.629378+0000","last_active":"2024-02-17T14:28:08.659629+0000","last_peered":"2024-02-17T14:28:08.659629+0000","last_clean":"2024-02-17T14:28:08.659629+0000","last_became_active":"2024-02-17T14:28:03.629097+0000","last_became_peered":"2024-02-17T14:28:03.629097+0000","last_unstale":"2024-02-17T14:28:08.659629+0000","last_undegraded":"2024-02-17T14:28:08.659629+0000","last_fullsized":"2024-02-17T14:28:08.659629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008740+0000","last_change":"2024-02-17T14:28:03.073579+0000","last_active":"2024-02-17T14:28:09.008740+0000","last_peered":"2024-02-17T14:28:09.008740+0000","last_clean":"2024-02-17T14:28:09.008740+0000","last_became_active":"2024-02-17T14:28:03.073167+0000","last_became_peered":"2024-02-17T14:28:03.073167+0000","last_unstale":"2024-02-17T14:28:09.008740+0000","last_undegraded":"2024-02-17T14:28:09.008740+0000","last_fullsized":"2024-02-17T14:28:09.008740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664544+0000","last_change":"2024-02-17T14:28:07.644972+0000","last_active":"2024-02-17T14:28:08.664544+0000","last_peered":"2024-02-17T14:28:08.664544+0000","last_clean":"2024-02-17T14:28:08.664544+0000","last_became_active":"2024-02-17T14:28:07.644523+0000","last_became_peered":"2024-02-17T14:28:07.644523+0000","last_unstale":"2024-02-17T14:28:08.664544+0000","last_undegraded":"2024-02-17T14:28:08.664544+0000","last_fullsized":"2024-02-17T14:28:08.664544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:25.221682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659355+0000","last_change":"2024-02-17T14:28:03.628527+0000","last_active":"2024-02-17T14:28:08.659355+0000","last_peered":"2024-02-17T14:28:08.659355+0000","last_clean":"2024-02-17T14:28:08.659355+0000","last_became_active":"2024-02-17T14:28:03.628274+0000","last_became_peered":"2024-02-17T14:28:03.628274+0000","last_unstale":"2024-02-17T14:28:08.659355+0000","last_undegraded":"2024-02-17T14:28:08.659355+0000","last_fullsized":"2024-02-17T14:28:08.659355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008406+0000","last_change":"2024-02-17T14:28:03.072317+0000","last_active":"2024-02-17T14:28:09.008406+0000","last_peered":"2024-02-17T14:28:09.008406+0000","last_clean":"2024-02-17T14:28:09.008406+0000","last_became_active":"2024-02-17T14:28:03.072016+0000","last_became_peered":"2024-02-17T14:28:03.072016+0000","last_unstale":"2024-02-17T14:28:09.008406+0000","last_undegraded":"2024-02-17T14:28:09.008406+0000","last_fullsized":"2024-02-17T14:28:09.008406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008870+0000","last_change":"2024-02-17T14:28:07.851022+0000","last_active":"2024-02-17T14:28:09.008870+0000","last_peered":"2024-02-17T14:28:09.008870+0000","last_clean":"2024-02-17T14:28:09.008870+0000","last_became_active":"2024-02-17T14:28:07.850379+0000","last_became_peered":"2024-02-17T14:28:07.850379+0000","last_unstale":"2024-02-17T14:28:09.008870+0000","last_undegraded":"2024-02-17T14:28:09.008870+0000","last_fullsized":"2024-02-17T14:28:09.008870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665771+0000","last_change":"2024-02-17T14:28:03.624798+0000","last_active":"2024-02-17T14:28:08.665771+0000","last_peered":"2024-02-17T14:28:08.665771+0000","last_clean":"2024-02-17T14:28:08.665771+0000","last_became_active":"2024-02-17T14:28:03.624517+0000","last_became_peered":"2024-02-17T14:28:03.624517+0000","last_unstale":"2024-02-17T14:28:08.665771+0000","last_undegraded":"2024-02-17T14:28:08.665771+0000","last_fullsized":"2024-02-17T14:28:08.665771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:40.637145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653091+0000","last_change":"2024-02-17T14:28:03.072806+0000","last_active":"2024-02-17T14:28:10.653091+0000","last_peered":"2024-02-17T14:28:10.653091+0000","last_clean":"2024-02-17T14:28:10.653091+0000","last_became_active":"2024-02-17T14:28:03.072490+0000","last_became_peered":"2024-02-17T14:28:03.072490+0000","last_unstale":"2024-02-17T14:28:10.653091+0000","last_undegraded":"2024-02-17T14:28:10.653091+0000","last_fullsized":"2024-02-17T14:28:10.653091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664603+0000","last_change":"2024-02-17T14:28:07.644959+0000","last_active":"2024-02-17T14:28:08.664603+0000","last_peered":"2024-02-17T14:28:08.664603+0000","last_clean":"2024-02-17T14:28:08.664603+0000","last_became_active":"2024-02-17T14:28:07.644524+0000","last_became_peered":"2024-02-17T14:28:07.644524+0000","last_unstale":"2024-02-17T14:28:08.664603+0000","last_undegraded":"2024-02-17T14:28:08.664603+0000","last_fullsized":"2024-02-17T14:28:08.664603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:02.122806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231643+0000","last_change":"2024-02-17T14:28:03.629190+0000","last_active":"2024-02-17T14:28:10.231643+0000","last_peered":"2024-02-17T14:28:10.231643+0000","last_clean":"2024-02-17T14:28:10.231643+0000","last_became_active":"2024-02-17T14:28:03.628777+0000","last_became_peered":"2024-02-17T14:28:03.628777+0000","last_unstale":"2024-02-17T14:28:10.231643+0000","last_undegraded":"2024-02-17T14:28:10.231643+0000","last_fullsized":"2024-02-17T14:28:10.231643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200259+0000","last_change":"2024-02-17T14:28:03.071097+0000","last_active":"2024-02-17T14:28:10.200259+0000","last_peered":"2024-02-17T14:28:10.200259+0000","last_clean":"2024-02-17T14:28:10.200259+0000","last_became_active":"2024-02-17T14:28:03.070790+0000","last_became_peered":"2024-02-17T14:28:03.070790+0000","last_unstale":"2024-02-17T14:28:10.200259+0000","last_undegraded":"2024-02-17T14:28:10.200259+0000","last_fullsized":"2024-02-17T14:28:10.200259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665566+0000","last_change":"2024-02-17T14:28:07.849764+0000","last_active":"2024-02-17T14:28:08.665566+0000","last_peered":"2024-02-17T14:28:08.665566+0000","last_clean":"2024-02-17T14:28:08.665566+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:08.665566+0000","last_undegraded":"2024-02-17T14:28:08.665566+0000","last_fullsized":"2024-02-17T14:28:08.665566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659802+0000","last_change":"2024-02-17T14:28:03.641818+0000","last_active":"2024-02-17T14:28:08.659802+0000","last_peered":"2024-02-17T14:28:08.659802+0000","last_clean":"2024-02-17T14:28:08.659802+0000","last_became_active":"2024-02-17T14:28:03.641577+0000","last_became_peered":"2024-02-17T14:28:03.641577+0000","last_unstale":"2024-02-17T14:28:08.659802+0000","last_undegraded":"2024-02-17T14:28:08.659802+0000","last_fullsized":"2024-02-17T14:28:08.659802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008983+0000","last_change":"2024-02-17T14:28:03.072074+0000","last_active":"2024-02-17T14:28:09.008983+0000","last_peered":"2024-02-17T14:28:09.008983+0000","last_clean":"2024-02-17T14:28:09.008983+0000","last_became_active":"2024-02-17T14:28:03.071850+0000","last_became_peered":"2024-02-17T14:28:03.071850+0000","last_unstale":"2024-02-17T14:28:09.008983+0000","last_undegraded":"2024-02-17T14:28:09.008983+0000","last_fullsized":"2024-02-17T14:28:09.008983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659047+0000","last_change":"2024-02-17T14:28:07.849616+0000","last_active":"2024-02-17T14:28:08.659047+0000","last_peered":"2024-02-17T14:28:08.659047+0000","last_clean":"2024-02-17T14:28:08.659047+0000","last_became_active":"2024-02-17T14:28:07.849022+0000","last_became_peered":"2024-02-17T14:28:07.849022+0000","last_unstale":"2024-02-17T14:28:08.659047+0000","last_undegraded":"2024-02-17T14:28:08.659047+0000","last_fullsized":"2024-02-17T14:28:08.659047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:18:22.630217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008626+0000","last_change":"2024-02-17T14:28:03.632265+0000","last_active":"2024-02-17T14:28:09.008626+0000","last_peered":"2024-02-17T14:28:09.008626+0000","last_clean":"2024-02-17T14:28:09.008626+0000","last_became_active":"2024-02-17T14:28:03.632020+0000","last_became_peered":"2024-02-17T14:28:03.632020+0000","last_unstale":"2024-02-17T14:28:09.008626+0000","last_undegraded":"2024-02-17T14:28:09.008626+0000","last_fullsized":"2024-02-17T14:28:09.008626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653833+0000","last_change":"2024-02-17T14:28:03.072252+0000","last_active":"2024-02-17T14:28:10.653833+0000","last_peered":"2024-02-17T14:28:10.653833+0000","last_clean":"2024-02-17T14:28:10.653833+0000","last_became_active":"2024-02-17T14:28:03.071830+0000","last_became_peered":"2024-02-17T14:28:03.071830+0000","last_unstale":"2024-02-17T14:28:10.653833+0000","last_undegraded":"2024-02-17T14:28:10.653833+0000","last_fullsized":"2024-02-17T14:28:10.653833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:24.870956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231494+0000","last_change":"2024-02-17T14:28:07.849579+0000","last_active":"2024-02-17T14:28:10.231494+0000","last_peered":"2024-02-17T14:28:10.231494+0000","last_clean":"2024-02-17T14:28:10.231494+0000","last_became_active":"2024-02-17T14:28:07.849212+0000","last_became_peered":"2024-02-17T14:28:07.849212+0000","last_unstale":"2024-02-17T14:28:10.231494+0000","last_undegraded":"2024-02-17T14:28:10.231494+0000","last_fullsized":"2024-02-17T14:28:10.231494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.666100+0000","last_change":"2024-02-17T14:28:03.626429+0000","last_active":"2024-02-17T14:28:08.666100+0000","last_peered":"2024-02-17T14:28:08.666100+0000","last_clean":"2024-02-17T14:28:08.666100+0000","last_became_active":"2024-02-17T14:28:03.626174+0000","last_became_peered":"2024-02-17T14:28:03.626174+0000","last_unstale":"2024-02-17T14:28:08.666100+0000","last_undegraded":"2024-02-17T14:28:08.666100+0000","last_fullsized":"2024-02-17T14:28:08.666100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008726+0000","last_change":"2024-02-17T14:28:03.068443+0000","last_active":"2024-02-17T14:28:09.008726+0000","last_peered":"2024-02-17T14:28:09.008726+0000","last_clean":"2024-02-17T14:28:09.008726+0000","last_became_active":"2024-02-17T14:28:03.068179+0000","last_became_peered":"2024-02-17T14:28:03.068179+0000","last_unstale":"2024-02-17T14:28:09.008726+0000","last_undegraded":"2024-02-17T14:28:09.008726+0000","last_fullsized":"2024-02-17T14:28:09.008726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008367+0000","last_change":"2024-02-17T14:28:07.650015+0000","last_active":"2024-02-17T14:28:09.008367+0000","last_peered":"2024-02-17T14:28:09.008367+0000","last_clean":"2024-02-17T14:28:09.008367+0000","last_became_active":"2024-02-17T14:28:07.647918+0000","last_became_peered":"2024-02-17T14:28:07.647918+0000","last_unstale":"2024-02-17T14:28:09.008367+0000","last_undegraded":"2024-02-17T14:28:09.008367+0000","last_fullsized":"2024-02-17T14:28:09.008367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665475+0000","last_change":"2024-02-17T14:28:03.629343+0000","last_active":"2024-02-17T14:28:08.665475+0000","last_peered":"2024-02-17T14:28:08.665475+0000","last_clean":"2024-02-17T14:28:08.665475+0000","last_became_active":"2024-02-17T14:28:03.629077+0000","last_became_peered":"2024-02-17T14:28:03.629077+0000","last_unstale":"2024-02-17T14:28:08.665475+0000","last_undegraded":"2024-02-17T14:28:08.665475+0000","last_fullsized":"2024-02-17T14:28:08.665475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:36.441335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664754+0000","last_change":"2024-02-17T14:28:03.069178+0000","last_active":"2024-02-17T14:28:08.664754+0000","last_peered":"2024-02-17T14:28:08.664754+0000","last_clean":"2024-02-17T14:28:08.664754+0000","last_became_active":"2024-02-17T14:28:03.068923+0000","last_became_peered":"2024-02-17T14:28:03.068923+0000","last_unstale":"2024-02-17T14:28:08.664754+0000","last_undegraded":"2024-02-17T14:28:08.664754+0000","last_fullsized":"2024-02-17T14:28:08.664754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008675+0000","last_change":"2024-02-17T14:28:07.648757+0000","last_active":"2024-02-17T14:28:09.008675+0000","last_peered":"2024-02-17T14:28:09.008675+0000","last_clean":"2024-02-17T14:28:09.008675+0000","last_became_active":"2024-02-17T14:28:07.645156+0000","last_became_peered":"2024-02-17T14:28:07.645156+0000","last_unstale":"2024-02-17T14:28:09.008675+0000","last_undegraded":"2024-02-17T14:28:09.008675+0000","last_fullsized":"2024-02-17T14:28:09.008675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008415+0000","last_change":"2024-02-17T14:28:03.627479+0000","last_active":"2024-02-17T14:28:09.008415+0000","last_peered":"2024-02-17T14:28:09.008415+0000","last_clean":"2024-02-17T14:28:09.008415+0000","last_became_active":"2024-02-17T14:28:03.627165+0000","last_became_peered":"2024-02-17T14:28:03.627165+0000","last_unstale":"2024-02-17T14:28:09.008415+0000","last_undegraded":"2024-02-17T14:28:09.008415+0000","last_fullsized":"2024-02-17T14:28:09.008415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952042+0000","last_change":"2024-02-17T14:28:03.066452+0000","last_active":"2024-02-17T14:28:08.952042+0000","last_peered":"2024-02-17T14:28:08.952042+0000","last_clean":"2024-02-17T14:28:08.952042+0000","last_became_active":"2024-02-17T14:28:03.066156+0000","last_became_peered":"2024-02-17T14:28:03.066156+0000","last_unstale":"2024-02-17T14:28:08.952042+0000","last_undegraded":"2024-02-17T14:28:08.952042+0000","last_fullsized":"2024-02-17T14:28:08.952042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008897+0000","last_change":"2024-02-17T14:28:07.649765+0000","last_active":"2024-02-17T14:28:09.008897+0000","last_peered":"2024-02-17T14:28:09.008897+0000","last_clean":"2024-02-17T14:28:09.008897+0000","last_became_active":"2024-02-17T14:28:07.649403+0000","last_became_peered":"2024-02-17T14:28:07.649403+0000","last_unstale":"2024-02-17T14:28:09.008897+0000","last_undegraded":"2024-02-17T14:28:09.008897+0000","last_fullsized":"2024-02-17T14:28:09.008897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231133+0000","last_change":"2024-02-17T14:28:03.629628+0000","last_active":"2024-02-17T14:28:10.231133+0000","last_peered":"2024-02-17T14:28:10.231133+0000","last_clean":"2024-02-17T14:28:10.231133+0000","last_became_active":"2024-02-17T14:28:03.629247+0000","last_became_peered":"2024-02-17T14:28:03.629247+0000","last_unstale":"2024-02-17T14:28:10.231133+0000","last_undegraded":"2024-02-17T14:28:10.231133+0000","last_fullsized":"2024-02-17T14:28:10.231133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:00:51.336643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653093+0000","last_change":"2024-02-17T14:28:03.072090+0000","last_active":"2024-02-17T14:28:10.653093+0000","last_peered":"2024-02-17T14:28:10.653093+0000","last_clean":"2024-02-17T14:28:10.653093+0000","last_became_active":"2024-02-17T14:28:03.071778+0000","last_became_peered":"2024-02-17T14:28:03.071778+0000","last_unstale":"2024-02-17T14:28:10.653093+0000","last_undegraded":"2024-02-17T14:28:10.653093+0000","last_fullsized":"2024-02-17T14:28:10.653093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231592+0000","last_change":"2024-02-17T14:28:07.850472+0000","last_active":"2024-02-17T14:28:10.231592+0000","last_peered":"2024-02-17T14:28:10.231592+0000","last_clean":"2024-02-17T14:28:10.231592+0000","last_became_active":"2024-02-17T14:28:07.850106+0000","last_became_peered":"2024-02-17T14:28:07.850106+0000","last_unstale":"2024-02-17T14:28:10.231592+0000","last_undegraded":"2024-02-17T14:28:10.231592+0000","last_fullsized":"2024-02-17T14:28:10.231592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659235+0000","last_change":"2024-02-17T14:28:03.635109+0000","last_active":"2024-02-17T14:28:08.659235+0000","last_peered":"2024-02-17T14:28:08.659235+0000","last_clean":"2024-02-17T14:28:08.659235+0000","last_became_active":"2024-02-17T14:28:03.634570+0000","last_became_peered":"2024-02-17T14:28:03.634570+0000","last_unstale":"2024-02-17T14:28:08.659235+0000","last_undegraded":"2024-02-17T14:28:08.659235+0000","last_fullsized":"2024-02-17T14:28:08.659235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665733+0000","last_change":"2024-02-17T14:28:03.061647+0000","last_active":"2024-02-17T14:28:08.665733+0000","last_peered":"2024-02-17T14:28:08.665733+0000","last_clean":"2024-02-17T14:28:08.665733+0000","last_became_active":"2024-02-17T14:28:03.061026+0000","last_became_peered":"2024-02-17T14:28:03.061026+0000","last_unstale":"2024-02-17T14:28:08.665733+0000","last_undegraded":"2024-02-17T14:28:08.665733+0000","last_fullsized":"2024-02-17T14:28:08.665733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653276+0000","last_change":"2024-02-17T14:28:00.253131+0000","last_active":"2024-02-17T14:28:10.653276+0000","last_peered":"2024-02-17T14:28:10.653276+0000","last_clean":"2024-02-17T14:28:10.653276+0000","last_became_active":"2024-02-17T14:28:00.252180+0000","last_became_peered":"2024-02-17T14:28:00.252180+0000","last_unstale":"2024-02-17T14:28:10.653276+0000","last_undegraded":"2024-02-17T14:28:10.653276+0000","last_fullsized":"2024-02-17T14:28:10.653276+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_clean_scrub_stamp":"2024-02-17T14:27:59.037303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:48.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199982+0000","last_change":"2024-02-17T14:28:07.849676+0000","last_active":"2024-02-17T14:28:10.199982+0000","last_peered":"2024-02-17T14:28:10.199982+0000","last_clean":"2024-02-17T14:28:10.199982+0000","last_became_active":"2024-02-17T14:28:07.849264+0000","last_became_peered":"2024-02-17T14:28:07.849264+0000","last_unstale":"2024-02-17T14:28:10.199982+0000","last_undegraded":"2024-02-17T14:28:10.199982+0000","last_fullsized":"2024-02-17T14:28:10.199982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653536+0000","last_change":"2024-02-17T14:28:03.642433+0000","last_active":"2024-02-17T14:28:10.653536+0000","last_peered":"2024-02-17T14:28:10.653536+0000","last_clean":"2024-02-17T14:28:10.653536+0000","last_became_active":"2024-02-17T14:28:03.641815+0000","last_became_peered":"2024-02-17T14:28:03.641815+0000","last_unstale":"2024-02-17T14:28:10.653536+0000","last_undegraded":"2024-02-17T14:28:10.653536+0000","last_fullsized":"2024-02-17T14:28:10.653536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:38.398272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952264+0000","last_change":"2024-02-17T14:28:03.066483+0000","last_active":"2024-02-17T14:28:08.952264+0000","last_peered":"2024-02-17T14:28:08.952264+0000","last_clean":"2024-02-17T14:28:08.952264+0000","last_became_active":"2024-02-17T14:28:03.066169+0000","last_became_peered":"2024-02-17T14:28:03.066169+0000","last_unstale":"2024-02-17T14:28:08.952264+0000","last_undegraded":"2024-02-17T14:28:08.952264+0000","last_fullsized":"2024-02-17T14:28:08.952264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199590+0000","last_change":"2024-02-17T14:28:07.846685+0000","last_active":"2024-02-17T14:28:10.199590+0000","last_peered":"2024-02-17T14:28:10.199590+0000","last_clean":"2024-02-17T14:28:10.199590+0000","last_became_active":"2024-02-17T14:28:07.846265+0000","last_became_peered":"2024-02-17T14:28:07.846265+0000","last_unstale":"2024-02-17T14:28:10.199590+0000","last_undegraded":"2024-02-17T14:28:10.199590+0000","last_fullsized":"2024-02-17T14:28:10.199590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664990+0000","last_change":"2024-02-17T14:28:03.634574+0000","last_active":"2024-02-17T14:28:08.664990+0000","last_peered":"2024-02-17T14:28:08.664990+0000","last_clean":"2024-02-17T14:28:08.664990+0000","last_became_active":"2024-02-17T14:28:03.634290+0000","last_became_peered":"2024-02-17T14:28:03.634290+0000","last_unstale":"2024-02-17T14:28:08.664990+0000","last_undegraded":"2024-02-17T14:28:08.664990+0000","last_fullsized":"2024-02-17T14:28:08.664990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008900+0000","last_change":"2024-02-17T14:28:03.072793+0000","last_active":"2024-02-17T14:28:09.008900+0000","last_peered":"2024-02-17T14:28:09.008900+0000","last_clean":"2024-02-17T14:28:09.008900+0000","last_became_active":"2024-02-17T14:28:03.072497+0000","last_became_peered":"2024-02-17T14:28:03.072497+0000","last_unstale":"2024-02-17T14:28:09.008900+0000","last_undegraded":"2024-02-17T14:28:09.008900+0000","last_fullsized":"2024-02-17T14:28:09.008900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231646+0000","last_change":"2024-02-17T14:28:07.651730+0000","last_active":"2024-02-17T14:28:10.231646+0000","last_peered":"2024-02-17T14:28:10.231646+0000","last_clean":"2024-02-17T14:28:10.231646+0000","last_became_active":"2024-02-17T14:28:07.651144+0000","last_became_peered":"2024-02-17T14:28:07.651144+0000","last_unstale":"2024-02-17T14:28:10.231646+0000","last_undegraded":"2024-02-17T14:28:10.231646+0000","last_fullsized":"2024-02-17T14:28:10.231646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653784+0000","last_change":"2024-02-17T14:28:03.643461+0000","last_active":"2024-02-17T14:28:10.653784+0000","last_peered":"2024-02-17T14:28:10.653784+0000","last_clean":"2024-02-17T14:28:10.653784+0000","last_became_active":"2024-02-17T14:28:03.643033+0000","last_became_peered":"2024-02-17T14:28:03.643033+0000","last_unstale":"2024-02-17T14:28:10.653784+0000","last_undegraded":"2024-02-17T14:28:10.653784+0000","last_fullsized":"2024-02-17T14:28:10.653784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:01.946139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952270+0000","last_change":"2024-02-17T14:28:03.067046+0000","last_active":"2024-02-17T14:28:08.952270+0000","last_peered":"2024-02-17T14:28:08.952270+0000","last_clean":"2024-02-17T14:28:08.952270+0000","last_became_active":"2024-02-17T14:28:03.066797+0000","last_became_peered":"2024-02-17T14:28:03.066797+0000","last_unstale":"2024-02-17T14:28:08.952270+0000","last_undegraded":"2024-02-17T14:28:08.952270+0000","last_fullsized":"2024-02-17T14:28:08.952270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.663876+0000","last_change":"2024-02-17T14:28:07.850145+0000","last_active":"2024-02-17T14:28:08.663876+0000","last_peered":"2024-02-17T14:28:08.663876+0000","last_clean":"2024-02-17T14:28:08.663876+0000","last_became_active":"2024-02-17T14:28:07.849280+0000","last_became_peered":"2024-02-17T14:28:07.849280+0000","last_unstale":"2024-02-17T14:28:08.663876+0000","last_undegraded":"2024-02-17T14:28:08.663876+0000","last_fullsized":"2024-02-17T14:28:08.663876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653718+0000","last_change":"2024-02-17T14:28:03.641357+0000","last_active":"2024-02-17T14:28:10.653718+0000","last_peered":"2024-02-17T14:28:10.653718+0000","last_clean":"2024-02-17T14:28:10.653718+0000","last_became_active":"2024-02-17T14:28:03.640945+0000","last_became_peered":"2024-02-17T14:28:03.640945+0000","last_unstale":"2024-02-17T14:28:10.653718+0000","last_undegraded":"2024-02-17T14:28:10.653718+0000","last_fullsized":"2024-02-17T14:28:10.653718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664250+0000","last_change":"2024-02-17T14:28:03.066640+0000","last_active":"2024-02-17T14:28:08.664250+0000","last_peered":"2024-02-17T14:28:08.664250+0000","last_clean":"2024-02-17T14:28:08.664250+0000","last_became_active":"2024-02-17T14:28:03.066350+0000","last_became_peered":"2024-02-17T14:28:03.066350+0000","last_unstale":"2024-02-17T14:28:08.664250+0000","last_undegraded":"2024-02-17T14:28:08.664250+0000","last_fullsized":"2024-02-17T14:28:08.664250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:43.162911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665250+0000","last_change":"2024-02-17T14:28:07.652490+0000","last_active":"2024-02-17T14:28:08.665250+0000","last_peered":"2024-02-17T14:28:08.665250+0000","last_clean":"2024-02-17T14:28:08.665250+0000","last_became_active":"2024-02-17T14:28:07.652088+0000","last_became_peered":"2024-02-17T14:28:07.652088+0000","last_unstale":"2024-02-17T14:28:08.665250+0000","last_undegraded":"2024-02-17T14:28:08.665250+0000","last_fullsized":"2024-02-17T14:28:08.665250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:41.975941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653573+0000","last_change":"2024-02-17T14:28:03.641468+0000","last_active":"2024-02-17T14:28:10.653573+0000","last_peered":"2024-02-17T14:28:10.653573+0000","last_clean":"2024-02-17T14:28:10.653573+0000","last_became_active":"2024-02-17T14:28:03.640860+0000","last_became_peered":"2024-02-17T14:28:03.640860+0000","last_unstale":"2024-02-17T14:28:10.653573+0000","last_undegraded":"2024-02-17T14:28:10.653573+0000","last_fullsized":"2024-02-17T14:28:10.653573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.951937+0000","last_change":"2024-02-17T14:28:03.070146+0000","last_active":"2024-02-17T14:28:08.951937+0000","last_peered":"2024-02-17T14:28:08.951937+0000","last_clean":"2024-02-17T14:28:08.951937+0000","last_became_active":"2024-02-17T14:28:03.069867+0000","last_became_peered":"2024-02-17T14:28:03.069867+0000","last_unstale":"2024-02-17T14:28:08.951937+0000","last_undegraded":"2024-02-17T14:28:08.951937+0000","last_fullsized":"2024-02-17T14:28:08.951937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231421+0000","last_change":"2024-02-17T14:28:07.644792+0000","last_active":"2024-02-17T14:28:10.231421+0000","last_peered":"2024-02-17T14:28:10.231421+0000","last_clean":"2024-02-17T14:28:10.231421+0000","last_became_active":"2024-02-17T14:28:07.644452+0000","last_became_peered":"2024-02-17T14:28:07.644452+0000","last_unstale":"2024-02-17T14:28:10.231421+0000","last_undegraded":"2024-02-17T14:28:10.231421+0000","last_fullsized":"2024-02-17T14:28:10.231421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199598+0000","last_change":"2024-02-17T14:28:03.630962+0000","last_active":"2024-02-17T14:28:10.199598+0000","last_peered":"2024-02-17T14:28:10.199598+0000","last_clean":"2024-02-17T14:28:10.199598+0000","last_became_active":"2024-02-17T14:28:03.630239+0000","last_became_peered":"2024-02-17T14:28:03.630239+0000","last_unstale":"2024-02-17T14:28:10.199598+0000","last_undegraded":"2024-02-17T14:28:10.199598+0000","last_fullsized":"2024-02-17T14:28:10.199598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199658+0000","last_change":"2024-02-17T14:28:03.073091+0000","last_active":"2024-02-17T14:28:10.199658+0000","last_peered":"2024-02-17T14:28:10.199658+0000","last_clean":"2024-02-17T14:28:10.199658+0000","last_became_active":"2024-02-17T14:28:03.072801+0000","last_became_peered":"2024-02-17T14:28:03.072801+0000","last_unstale":"2024-02-17T14:28:10.199658+0000","last_undegraded":"2024-02-17T14:28:10.199658+0000","last_fullsized":"2024-02-17T14:28:10.199658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659664+0000","last_change":"2024-02-17T14:28:07.849362+0000","last_active":"2024-02-17T14:28:08.659664+0000","last_peered":"2024-02-17T14:28:08.659664+0000","last_clean":"2024-02-17T14:28:08.659664+0000","last_became_active":"2024-02-17T14:28:07.848991+0000","last_became_peered":"2024-02-17T14:28:07.848991+0000","last_unstale":"2024-02-17T14:28:08.659664+0000","last_undegraded":"2024-02-17T14:28:08.659664+0000","last_fullsized":"2024-02-17T14:28:08.659664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:52.959315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653518+0000","last_change":"2024-02-17T14:28:03.641810+0000","last_active":"2024-02-17T14:28:10.653518+0000","last_peered":"2024-02-17T14:28:10.653518+0000","last_clean":"2024-02-17T14:28:10.653518+0000","last_became_active":"2024-02-17T14:28:03.641501+0000","last_became_peered":"2024-02-17T14:28:03.641501+0000","last_unstale":"2024-02-17T14:28:10.653518+0000","last_undegraded":"2024-02-17T14:28:10.653518+0000","last_fullsized":"2024-02-17T14:28:10.653518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664665+0000","last_change":"2024-02-17T14:28:03.066989+0000","last_active":"2024-02-17T14:28:08.664665+0000","last_peered":"2024-02-17T14:28:08.664665+0000","last_clean":"2024-02-17T14:28:08.664665+0000","last_became_active":"2024-02-17T14:28:03.066538+0000","last_became_peered":"2024-02-17T14:28:03.066538+0000","last_unstale":"2024-02-17T14:28:08.664665+0000","last_undegraded":"2024-02-17T14:28:08.664665+0000","last_fullsized":"2024-02-17T14:28:08.664665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659889+0000","last_change":"2024-02-17T14:28:07.846885+0000","last_active":"2024-02-17T14:28:08.659889+0000","last_peered":"2024-02-17T14:28:08.659889+0000","last_clean":"2024-02-17T14:28:08.659889+0000","last_became_active":"2024-02-17T14:28:07.846413+0000","last_became_peered":"2024-02-17T14:28:07.846413+0000","last_unstale":"2024-02-17T14:28:08.659889+0000","last_undegraded":"2024-02-17T14:28:08.659889+0000","last_fullsized":"2024-02-17T14:28:08.659889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:00.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231324+0000","last_change":"2024-02-17T14:28:03.638054+0000","last_active":"2024-02-17T14:28:10.231324+0000","last_peered":"2024-02-17T14:28:10.231324+0000","last_clean":"2024-02-17T14:28:10.231324+0000","last_became_active":"2024-02-17T14:28:03.637831+0000","last_became_peered":"2024-02-17T14:28:03.637831+0000","last_unstale":"2024-02-17T14:28:10.231324+0000","last_undegraded":"2024-02-17T14:28:10.231324+0000","last_fullsized":"2024-02-17T14:28:10.231324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:11:23.521059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231733+0000","last_change":"2024-02-17T14:28:03.064510+0000","last_active":"2024-02-17T14:28:10.231733+0000","last_peered":"2024-02-17T14:28:10.231733+0000","last_clean":"2024-02-17T14:28:10.231733+0000","last_became_active":"2024-02-17T14:28:03.064226+0000","last_became_peered":"2024-02-17T14:28:03.064226+0000","last_unstale":"2024-02-17T14:28:10.231733+0000","last_undegraded":"2024-02-17T14:28:10.231733+0000","last_fullsized":"2024-02-17T14:28:10.231733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:26:19.467344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.666011+0000","last_change":"2024-02-17T14:28:07.849775+0000","last_active":"2024-02-17T14:28:08.666011+0000","last_peered":"2024-02-17T14:28:08.666011+0000","last_clean":"2024-02-17T14:28:08.666011+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:08.666011+0000","last_undegraded":"2024-02-17T14:28:08.666011+0000","last_fullsized":"2024-02-17T14:28:08.666011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653418+0000","last_change":"2024-02-17T14:28:03.642582+0000","last_active":"2024-02-17T14:28:10.653418+0000","last_peered":"2024-02-17T14:28:10.653418+0000","last_clean":"2024-02-17T14:28:10.653418+0000","last_became_active":"2024-02-17T14:28:03.642077+0000","last_became_peered":"2024-02-17T14:28:03.642077+0000","last_unstale":"2024-02-17T14:28:10.653418+0000","last_undegraded":"2024-02-17T14:28:10.653418+0000","last_fullsized":"2024-02-17T14:28:10.653418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:12.644402+0000","last_change":"2024-02-17T14:28:03.071791+0000","last_active":"2024-02-17T14:28:12.644402+0000","last_peered":"2024-02-17T14:28:12.644402+0000","last_clean":"2024-02-17T14:28:12.644402+0000","last_became_active":"2024-02-17T14:28:03.071303+0000","last_became_peered":"2024-02-17T14:28:03.071303+0000","last_unstale":"2024-02-17T14:28:12.644402+0000","last_undegraded":"2024-02-17T14:28:12.644402+0000","last_fullsized":"2024-02-17T14:28:12.644402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008512+0000","last_change":"2024-02-17T14:28:07.649531+0000","last_active":"2024-02-17T14:28:09.008512+0000","last_peered":"2024-02-17T14:28:09.008512+0000","last_clean":"2024-02-17T14:28:09.008512+0000","last_became_active":"2024-02-17T14:28:07.645313+0000","last_became_peered":"2024-02-17T14:28:07.645313+0000","last_unstale":"2024-02-17T14:28:09.008512+0000","last_undegraded":"2024-02-17T14:28:09.008512+0000","last_fullsized":"2024-02-17T14:28:09.008512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664873+0000","last_change":"2024-02-17T14:28:03.638812+0000","last_active":"2024-02-17T14:28:08.664873+0000","last_peered":"2024-02-17T14:28:08.664873+0000","last_clean":"2024-02-17T14:28:08.664873+0000","last_became_active":"2024-02-17T14:28:03.637937+0000","last_became_peered":"2024-02-17T14:28:03.637937+0000","last_unstale":"2024-02-17T14:28:08.664873+0000","last_undegraded":"2024-02-17T14:28:08.664873+0000","last_fullsized":"2024-02-17T14:28:08.664873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008758+0000","last_change":"2024-02-17T14:28:03.069972+0000","last_active":"2024-02-17T14:28:09.008758+0000","last_peered":"2024-02-17T14:28:09.008758+0000","last_clean":"2024-02-17T14:28:09.008758+0000","last_became_active":"2024-02-17T14:28:03.069690+0000","last_became_peered":"2024-02-17T14:28:03.069690+0000","last_unstale":"2024-02-17T14:28:09.008758+0000","last_undegraded":"2024-02-17T14:28:09.008758+0000","last_fullsized":"2024-02-17T14:28:09.008758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665294+0000","last_change":"2024-02-17T14:28:07.647825+0000","last_active":"2024-02-17T14:28:08.665294+0000","last_peered":"2024-02-17T14:28:08.665294+0000","last_clean":"2024-02-17T14:28:08.665294+0000","last_became_active":"2024-02-17T14:28:07.647420+0000","last_became_peered":"2024-02-17T14:28:07.647420+0000","last_unstale":"2024-02-17T14:28:08.665294+0000","last_undegraded":"2024-02-17T14:28:08.665294+0000","last_fullsized":"2024-02-17T14:28:08.665294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231519+0000","last_change":"2024-02-17T14:28:03.631000+0000","last_active":"2024-02-17T14:28:10.231519+0000","last_peered":"2024-02-17T14:28:10.231519+0000","last_clean":"2024-02-17T14:28:10.231519+0000","last_became_active":"2024-02-17T14:28:03.630169+0000","last_became_peered":"2024-02-17T14:28:03.630169+0000","last_unstale":"2024-02-17T14:28:10.231519+0000","last_undegraded":"2024-02-17T14:28:10.231519+0000","last_fullsized":"2024-02-17T14:28:10.231519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665258+0000","last_change":"2024-02-17T14:28:03.069911+0000","last_active":"2024-02-17T14:28:08.665258+0000","last_peered":"2024-02-17T14:28:08.665258+0000","last_clean":"2024-02-17T14:28:08.665258+0000","last_became_active":"2024-02-17T14:28:03.069617+0000","last_became_peered":"2024-02-17T14:28:03.069617+0000","last_unstale":"2024-02-17T14:28:08.665258+0000","last_undegraded":"2024-02-17T14:28:08.665258+0000","last_fullsized":"2024-02-17T14:28:08.665258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659211+0000","last_change":"2024-02-17T14:28:07.646742+0000","last_active":"2024-02-17T14:28:08.659211+0000","last_peered":"2024-02-17T14:28:08.659211+0000","last_clean":"2024-02-17T14:28:08.659211+0000","last_became_active":"2024-02-17T14:28:07.646403+0000","last_became_peered":"2024-02-17T14:28:07.646403+0000","last_unstale":"2024-02-17T14:28:08.659211+0000","last_undegraded":"2024-02-17T14:28:08.659211+0000","last_fullsized":"2024-02-17T14:28:08.659211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665170+0000","last_change":"2024-02-17T14:28:03.638522+0000","last_active":"2024-02-17T14:28:08.665170+0000","last_peered":"2024-02-17T14:28:08.665170+0000","last_clean":"2024-02-17T14:28:08.665170+0000","last_became_active":"2024-02-17T14:28:03.638281+0000","last_became_peered":"2024-02-17T14:28:03.638281+0000","last_unstale":"2024-02-17T14:28:08.665170+0000","last_undegraded":"2024-02-17T14:28:08.665170+0000","last_fullsized":"2024-02-17T14:28:08.665170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200162+0000","last_change":"2024-02-17T14:28:03.072855+0000","last_active":"2024-02-17T14:28:10.200162+0000","last_peered":"2024-02-17T14:28:10.200162+0000","last_clean":"2024-02-17T14:28:10.200162+0000","last_became_active":"2024-02-17T14:28:03.072571+0000","last_became_peered":"2024-02-17T14:28:03.072571+0000","last_unstale":"2024-02-17T14:28:10.200162+0000","last_undegraded":"2024-02-17T14:28:10.200162+0000","last_fullsized":"2024-02-17T14:28:10.200162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659178+0000","last_change":"2024-02-17T14:28:07.849448+0000","last_active":"2024-02-17T14:28:08.659178+0000","last_peered":"2024-02-17T14:28:08.659178+0000","last_clean":"2024-02-17T14:28:08.659178+0000","last_became_active":"2024-02-17T14:28:07.849096+0000","last_became_peered":"2024-02-17T14:28:07.849096+0000","last_unstale":"2024-02-17T14:28:08.659178+0000","last_undegraded":"2024-02-17T14:28:08.659178+0000","last_fullsized":"2024-02-17T14:28:08.659178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231420+0000","last_change":"2024-02-17T14:28:07.849485+0000","last_active":"2024-02-17T14:28:10.231420+0000","last_peered":"2024-02-17T14:28:10.231420+0000","last_clean":"2024-02-17T14:28:10.231420+0000","last_became_active":"2024-02-17T14:28:07.849053+0000","last_became_peered":"2024-02-17T14:28:07.849053+0000","last_unstale":"2024-02-17T14:28:10.231420+0000","last_undegraded":"2024-02-17T14:28:10.231420+0000","last_fullsized":"2024-02-17T14:28:10.231420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008242+0000","last_change":"2024-02-17T14:28:03.632467+0000","last_active":"2024-02-17T14:28:09.008242+0000","last_peered":"2024-02-17T14:28:09.008242+0000","last_clean":"2024-02-17T14:28:09.008242+0000","last_became_active":"2024-02-17T14:28:03.632204+0000","last_became_peered":"2024-02-17T14:28:03.632204+0000","last_unstale":"2024-02-17T14:28:09.008242+0000","last_undegraded":"2024-02-17T14:28:09.008242+0000","last_fullsized":"2024-02-17T14:28:09.008242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664021+0000","last_change":"2024-02-17T14:28:03.062682+0000","last_active":"2024-02-17T14:28:08.664021+0000","last_peered":"2024-02-17T14:28:08.664021+0000","last_clean":"2024-02-17T14:28:08.664021+0000","last_became_active":"2024-02-17T14:28:03.062390+0000","last_became_peered":"2024-02-17T14:28:03.062390+0000","last_unstale":"2024-02-17T14:28:08.664021+0000","last_undegraded":"2024-02-17T14:28:08.664021+0000","last_fullsized":"2024-02-17T14:28:08.664021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200129+0000","last_change":"2024-02-17T14:28:07.651004+0000","last_active":"2024-02-17T14:28:10.200129+0000","last_peered":"2024-02-17T14:28:10.200129+0000","last_clean":"2024-02-17T14:28:10.200129+0000","last_became_active":"2024-02-17T14:28:07.650627+0000","last_became_peered":"2024-02-17T14:28:07.650627+0000","last_unstale":"2024-02-17T14:28:10.200129+0000","last_undegraded":"2024-02-17T14:28:10.200129+0000","last_fullsized":"2024-02-17T14:28:10.200129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659217+0000","last_change":"2024-02-17T14:28:03.627978+0000","last_active":"2024-02-17T14:28:08.659217+0000","last_peered":"2024-02-17T14:28:08.659217+0000","last_clean":"2024-02-17T14:28:08.659217+0000","last_became_active":"2024-02-17T14:28:03.627708+0000","last_became_peered":"2024-02-17T14:28:03.627708+0000","last_unstale":"2024-02-17T14:28:08.659217+0000","last_undegraded":"2024-02-17T14:28:08.659217+0000","last_fullsized":"2024-02-17T14:28:08.659217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659359+0000","last_change":"2024-02-17T14:28:03.071479+0000","last_active":"2024-02-17T14:28:08.659359+0000","last_peered":"2024-02-17T14:28:08.659359+0000","last_clean":"2024-02-17T14:28:08.659359+0000","last_became_active":"2024-02-17T14:28:03.071170+0000","last_became_peered":"2024-02-17T14:28:03.071170+0000","last_unstale":"2024-02-17T14:28:08.659359+0000","last_undegraded":"2024-02-17T14:28:08.659359+0000","last_fullsized":"2024-02-17T14:28:08.659359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:03:44.733125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199746+0000","last_change":"2024-02-17T14:28:03.073225+0000","last_active":"2024-02-17T14:28:10.199746+0000","last_peered":"2024-02-17T14:28:10.199746+0000","last_clean":"2024-02-17T14:28:10.199746+0000","last_became_active":"2024-02-17T14:28:03.072928+0000","last_became_peered":"2024-02-17T14:28:03.072928+0000","last_unstale":"2024-02-17T14:28:10.199746+0000","last_undegraded":"2024-02-17T14:28:10.199746+0000","last_fullsized":"2024-02-17T14:28:10.199746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231675+0000","last_change":"2024-02-17T14:28:03.635534+0000","last_active":"2024-02-17T14:28:10.231675+0000","last_peered":"2024-02-17T14:28:10.231675+0000","last_clean":"2024-02-17T14:28:10.231675+0000","last_became_active":"2024-02-17T14:28:03.635362+0000","last_became_peered":"2024-02-17T14:28:03.635362+0000","last_unstale":"2024-02-17T14:28:10.231675+0000","last_undegraded":"2024-02-17T14:28:10.231675+0000","last_fullsized":"2024-02-17T14:28:10.231675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952161+0000","last_change":"2024-02-17T14:28:07.645087+0000","last_active":"2024-02-17T14:28:08.952161+0000","last_peered":"2024-02-17T14:28:08.952161+0000","last_clean":"2024-02-17T14:28:08.952161+0000","last_became_active":"2024-02-17T14:28:07.644637+0000","last_became_peered":"2024-02-17T14:28:07.644637+0000","last_unstale":"2024-02-17T14:28:08.952161+0000","last_undegraded":"2024-02-17T14:28:08.952161+0000","last_fullsized":"2024-02-17T14:28:08.952161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:39.175950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659718+0000","last_change":"2024-02-17T14:28:03.072162+0000","last_active":"2024-02-17T14:28:08.659718+0000","last_peered":"2024-02-17T14:28:08.659718+0000","last_clean":"2024-02-17T14:28:08.659718+0000","last_became_active":"2024-02-17T14:28:03.071112+0000","last_became_peered":"2024-02-17T14:28:03.071112+0000","last_unstale":"2024-02-17T14:28:08.659718+0000","last_undegraded":"2024-02-17T14:28:08.659718+0000","last_fullsized":"2024-02-17T14:28:08.659718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665058+0000","last_change":"2024-02-17T14:28:03.628403+0000","last_active":"2024-02-17T14:28:08.665058+0000","last_peered":"2024-02-17T14:28:08.665058+0000","last_clean":"2024-02-17T14:28:08.665058+0000","last_became_active":"2024-02-17T14:28:03.628144+0000","last_became_peered":"2024-02-17T14:28:03.628144+0000","last_unstale":"2024-02-17T14:28:08.665058+0000","last_undegraded":"2024-02-17T14:28:08.665058+0000","last_fullsized":"2024-02-17T14:28:08.665058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:01.247136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659662+0000","last_change":"2024-02-17T14:28:07.648376+0000","last_active":"2024-02-17T14:28:08.659662+0000","last_peered":"2024-02-17T14:28:08.659662+0000","last_clean":"2024-02-17T14:28:08.659662+0000","last_became_active":"2024-02-17T14:28:07.647491+0000","last_became_peered":"2024-02-17T14:28:07.647491+0000","last_unstale":"2024-02-17T14:28:08.659662+0000","last_undegraded":"2024-02-17T14:28:08.659662+0000","last_fullsized":"2024-02-17T14:28:08.659662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:12.810441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199485+0000","last_change":"2024-02-17T14:28:03.631191+0000","last_active":"2024-02-17T14:28:10.199485+0000","last_peered":"2024-02-17T14:28:10.199485+0000","last_clean":"2024-02-17T14:28:10.199485+0000","last_became_active":"2024-02-17T14:28:03.630662+0000","last_became_peered":"2024-02-17T14:28:03.630662+0000","last_unstale":"2024-02-17T14:28:10.199485+0000","last_undegraded":"2024-02-17T14:28:10.199485+0000","last_fullsized":"2024-02-17T14:28:10.199485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952028+0000","last_change":"2024-02-17T14:28:03.629028+0000","last_active":"2024-02-17T14:28:08.952028+0000","last_peered":"2024-02-17T14:28:08.952028+0000","last_clean":"2024-02-17T14:28:08.952028+0000","last_became_active":"2024-02-17T14:28:03.628781+0000","last_became_peered":"2024-02-17T14:28:03.628781+0000","last_unstale":"2024-02-17T14:28:08.952028+0000","last_undegraded":"2024-02-17T14:28:08.952028+0000","last_fullsized":"2024-02-17T14:28:08.952028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664578+0000","last_change":"2024-02-17T14:28:03.633531+0000","last_active":"2024-02-17T14:28:08.664578+0000","last_peered":"2024-02-17T14:28:08.664578+0000","last_clean":"2024-02-17T14:28:08.664578+0000","last_became_active":"2024-02-17T14:28:03.633248+0000","last_became_peered":"2024-02-17T14:28:03.633248+0000","last_unstale":"2024-02-17T14:28:08.664578+0000","last_undegraded":"2024-02-17T14:28:08.664578+0000","last_fullsized":"2024-02-17T14:28:08.664578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231592+0000","last_change":"2024-02-17T14:28:03.627122+0000","last_active":"2024-02-17T14:28:10.231592+0000","last_peered":"2024-02-17T14:28:10.231592+0000","last_clean":"2024-02-17T14:28:10.231592+0000","last_became_active":"2024-02-17T14:28:03.626738+0000","last_became_peered":"2024-02-17T14:28:03.626738+0000","last_unstale":"2024-02-17T14:28:10.231592+0000","last_undegraded":"2024-02-17T14:28:10.231592+0000","last_fullsized":"2024-02-17T14:28:10.231592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659986+0000","last_change":"2024-02-17T14:28:03.631182+0000","last_active":"2024-02-17T14:28:08.659986+0000","last_peered":"2024-02-17T14:28:08.659986+0000","last_clean":"2024-02-17T14:28:08.659986+0000","last_became_active":"2024-02-17T14:28:03.630705+0000","last_became_peered":"2024-02-17T14:28:03.630705+0000","last_unstale":"2024-02-17T14:28:08.659986+0000","last_undegraded":"2024-02-17T14:28:08.659986+0000","last_fullsized":"2024-02-17T14:28:08.659986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008574+0000","last_change":"2024-02-17T14:28:03.631731+0000","last_active":"2024-02-17T14:28:09.008574+0000","last_peered":"2024-02-17T14:28:09.008574+0000","last_clean":"2024-02-17T14:28:09.008574+0000","last_became_active":"2024-02-17T14:28:03.631476+0000","last_became_peered":"2024-02-17T14:28:03.631476+0000","last_unstale":"2024-02-17T14:28:09.008574+0000","last_undegraded":"2024-02-17T14:28:09.008574+0000","last_fullsized":"2024-02-17T14:28:09.008574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200191+0000","last_change":"2024-02-17T14:28:03.638716+0000","last_active":"2024-02-17T14:28:10.200191+0000","last_peered":"2024-02-17T14:28:10.200191+0000","last_clean":"2024-02-17T14:28:10.200191+0000","last_became_active":"2024-02-17T14:28:03.638442+0000","last_became_peered":"2024-02-17T14:28:03.638442+0000","last_unstale":"2024-02-17T14:28:10.200191+0000","last_undegraded":"2024-02-17T14:28:10.200191+0000","last_fullsized":"2024-02-17T14:28:10.200191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659705+0000","last_change":"2024-02-17T14:28:03.630945+0000","last_active":"2024-02-17T14:28:08.659705+0000","last_peered":"2024-02-17T14:28:08.659705+0000","last_clean":"2024-02-17T14:28:08.659705+0000","last_became_active":"2024-02-17T14:28:03.630676+0000","last_became_peered":"2024-02-17T14:28:03.630676+0000","last_unstale":"2024-02-17T14:28:08.659705+0000","last_undegraded":"2024-02-17T14:28:08.659705+0000","last_fullsized":"2024-02-17T14:28:08.659705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664109+0000","last_change":"2024-02-17T14:28:03.627202+0000","last_active":"2024-02-17T14:28:08.664109+0000","last_peered":"2024-02-17T14:28:08.664109+0000","last_clean":"2024-02-17T14:28:08.664109+0000","last_became_active":"2024-02-17T14:28:03.626848+0000","last_became_peered":"2024-02-17T14:28:03.626848+0000","last_unstale":"2024-02-17T14:28:08.664109+0000","last_undegraded":"2024-02-17T14:28:08.664109+0000","last_fullsized":"2024-02-17T14:28:08.664109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659335+0000","last_change":"2024-02-17T14:28:03.627493+0000","last_active":"2024-02-17T14:28:08.659335+0000","last_peered":"2024-02-17T14:28:08.659335+0000","last_clean":"2024-02-17T14:28:08.659335+0000","last_became_active":"2024-02-17T14:28:03.626450+0000","last_became_peered":"2024-02-17T14:28:03.626450+0000","last_unstale":"2024-02-17T14:28:08.659335+0000","last_undegraded":"2024-02-17T14:28:08.659335+0000","last_fullsized":"2024-02-17T14:28:08.659335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664490+0000","last_change":"2024-02-17T14:28:03.639610+0000","last_active":"2024-02-17T14:28:08.664490+0000","last_peered":"2024-02-17T14:28:08.664490+0000","last_clean":"2024-02-17T14:28:08.664490+0000","last_became_active":"2024-02-17T14:28:03.639330+0000","last_became_peered":"2024-02-17T14:28:03.639330+0000","last_unstale":"2024-02-17T14:28:08.664490+0000","last_undegraded":"2024-02-17T14:28:08.664490+0000","last_fullsized":"2024-02-17T14:28:08.664490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231482+0000","last_change":"2024-02-17T14:28:03.641774+0000","last_active":"2024-02-17T14:28:10.231482+0000","last_peered":"2024-02-17T14:28:10.231482+0000","last_clean":"2024-02-17T14:28:10.231482+0000","last_became_active":"2024-02-17T14:28:03.641485+0000","last_became_peered":"2024-02-17T14:28:03.641485+0000","last_unstale":"2024-02-17T14:28:10.231482+0000","last_undegraded":"2024-02-17T14:28:10.231482+0000","last_fullsized":"2024-02-17T14:28:10.231482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199910+0000","last_change":"2024-02-17T14:28:03.630129+0000","last_active":"2024-02-17T14:28:10.199910+0000","last_peered":"2024-02-17T14:28:10.199910+0000","last_clean":"2024-02-17T14:28:10.199910+0000","last_became_active":"2024-02-17T14:28:03.629841+0000","last_became_peered":"2024-02-17T14:28:03.629841+0000","last_unstale":"2024-02-17T14:28:10.199910+0000","last_undegraded":"2024-02-17T14:28:10.199910+0000","last_fullsized":"2024-02-17T14:28:10.199910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653773+0000","last_change":"2024-02-17T14:28:03.642676+0000","last_active":"2024-02-17T14:28:10.653773+0000","last_peered":"2024-02-17T14:28:10.653773+0000","last_clean":"2024-02-17T14:28:10.653773+0000","last_became_active":"2024-02-17T14:28:03.642150+0000","last_became_peered":"2024-02-17T14:28:03.642150+0000","last_unstale":"2024-02-17T14:28:10.653773+0000","last_undegraded":"2024-02-17T14:28:10.653773+0000","last_fullsized":"2024-02-17T14:28:10.653773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952216+0000","last_change":"2024-02-17T14:28:03.632127+0000","last_active":"2024-02-17T14:28:08.952216+0000","last_peered":"2024-02-17T14:28:08.952216+0000","last_clean":"2024-02-17T14:28:08.952216+0000","last_became_active":"2024-02-17T14:28:03.631844+0000","last_became_peered":"2024-02-17T14:28:03.631844+0000","last_unstale":"2024-02-17T14:28:08.952216+0000","last_undegraded":"2024-02-17T14:28:08.952216+0000","last_fullsized":"2024-02-17T14:28:08.952216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:07.756422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665733+0000","last_change":"2024-02-17T14:28:03.638703+0000","last_active":"2024-02-17T14:28:08.665733+0000","last_peered":"2024-02-17T14:28:08.665733+0000","last_clean":"2024-02-17T14:28:08.665733+0000","last_became_active":"2024-02-17T14:28:03.638427+0000","last_became_peered":"2024-02-17T14:28:03.638427+0000","last_unstale":"2024-02-17T14:28:08.665733+0000","last_undegraded":"2024-02-17T14:28:08.665733+0000","last_fullsized":"2024-02-17T14:28:08.665733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.663890+0000","last_change":"2024-02-17T14:28:03.628626+0000","last_active":"2024-02-17T14:28:08.663890+0000","last_peered":"2024-02-17T14:28:08.663890+0000","last_clean":"2024-02-17T14:28:08.663890+0000","last_became_active":"2024-02-17T14:28:03.628343+0000","last_became_peered":"2024-02-17T14:28:03.628343+0000","last_unstale":"2024-02-17T14:28:08.663890+0000","last_undegraded":"2024-02-17T14:28:08.663890+0000","last_fullsized":"2024-02-17T14:28:08.663890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008316+0000","last_change":"2024-02-17T14:28:03.635610+0000","last_active":"2024-02-17T14:28:09.008316+0000","last_peered":"2024-02-17T14:28:09.008316+0000","last_clean":"2024-02-17T14:28:09.008316+0000","last_became_active":"2024-02-17T14:28:03.635340+0000","last_became_peered":"2024-02-17T14:28:03.635340+0000","last_unstale":"2024-02-17T14:28:09.008316+0000","last_undegraded":"2024-02-17T14:28:09.008316+0000","last_fullsized":"2024-02-17T14:28:09.008316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231274+0000","last_change":"2024-02-17T14:28:03.632540+0000","last_active":"2024-02-17T14:28:10.231274+0000","last_peered":"2024-02-17T14:28:10.231274+0000","last_clean":"2024-02-17T14:28:10.231274+0000","last_became_active":"2024-02-17T14:28:03.632273+0000","last_became_peered":"2024-02-17T14:28:03.632273+0000","last_unstale":"2024-02-17T14:28:10.231274+0000","last_undegraded":"2024-02-17T14:28:10.231274+0000","last_fullsized":"2024-02-17T14:28:10.231274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:35.598281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659538+0000","last_change":"2024-02-17T14:28:03.631678+0000","last_active":"2024-02-17T14:28:08.659538+0000","last_peered":"2024-02-17T14:28:08.659538+0000","last_clean":"2024-02-17T14:28:08.659538+0000","last_became_active":"2024-02-17T14:28:03.631431+0000","last_became_peered":"2024-02-17T14:28:03.631431+0000","last_unstale":"2024-02-17T14:28:08.659538+0000","last_undegraded":"2024-02-17T14:28:08.659538+0000","last_fullsized":"2024-02-17T14:28:08.659538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664773+0000","last_change":"2024-02-17T14:28:03.631661+0000","last_active":"2024-02-17T14:28:08.664773+0000","last_peered":"2024-02-17T14:28:08.664773+0000","last_clean":"2024-02-17T14:28:08.664773+0000","last_became_active":"2024-02-17T14:28:03.631379+0000","last_became_peered":"2024-02-17T14:28:03.631379+0000","last_unstale":"2024-02-17T14:28:08.664773+0000","last_undegraded":"2024-02-17T14:28:08.664773+0000","last_fullsized":"2024-02-17T14:28:08.664773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:03.242976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199968+0000","last_change":"2024-02-17T14:28:03.635522+0000","last_active":"2024-02-17T14:28:10.199968+0000","last_peered":"2024-02-17T14:28:10.199968+0000","last_clean":"2024-02-17T14:28:10.199968+0000","last_became_active":"2024-02-17T14:28:03.635254+0000","last_became_peered":"2024-02-17T14:28:03.635254+0000","last_unstale":"2024-02-17T14:28:10.199968+0000","last_undegraded":"2024-02-17T14:28:10.199968+0000","last_fullsized":"2024-02-17T14:28:10.199968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200179+0000","last_change":"2024-02-17T14:28:03.635588+0000","last_active":"2024-02-17T14:28:10.200179+0000","last_peered":"2024-02-17T14:28:10.200179+0000","last_clean":"2024-02-17T14:28:10.200179+0000","last_became_active":"2024-02-17T14:28:03.635312+0000","last_became_peered":"2024-02-17T14:28:03.635312+0000","last_unstale":"2024-02-17T14:28:10.200179+0000","last_undegraded":"2024-02-17T14:28:10.200179+0000","last_fullsized":"2024-02-17T14:28:10.200179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653775+0000","last_change":"2024-02-17T14:28:03.646624+0000","last_active":"2024-02-17T14:28:10.653775+0000","last_peered":"2024-02-17T14:28:10.653775+0000","last_clean":"2024-02-17T14:28:10.653775+0000","last_became_active":"2024-02-17T14:28:03.646337+0000","last_became_peered":"2024-02-17T14:28:03.646337+0000","last_unstale":"2024-02-17T14:28:10.653775+0000","last_undegraded":"2024-02-17T14:28:10.653775+0000","last_fullsized":"2024-02-17T14:28:10.653775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:10.836577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659106+0000","last_change":"2024-02-17T14:28:03.635018+0000","last_active":"2024-02-17T14:28:08.659106+0000","last_peered":"2024-02-17T14:28:08.659106+0000","last_clean":"2024-02-17T14:28:08.659106+0000","last_became_active":"2024-02-17T14:28:03.634751+0000","last_became_peered":"2024-02-17T14:28:03.634751+0000","last_unstale":"2024-02-17T14:28:08.659106+0000","last_undegraded":"2024-02-17T14:28:08.659106+0000","last_fullsized":"2024-02-17T14:28:08.659106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653292+0000","last_change":"2024-02-17T14:28:03.641708+0000","last_active":"2024-02-17T14:28:10.653292+0000","last_peered":"2024-02-17T14:28:10.653292+0000","last_clean":"2024-02-17T14:28:10.653292+0000","last_became_active":"2024-02-17T14:28:03.641260+0000","last_became_peered":"2024-02-17T14:28:03.641260+0000","last_unstale":"2024-02-17T14:28:10.653292+0000","last_undegraded":"2024-02-17T14:28:10.653292+0000","last_fullsized":"2024-02-17T14:28:10.653292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664400+0000","last_change":"2024-02-17T14:28:03.628239+0000","last_active":"2024-02-17T14:28:08.664400+0000","last_peered":"2024-02-17T14:28:08.664400+0000","last_clean":"2024-02-17T14:28:08.664400+0000","last_became_active":"2024-02-17T14:28:03.627918+0000","last_became_peered":"2024-02-17T14:28:03.627918+0000","last_unstale":"2024-02-17T14:28:08.664400+0000","last_undegraded":"2024-02-17T14:28:08.664400+0000","last_fullsized":"2024-02-17T14:28:08.664400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653391+0000","last_change":"2024-02-17T14:28:03.641192+0000","last_active":"2024-02-17T14:28:10.653391+0000","last_peered":"2024-02-17T14:28:10.653391+0000","last_clean":"2024-02-17T14:28:10.653391+0000","last_became_active":"2024-02-17T14:28:03.640873+0000","last_became_peered":"2024-02-17T14:28:03.640873+0000","last_unstale":"2024-02-17T14:28:10.653391+0000","last_undegraded":"2024-02-17T14:28:10.653391+0000","last_fullsized":"2024-02-17T14:28:10.653391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664766+0000","last_change":"2024-02-17T14:28:03.634770+0000","last_active":"2024-02-17T14:28:08.664766+0000","last_peered":"2024-02-17T14:28:08.664766+0000","last_clean":"2024-02-17T14:28:08.664766+0000","last_became_active":"2024-02-17T14:28:03.634397+0000","last_became_peered":"2024-02-17T14:28:03.634397+0000","last_unstale":"2024-02-17T14:28:08.664766+0000","last_undegraded":"2024-02-17T14:28:08.664766+0000","last_fullsized":"2024-02-17T14:28:08.664766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:38.398272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231407+0000","last_change":"2024-02-17T14:28:03.628223+0000","last_active":"2024-02-17T14:28:10.231407+0000","last_peered":"2024-02-17T14:28:10.231407+0000","last_clean":"2024-02-17T14:28:10.231407+0000","last_became_active":"2024-02-17T14:28:03.627978+0000","last_became_peered":"2024-02-17T14:28:03.627978+0000","last_unstale":"2024-02-17T14:28:10.231407+0000","last_undegraded":"2024-02-17T14:28:10.231407+0000","last_fullsized":"2024-02-17T14:28:10.231407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008914+0000","last_change":"2024-02-17T14:28:03.631742+0000","last_active":"2024-02-17T14:28:09.008914+0000","last_peered":"2024-02-17T14:28:09.008914+0000","last_clean":"2024-02-17T14:28:09.008914+0000","last_became_active":"2024-02-17T14:28:03.631493+0000","last_became_peered":"2024-02-17T14:28:03.631493+0000","last_unstale":"2024-02-17T14:28:09.008914+0000","last_undegraded":"2024-02-17T14:28:09.008914+0000","last_fullsized":"2024-02-17T14:28:09.008914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653565+0000","last_change":"2024-02-17T14:28:03.641525+0000","last_active":"2024-02-17T14:28:10.653565+0000","last_peered":"2024-02-17T14:28:10.653565+0000","last_clean":"2024-02-17T14:28:10.653565+0000","last_became_active":"2024-02-17T14:28:03.641154+0000","last_became_peered":"2024-02-17T14:28:03.641154+0000","last_unstale":"2024-02-17T14:28:10.653565+0000","last_undegraded":"2024-02-17T14:28:10.653565+0000","last_fullsized":"2024-02-17T14:28:10.653565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":695877,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":695933,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T14:28:25.987 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-17T14:28:25.987 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-17T14:28:25.987 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-17T14:28:25.988 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-17T14:28:25.988 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-17T14:28:26.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.123+0000 7f150f12c640 1 Processor -- start 2024-02-17T14:28:26.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.123+0000 7f150f12c640 1 -- start start 2024-02-17T14:28:26.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.124+0000 7f150f12c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f15080b0600 0x7f15080b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.124+0000 7f150f12c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15080714b0 con 0x7f1508071940 2024-02-17T14:28:26.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.124+0000 7f150f12c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15080b0ff0 con 0x7f15080b5020 2024-02-17T14:28:26.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.124+0000 7f150f12c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15080b5eb0 con 0x7f15080b0600 2024-02-17T14:28:26.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.124+0000 7f150d6c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f15080b0600 0x7f15080b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.124+0000 7f1507fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1508071940 0x7f1508071da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51010/0 (socket says 172.21.15.134:51010) 2024-02-17T14:28:26.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.124+0000 7f150d6c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f15080b0600 0x7f15080b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46072/0 (socket says 172.21.15.134:46072) 2024-02-17T14:28:26.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.124+0000 7f1507fff640 1 -- 172.21.15.134:0/3646082561 learned_addr learned my addr 172.21.15.134:0/3646082561 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:26.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.124+0000 7f150d6c9640 1 -- 172.21.15.134:0/3646082561 >> v1:172.21.15.142:6789/0 conn(0x7f15080b5020 legacy=0x7f1508144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:26.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.124+0000 7f150d6c9640 1 -- 172.21.15.134:0/3646082561 >> v1:172.21.15.134:6789/0 conn(0x7f1508071940 legacy=0x7f1508071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.124+0000 7f150d6c9640 1 -- 172.21.15.134:0/3646082561 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15080b5400 con 0x7f15080b0600 2024-02-17T14:28:26.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.125+0000 7f150d6c9640 1 --2- 172.21.15.134:0/3646082561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15080b0600 0x7f15080b0ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1500009d90 tx=0x7f150002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6296abc59b5ca1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:26.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.125+0000 7f15077fe640 1 -- 172.21.15.134:0/3646082561 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150002cb40 con 0x7f15080b0600 2024-02-17T14:28:26.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.125+0000 7f15077fe640 1 -- 172.21.15.134:0/3646082561 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150002cca0 con 0x7f15080b0600 2024-02-17T14:28:26.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.125+0000 7f15077fe640 1 -- 172.21.15.134:0/3646082561 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500034660 con 0x7f15080b0600 2024-02-17T14:28:26.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.126+0000 7f150f12c640 1 -- 172.21.15.134:0/3646082561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15080b0600 msgr2=0x7f15080b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.126+0000 7f150f12c640 1 --2- 172.21.15.134:0/3646082561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15080b0600 0x7f15080b0ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1500009d90 tx=0x7f150002bd90 comp rx=0 tx=0).stop 2024-02-17T14:28:26.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.126+0000 7f150f12c640 1 -- 172.21.15.134:0/3646082561 shutdown_connections 2024-02-17T14:28:26.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.126+0000 7f150f12c640 1 --2- 172.21.15.134:0/3646082561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15080b0600 0x7f15080b0ab0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.126+0000 7f150f12c640 1 -- 172.21.15.134:0/3646082561 >> 172.21.15.134:0/3646082561 conn(0x7f15080ba430 msgr2=0x7f15080ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:26.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.126+0000 7f150f12c640 1 -- 172.21.15.134:0/3646082561 shutdown_connections 2024-02-17T14:28:26.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.126+0000 7f150f12c640 1 -- 172.21.15.134:0/3646082561 wait complete. 2024-02-17T14:28:26.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.127+0000 7f150f12c640 1 Processor -- start 2024-02-17T14:28:26.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.127+0000 7f150f12c640 1 -- start start 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.127+0000 7f150f12c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1508071940 0x7f15081daa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.127+0000 7f150f12c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15080b0600 0x7f15081daf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.127+0000 7f150f12c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15080b5020 0x7f150813f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.127+0000 7f150f12c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15081429e0 con 0x7f15080b0600 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.127+0000 7f150f12c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1508141180 con 0x7f15080b5020 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.127+0000 7f150f12c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1508140cf0 con 0x7f1508071940 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.127+0000 7f1507fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15080b0600 0x7f15081daf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f1507fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15080b0600 0x7f15081daf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46080/0 (socket says 172.21.15.134:46080) 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f1507fff640 1 -- 172.21.15.134:0/3307591592 learned_addr learned my addr 172.21.15.134:0/3307591592 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f150cec8640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1508071940 0x7f15081daa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f150d6c9640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15080b5020 0x7f150813f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f1507fff640 1 -- 172.21.15.134:0/3307591592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1508071940 msgr2=0x7f15081daa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f1507fff640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1508071940 0x7f15081daa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f1507fff640 1 -- 172.21.15.134:0/3307591592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15080b5020 msgr2=0x7f150813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f1507fff640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15080b5020 0x7f150813f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f1507fff640 1 -- 172.21.15.134:0/3307591592 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1500009a70 con 0x7f15080b0600 2024-02-17T14:28:26.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f1507fff640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15080b0600 0x7f15081daf40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00c440 tx=0x7f14fc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:26.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f15057fa640 1 -- 172.21.15.134:0/3307591592 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc005ce0 con 0x7f15080b0600 2024-02-17T14:28:26.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f15057fa640 1 -- 172.21.15.134:0/3307591592 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc005e40 con 0x7f15080b0600 2024-02-17T14:28:26.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f15057fa640 1 -- 172.21.15.134:0/3307591592 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0072f0 con 0x7f15080b0600 2024-02-17T14:28:26.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f150f12c640 1 -- 172.21.15.134:0/3307591592 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1508141bf0 con 0x7f15080b0600 2024-02-17T14:28:26.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.128+0000 7f150f12c640 1 -- 172.21.15.134:0/3307591592 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1508142700 con 0x7f15080b0600 2024-02-17T14:28:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.129+0000 7f150f12c640 1 -- 172.21.15.134:0/3307591592 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1508067b70 con 0x7f15080b0600 2024-02-17T14:28:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.130+0000 7f15057fa640 1 -- 172.21.15.134:0/3307591592 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f14fc007450 con 0x7f15080b0600 2024-02-17T14:28:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.130+0000 7f15057fa640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f14f406b840 0x7f14f406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.130+0000 7f15057fa640 1 -- 172.21.15.134:0/3307591592 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f14fc089a00 con 0x7f15080b0600 2024-02-17T14:28:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.130+0000 7f150cec8640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f14f406b840 0x7f14f406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.130+0000 7f150cec8640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f14f406b840 0x7f14f406dd00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14f800a750 tx=0x7f14f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:26.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.135+0000 7f15057fa640 1 -- 172.21.15.134:0/3307591592 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f14fc054170 con 0x7f15080b0600 2024-02-17T14:28:26.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.354+0000 7f150f12c640 1 -- 172.21.15.134:0/3307591592 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1508149040 con 0x7f15080b0600 2024-02-17T14:28:26.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.357+0000 7f15057fa640 1 -- 172.21.15.134:0/3307591592 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171799 (secure 0 0 0) 0x7f14fc017090 con 0x7f15080b0600 2024-02-17T14:28:26.360 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:26.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.360+0000 7f150f12c640 1 -- 172.21.15.134:0/3307591592 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f14f406b840 msgr2=0x7f14f406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.360+0000 7f150f12c640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f14f406b840 0x7f14f406dd00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14f800a750 tx=0x7f14f8008040 comp rx=0 tx=0).stop 2024-02-17T14:28:26.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.360+0000 7f150f12c640 1 -- 172.21.15.134:0/3307591592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15080b0600 msgr2=0x7f15081daf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.360+0000 7f150f12c640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15080b0600 0x7f15081daf40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00c440 tx=0x7f14fc001e70 comp rx=0 tx=0).stop 2024-02-17T14:28:26.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.360+0000 7f150f12c640 1 -- 172.21.15.134:0/3307591592 shutdown_connections 2024-02-17T14:28:26.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.360+0000 7f150f12c640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15080b5020 0x7f150813f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.360+0000 7f150f12c640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f14f406b840 0x7f14f406dd00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.360+0000 7f150f12c640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15080b0600 0x7f15081daf40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.360+0000 7f150f12c640 1 --2- 172.21.15.134:0/3307591592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1508071940 0x7f15081daa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.360+0000 7f150f12c640 1 -- 172.21.15.134:0/3307591592 >> 172.21.15.134:0/3307591592 conn(0x7f15080ba430 msgr2=0x7f15080b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:26.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.360+0000 7f150f12c640 1 -- 172.21.15.134:0/3307591592 shutdown_connections 2024-02-17T14:28:26.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.360+0000 7f150f12c640 1 -- 172.21.15.134:0/3307591592 wait complete. 2024-02-17T14:28:26.371 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":653762796},{"type":"v1","addr":"172.21.15.134:6833","nonce":653762796}]},"active_addr":"172.21.15.134:6833/653762796","active_change":"2024-02-17T14:27:50.550697+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":2220823472}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":3595200006}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1067639887}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1427102815}]}]} 2024-02-17T14:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-17T14:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-17T14:28:26.375 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:26.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.475+0000 7fa0feb6c640 1 Processor -- start 2024-02-17T14:28:26.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.475+0000 7fa0feb6c640 1 -- start start 2024-02-17T14:28:26.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.476+0000 7fa0feb6c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0f80720e0 0x7fa0f8070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.476+0000 7fa0feb6c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa0f8070c50 0x7fa0f80b5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.476+0000 7fa0feb6c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f81474e0 con 0x7fa0f80b3440 2024-02-17T14:28:26.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.476+0000 7fa0feb6c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f80b5c60 con 0x7fa0f8070c50 2024-02-17T14:28:26.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.476+0000 7fa0feb6c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f8071090 con 0x7fa0f80720e0 2024-02-17T14:28:26.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.476+0000 7fa0fd109640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa0f8070c50 0x7fa0f80b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.476+0000 7fa0fd109640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa0f8070c50 0x7fa0f80b5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46088/0 (socket says 172.21.15.134:46088) 2024-02-17T14:28:26.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.476+0000 7fa0fd109640 1 -- 172.21.15.134:0/2201068558 learned_addr learned my addr 172.21.15.134:0/2201068558 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:26.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.476+0000 7fa0fc908640 1 --2- 172.21.15.134:0/2201068558 >> v2:172.21.15.142:3300/0 conn(0x7fa0f80720e0 0x7fa0f8070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.476+0000 7fa0fd109640 1 -- 172.21.15.134:0/2201068558 >> v2:172.21.15.142:3300/0 conn(0x7fa0f80720e0 msgr2=0x7fa0f8070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:26.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.477+0000 7fa0fd109640 1 --2- 172.21.15.134:0/2201068558 >> v2:172.21.15.142:3300/0 conn(0x7fa0f80720e0 0x7fa0f8070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.477+0000 7fa0fd109640 1 -- 172.21.15.134:0/2201068558 >> v1:172.21.15.142:6789/0 conn(0x7fa0f80b3440 legacy=0x7fa0f80b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.477+0000 7fa0fd109640 1 -- 172.21.15.134:0/2201068558 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f8147720 con 0x7fa0f8070c50 2024-02-17T14:28:26.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.477+0000 7fa0fd109640 1 --2- 172.21.15.134:0/2201068558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f8070c50 0x7fa0f80b5720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa0f806cc30 tx=0x7fa0f002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c5fc01a933c89 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:26.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.477+0000 7fa0f77fe640 1 -- 172.21.15.134:0/2201068558 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f002ca80 con 0x7fa0f8070c50 2024-02-17T14:28:26.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.477+0000 7fa0f77fe640 1 -- 172.21.15.134:0/2201068558 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f002cbe0 con 0x7fa0f8070c50 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.477+0000 7fa0f77fe640 1 -- 172.21.15.134:0/2201068558 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00343f0 con 0x7fa0f8070c50 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.478+0000 7fa0feb6c640 1 -- 172.21.15.134:0/2201068558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f8070c50 msgr2=0x7fa0f80b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.478+0000 7fa0feb6c640 1 --2- 172.21.15.134:0/2201068558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f8070c50 0x7fa0f80b5720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa0f806cc30 tx=0x7fa0f002bee0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.478+0000 7fa0feb6c640 1 -- 172.21.15.134:0/2201068558 shutdown_connections 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.478+0000 7fa0feb6c640 1 --2- 172.21.15.134:0/2201068558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f8070c50 0x7fa0f80b5720 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.478+0000 7fa0feb6c640 1 --2- 172.21.15.134:0/2201068558 >> v2:172.21.15.142:3300/0 conn(0x7fa0f80720e0 0x7fa0f8070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.478+0000 7fa0feb6c640 1 -- 172.21.15.134:0/2201068558 >> 172.21.15.134:0/2201068558 conn(0x7fa0f80b9350 msgr2=0x7fa0f80b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.478+0000 7fa0feb6c640 1 -- 172.21.15.134:0/2201068558 shutdown_connections 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.478+0000 7fa0feb6c640 1 -- 172.21.15.134:0/2201068558 wait complete. 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.479+0000 7fa0feb6c640 1 Processor -- start 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.479+0000 7fa0feb6c640 1 -- start start 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0feb6c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f8070c50 0x7fa0f813cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0feb6c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0f80720e0 0x7fa0f8135aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0feb6c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f80b3440 0x7fa0f81346d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0feb6c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f8150e30 con 0x7fa0f80b3440 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0feb6c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f8140ce0 con 0x7fa0f80720e0 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0feb6c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f81512c0 con 0x7fa0f8070c50 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0fd109640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f80b3440 0x7fa0f81346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0fd109640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f80b3440 0x7fa0f81346d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46090/0 (socket says 172.21.15.134:46090) 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0fd109640 1 -- 172.21.15.134:0/826553496 learned_addr learned my addr 172.21.15.134:0/826553496 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0fc908640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f8070c50 0x7fa0f813cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0f7fff640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0f80720e0 0x7fa0f8135aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0fd109640 1 -- 172.21.15.134:0/826553496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f8070c50 msgr2=0x7fa0f813cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0fd109640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f8070c50 0x7fa0f813cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0fd109640 1 -- 172.21.15.134:0/826553496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0f80720e0 msgr2=0x7fa0f8135aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0fd109640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0f80720e0 0x7fa0f8135aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0fd109640 1 -- 172.21.15.134:0/826553496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f0009b30 con 0x7fa0f80b3440 2024-02-17T14:28:26.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0fd109640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f80b3440 0x7fa0f81346d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009f40 tx=0x7fa0f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:26.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0f57fa640 1 -- 172.21.15.134:0/826553496 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0009510 con 0x7fa0f80b3440 2024-02-17T14:28:26.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0f57fa640 1 -- 172.21.15.134:0/826553496 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f003e450 con 0x7fa0f80b3440 2024-02-17T14:28:26.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0f57fa640 1 -- 172.21.15.134:0/826553496 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f003e800 con 0x7fa0f80b3440 2024-02-17T14:28:26.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0feb6c640 1 -- 172.21.15.134:0/826553496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f8144830 con 0x7fa0f80b3440 2024-02-17T14:28:26.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.480+0000 7fa0feb6c640 1 -- 172.21.15.134:0/826553496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f8135490 con 0x7fa0f80b3440 2024-02-17T14:28:26.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.481+0000 7fa0feb6c640 1 -- 172.21.15.134:0/826553496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f8150fa0 con 0x7fa0f80b3440 2024-02-17T14:28:26.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.482+0000 7fa0f57fa640 1 -- 172.21.15.134:0/826553496 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa0f002cd50 con 0x7fa0f80b3440 2024-02-17T14:28:26.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.482+0000 7fa0f57fa640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa0e406b840 0x7fa0e406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.482+0000 7fa0f57fa640 1 -- 172.21.15.134:0/826553496 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa0f00accf0 con 0x7fa0f80b3440 2024-02-17T14:28:26.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.482+0000 7fa0fc908640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa0e406b840 0x7fa0e406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.483+0000 7fa0fc908640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa0e406b840 0x7fa0e406dd00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009b40 tx=0x7fa0e8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:26.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.487+0000 7fa0f57fa640 1 -- 172.21.15.134:0/826553496 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0f00b1070 con 0x7fa0f80b3440 2024-02-17T14:28:26.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.659+0000 7fa0feb6c640 1 -- 172.21.15.134:0/826553496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0f8068280 con 0x7fa0f80b3440 2024-02-17T14:28:26.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.660+0000 7fa0f57fa640 1 -- 172.21.15.134:0/826553496 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7fa0f0077630 con 0x7fa0f80b3440 2024-02-17T14:28:26.661 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:26.661 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:07.990271+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:26.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.662+0000 7fa0feb6c640 1 -- 172.21.15.134:0/826553496 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa0e406b840 msgr2=0x7fa0e406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.662+0000 7fa0feb6c640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa0e406b840 0x7fa0e406dd00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009b40 tx=0x7fa0e8009190 comp rx=0 tx=0).stop 2024-02-17T14:28:26.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.662+0000 7fa0feb6c640 1 -- 172.21.15.134:0/826553496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f80b3440 msgr2=0x7fa0f81346d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.662+0000 7fa0feb6c640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f80b3440 0x7fa0f81346d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009f40 tx=0x7fa0f0004a40 comp rx=0 tx=0).stop 2024-02-17T14:28:26.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.662+0000 7fa0feb6c640 1 -- 172.21.15.134:0/826553496 shutdown_connections 2024-02-17T14:28:26.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.662+0000 7fa0feb6c640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa0e406b840 0x7fa0e406dd00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.662+0000 7fa0feb6c640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f80b3440 0x7fa0f81346d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.662+0000 7fa0feb6c640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0f80720e0 0x7fa0f8135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.662+0000 7fa0feb6c640 1 --2- 172.21.15.134:0/826553496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0f8070c50 0x7fa0f813cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.662+0000 7fa0feb6c640 1 -- 172.21.15.134:0/826553496 >> 172.21.15.134:0/826553496 conn(0x7fa0f80b9350 msgr2=0x7fa0f80b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:26.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.662+0000 7fa0feb6c640 1 -- 172.21.15.134:0/826553496 shutdown_connections 2024-02-17T14:28:26.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.662+0000 7fa0feb6c640 1 -- 172.21.15.134:0/826553496 wait complete. 2024-02-17T14:28:26.673 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-17T14:28:26.674 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:26.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.774+0000 7ff71f32c640 1 Processor -- start 2024-02-17T14:28:26.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.775+0000 7ff71f32c640 1 -- start start 2024-02-17T14:28:26.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.775+0000 7ff71f32c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7180b1640 0x7ff71813d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.775+0000 7ff71f32c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7180b0ba0 0x7ff71813da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.775+0000 7ff71f32c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff718073040 con 0x7ff7180b2e60 2024-02-17T14:28:26.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.775+0000 7ff71f32c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7180b3240 con 0x7ff7180b0ba0 2024-02-17T14:28:26.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.775+0000 7ff71f32c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7180b1ad0 con 0x7ff7180b1640 2024-02-17T14:28:26.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.775+0000 7ff71d8c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7180b0ba0 0x7ff71813da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.775+0000 7ff71d8c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7180b0ba0 0x7ff71813da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46104/0 (socket says 172.21.15.134:46104) 2024-02-17T14:28:26.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.775+0000 7ff71d8c9640 1 -- 172.21.15.134:0/1210701830 learned_addr learned my addr 172.21.15.134:0/1210701830 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:26.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.776+0000 7ff71c8c7640 1 --2- 172.21.15.134:0/1210701830 >> v2:172.21.15.142:3300/0 conn(0x7ff7180b1640 0x7ff71813d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.776+0000 7ff71d8c9640 1 -- 172.21.15.134:0/1210701830 >> v2:172.21.15.142:3300/0 conn(0x7ff7180b1640 msgr2=0x7ff71813d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:26.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.776+0000 7ff71d8c9640 1 --2- 172.21.15.134:0/1210701830 >> v2:172.21.15.142:3300/0 conn(0x7ff7180b1640 0x7ff71813d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.776+0000 7ff71d8c9640 1 -- 172.21.15.134:0/1210701830 >> v1:172.21.15.142:6789/0 conn(0x7ff7180b2e60 legacy=0x7ff7180b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:26.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.776+0000 7ff71d8c9640 1 -- 172.21.15.134:0/1210701830 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718072b20 con 0x7ff7180b0ba0 2024-02-17T14:28:26.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.776+0000 7ff71d8c9640 1 --2- 172.21.15.134:0/1210701830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7180b0ba0 0x7ff71813da10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff71000d150 tx=0x7ff71002dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cdae7addbd76ebc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:26.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.776+0000 7ff70ffff640 1 -- 172.21.15.134:0/1210701830 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71002e970 con 0x7ff7180b0ba0 2024-02-17T14:28:26.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.777+0000 7ff70ffff640 1 -- 172.21.15.134:0/1210701830 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71002ead0 con 0x7ff7180b0ba0 2024-02-17T14:28:26.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.777+0000 7ff70ffff640 1 -- 172.21.15.134:0/1210701830 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71002ee60 con 0x7ff7180b0ba0 2024-02-17T14:28:26.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.777+0000 7ff71f32c640 1 -- 172.21.15.134:0/1210701830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7180b0ba0 msgr2=0x7ff71813da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.777+0000 7ff71f32c640 1 --2- 172.21.15.134:0/1210701830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7180b0ba0 0x7ff71813da10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff71000d150 tx=0x7ff71002dfd0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.777+0000 7ff71f32c640 1 -- 172.21.15.134:0/1210701830 shutdown_connections 2024-02-17T14:28:26.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.777+0000 7ff71f32c640 1 --2- 172.21.15.134:0/1210701830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7180b0ba0 0x7ff71813da10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.777+0000 7ff71f32c640 1 --2- 172.21.15.134:0/1210701830 >> v2:172.21.15.142:3300/0 conn(0x7ff7180b1640 0x7ff71813d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.777+0000 7ff71f32c640 1 -- 172.21.15.134:0/1210701830 >> 172.21.15.134:0/1210701830 conn(0x7ff7180b8270 msgr2=0x7ff7180b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:26.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.777+0000 7ff71f32c640 1 -- 172.21.15.134:0/1210701830 shutdown_connections 2024-02-17T14:28:26.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.777+0000 7ff71f32c640 1 -- 172.21.15.134:0/1210701830 wait complete. 2024-02-17T14:28:26.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.778+0000 7ff71f32c640 1 Processor -- start 2024-02-17T14:28:26.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.778+0000 7ff71f32c640 1 -- start start 2024-02-17T14:28:26.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71f32c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7180b0ba0 0x7ff7180b7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71f32c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7180b2e60 0x7ff7181cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71f32c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7181cc2d0 0x7ff7181cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71f32c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7181ca4c0 con 0x7ff7180b0ba0 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71f32c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7181417e0 con 0x7ff7180b2e60 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71f32c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7181cb590 con 0x7ff7181cc2d0 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71d0c8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7180b0ba0 0x7ff7180b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71d0c8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7180b0ba0 0x7ff7180b7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46110/0 (socket says 172.21.15.134:46110) 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71d0c8640 1 -- 172.21.15.134:0/2254920310 learned_addr learned my addr 172.21.15.134:0/2254920310 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71c8c7640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7180b2e60 0x7ff7181cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71d8c9640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7181cc2d0 0x7ff7181cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71d0c8640 1 -- 172.21.15.134:0/2254920310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7181cc2d0 msgr2=0x7ff7181cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71d0c8640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7181cc2d0 0x7ff7181cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71d0c8640 1 -- 172.21.15.134:0/2254920310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7180b2e60 msgr2=0x7ff7181cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71d0c8640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7180b2e60 0x7ff7181cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71d0c8640 1 -- 172.21.15.134:0/2254920310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71000bd40 con 0x7ff7180b0ba0 2024-02-17T14:28:26.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71c8c7640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7180b2e60 0x7ff7181cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:26.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71d8c9640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7181cc2d0 0x7ff7181cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:26.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.779+0000 7ff71d0c8640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7180b0ba0 0x7ff7180b7310 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff70800b3f0 tx=0x7ff70800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:26.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.780+0000 7ff70dffb640 1 -- 172.21.15.134:0/2254920310 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708011830 con 0x7ff7180b0ba0 2024-02-17T14:28:26.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.780+0000 7ff70dffb640 1 -- 172.21.15.134:0/2254920310 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff708011990 con 0x7ff7180b0ba0 2024-02-17T14:28:26.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.780+0000 7ff70dffb640 1 -- 172.21.15.134:0/2254920310 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708011d40 con 0x7ff7180b0ba0 2024-02-17T14:28:26.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.780+0000 7ff71f32c640 1 -- 172.21.15.134:0/2254920310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff718141520 con 0x7ff7180b0ba0 2024-02-17T14:28:26.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.780+0000 7ff71f32c640 1 -- 172.21.15.134:0/2254920310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7181cb8c0 con 0x7ff7180b0ba0 2024-02-17T14:28:26.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.781+0000 7ff71f32c640 1 -- 172.21.15.134:0/2254920310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7181cbff0 con 0x7ff7180b0ba0 2024-02-17T14:28:26.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.781+0000 7ff70dffb640 1 -- 172.21.15.134:0/2254920310 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff70801a400 con 0x7ff7180b0ba0 2024-02-17T14:28:26.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.781+0000 7ff70dffb640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff6fc06b810 0x7ff6fc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:26.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.781+0000 7ff70dffb640 1 -- 172.21.15.134:0/2254920310 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff70808a2b0 con 0x7ff7180b0ba0 2024-02-17T14:28:26.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.781+0000 7ff71c8c7640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff6fc06b810 0x7ff6fc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:26.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.782+0000 7ff71c8c7640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff6fc06b810 0x7ff6fc06dcd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff718072500 tx=0x7ff714008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:26.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.786+0000 7ff70dffb640 1 -- 172.21.15.134:0/2254920310 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7181cbff0 con 0x7ff7180b0ba0 2024-02-17T14:28:26.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.956+0000 7ff71f32c640 1 -- 172.21.15.134:0/2254920310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7181cbff0 con 0x7ff7180b0ba0 2024-02-17T14:28:26.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.957+0000 7ff70dffb640 1 -- 172.21.15.134:0/2254920310 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7ff708054a20 con 0x7ff7180b0ba0 2024-02-17T14:28:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:26.957 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:07.990271+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:26.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.959+0000 7ff71f32c640 1 -- 172.21.15.134:0/2254920310 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff6fc06b810 msgr2=0x7ff6fc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.959+0000 7ff71f32c640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff6fc06b810 0x7ff6fc06dcd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff718072500 tx=0x7ff714008040 comp rx=0 tx=0).stop 2024-02-17T14:28:26.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.959+0000 7ff71f32c640 1 -- 172.21.15.134:0/2254920310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7180b0ba0 msgr2=0x7ff7180b7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:26.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.959+0000 7ff71f32c640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7180b0ba0 0x7ff7180b7310 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff70800b3f0 tx=0x7ff70800b8b0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.960+0000 7ff71f32c640 1 -- 172.21.15.134:0/2254920310 shutdown_connections 2024-02-17T14:28:26.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.960+0000 7ff71f32c640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7181cc2d0 0x7ff7181cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.960+0000 7ff71f32c640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7180b2e60 0x7ff7181cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.960+0000 7ff71f32c640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff6fc06b810 0x7ff6fc06dcd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.960+0000 7ff71f32c640 1 --2- 172.21.15.134:0/2254920310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7180b0ba0 0x7ff7180b7310 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:26.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.960+0000 7ff71f32c640 1 -- 172.21.15.134:0/2254920310 >> 172.21.15.134:0/2254920310 conn(0x7ff7180b8270 msgr2=0x7ff7180b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:26.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.960+0000 7ff71f32c640 1 -- 172.21.15.134:0/2254920310 shutdown_connections 2024-02-17T14:28:26.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:26.960+0000 7ff71f32c640 1 -- 172.21.15.134:0/2254920310 wait complete. 2024-02-17T14:28:26.970 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-17T14:28:26.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-17T14:28:26.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-17T14:28:26.972 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-17T14:28:26.972 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-17T14:28:26.972 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-17T14:28:26.973 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-17T14:28:26.973 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-17T14:28:27.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.139+0000 7f12c9f0d640 1 Processor -- start 2024-02-17T14:28:27.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.140+0000 7f12c9f0d640 1 -- start start 2024-02-17T14:28:27.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.140+0000 7f12c9f0d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f12bc006ed0 0x7f12bc0365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.140+0000 7f12c9f0d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc033800 0x7f12bc035630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.140+0000 7f12c9f0d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12bc02a020 con 0x7f12bc033c80 2024-02-17T14:28:27.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.140+0000 7f12c9f0d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc036410 con 0x7f12bc006ed0 2024-02-17T14:28:27.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.140+0000 7f12c9f0d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc029db0 con 0x7f12bc033800 2024-02-17T14:28:27.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.141+0000 7f12c37fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f12bc006ed0 0x7f12bc0365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.141+0000 7f12c2ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc033800 0x7f12bc035630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.141+0000 7f12c2ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc033800 0x7f12bc035630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:41248/0 (socket says 172.21.15.134:41248) 2024-02-17T14:28:27.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.141+0000 7f12c2ffd640 1 -- 172.21.15.134:0/2180376446 learned_addr learned my addr 172.21.15.134:0/2180376446 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.141+0000 7f12c2ffd640 1 -- 172.21.15.134:0/2180376446 >> v2:172.21.15.142:3300/0 conn(0x7f12bc006ed0 msgr2=0x7f12bc0365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.141+0000 7f12c2ffd640 1 --2- 172.21.15.134:0/2180376446 >> v2:172.21.15.142:3300/0 conn(0x7f12bc006ed0 0x7f12bc0365d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.141+0000 7f12c2ffd640 1 -- 172.21.15.134:0/2180376446 >> v1:172.21.15.142:6789/0 conn(0x7f12bc033c80 legacy=0x7f12bc0c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.141+0000 7f12c2ffd640 1 -- 172.21.15.134:0/2180376446 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc036130 con 0x7f12bc033800 2024-02-17T14:28:27.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.142+0000 7f12c2ffd640 1 --2- 172.21.15.134:0/2180376446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc033800 0x7f12bc035630 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f12c4068220 tx=0x7f12c40a65d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8c869cf781795ce server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.142+0000 7f12c27fc640 1 -- 172.21.15.134:0/2180376446 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40ab7d0 con 0x7f12bc033800 2024-02-17T14:28:27.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.143+0000 7f12c27fc640 1 -- 172.21.15.134:0/2180376446 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c40a9050 con 0x7f12bc033800 2024-02-17T14:28:27.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.143+0000 7f12c27fc640 1 -- 172.21.15.134:0/2180376446 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40abbf0 con 0x7f12bc033800 2024-02-17T14:28:27.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.144+0000 7f12c9f0d640 1 -- 172.21.15.134:0/2180376446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc033800 msgr2=0x7f12bc035630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.144+0000 7f12c9f0d640 1 --2- 172.21.15.134:0/2180376446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc033800 0x7f12bc035630 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f12c4068220 tx=0x7f12c40a65d0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.144+0000 7f12c9f0d640 1 -- 172.21.15.134:0/2180376446 shutdown_connections 2024-02-17T14:28:27.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.144+0000 7f12c9f0d640 1 --2- 172.21.15.134:0/2180376446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc033800 0x7f12bc035630 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.144+0000 7f12c9f0d640 1 --2- 172.21.15.134:0/2180376446 >> v2:172.21.15.142:3300/0 conn(0x7f12bc006ed0 0x7f12bc0365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.144+0000 7f12c9f0d640 1 -- 172.21.15.134:0/2180376446 >> 172.21.15.134:0/2180376446 conn(0x7f12bc03a8d0 msgr2=0x7f12bc03ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.144+0000 7f12c9f0d640 1 -- 172.21.15.134:0/2180376446 shutdown_connections 2024-02-17T14:28:27.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.144+0000 7f47ad175640 1 Processor -- start 2024-02-17T14:28:27.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.144+0000 7f12c9f0d640 1 -- 172.21.15.134:0/2180376446 wait complete. 2024-02-17T14:28:27.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.145+0000 7f12c9f0d640 1 Processor -- start 2024-02-17T14:28:27.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.145+0000 7fe356bd0640 1 Processor -- start 2024-02-17T14:28:27.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.145+0000 7fe356bd0640 1 -- start start 2024-02-17T14:28:27.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.144+0000 7f47ad175640 1 -- start start 2024-02-17T14:28:27.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.146+0000 7fe356bd0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe350072a70 0x7fe3500afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.146+0000 7fe356bd0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe35014e7f0 0x7fe35014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.146+0000 7fe356bd0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3500b24c0 con 0x7fe35014f1a0 2024-02-17T14:28:27.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.146+0000 7fe356bd0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3500af7f0 con 0x7fe35014e7f0 2024-02-17T14:28:27.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.146+0000 7fe356bd0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe350072e50 con 0x7fe350072a70 2024-02-17T14:28:27.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.145+0000 7f47ad175640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f47a8099d00 0x7f47a809a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.146+0000 7f12c9f0d640 1 -- start start 2024-02-17T14:28:27.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.145+0000 7f47ad175640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a8143a40 0x7f47a814d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.146+0000 7fe35516d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe35014f1a0 0x7fe35014b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51038/0 (socket says 172.21.15.134:51038) 2024-02-17T14:28:27.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.146+0000 7fe35516d640 1 -- 172.21.15.134:0/2835071198 learned_addr learned my addr 172.21.15.134:0/2835071198 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:27.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.146+0000 7fe35496c640 1 --2- 172.21.15.134:0/2835071198 >> v2:172.21.15.142:3300/0 conn(0x7fe350072a70 0x7fe3500afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.145+0000 7f47ad175640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a809a0e0 con 0x7f47a809aac0 2024-02-17T14:28:27.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.145+0000 7f47ad175640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a80ae080 con 0x7f47a8099d00 2024-02-17T14:28:27.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.145+0000 7f47ad175640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80ade10 con 0x7f47a8143a40 2024-02-17T14:28:27.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.145+0000 7fe79759e640 1 Processor -- start 2024-02-17T14:28:27.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.145+0000 7fe79759e640 1 -- start start 2024-02-17T14:28:27.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7fe79759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7980b3170 0x7fe798072110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7fe79759e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7980b47a0 con 0x7fe79814b0f0 2024-02-17T14:28:27.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7fe79759e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79814b680 con 0x7fe7980b43c0 2024-02-17T14:28:27.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7fe79759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79814b960 con 0x7fe7980b3170 2024-02-17T14:28:27.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7fe795d9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe79814b0f0 0x7fe7980b2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51052/0 (socket says 172.21.15.134:51052) 2024-02-17T14:28:27.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f12c9f0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc006ed0 0x7f12bc169b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f12c9f0d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc033800 0x7f12bc0b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f12c9f0d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12bc033c80 0x7f12bc0d7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f12c9f0d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0d8270 con 0x7f12bc033c80 2024-02-17T14:28:27.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f12c9f0d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0c4de0 con 0x7f12bc006ed0 2024-02-17T14:28:27.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f12c9f0d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc16a910 con 0x7f12bc033800 2024-02-17T14:28:27.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7fe795d9b640 1 -- 172.21.15.134:0/193954208 learned_addr learned my addr 172.21.15.134:0/193954208 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:27.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f12c37fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc006ed0 0x7f12bc169b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f12c37fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc006ed0 0x7f12bc169b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:41532/0 (socket says 172.21.15.134:41532) 2024-02-17T14:28:27.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f12c37fe640 1 -- 172.21.15.134:0/1448763171 learned_addr learned my addr 172.21.15.134:0/1448763171 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7fe34f7fe640 1 -- 172.21.15.134:0/2835071198 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553360171 0 0) 0x7fe3500b24c0 con 0x7fe35014f1a0 2024-02-17T14:28:27.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7fe34f7fe640 1 -- 172.21.15.134:0/2835071198 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe340003520 con 0x7fe35014f1a0 2024-02-17T14:28:27.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7fe35496c640 1 -- 172.21.15.134:0/2835071198 >> v2:172.21.15.134:3300/0 conn(0x7fe35014e7f0 msgr2=0x7fe35014ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7fe35496c640 1 --2- 172.21.15.134:0/2835071198 >> v2:172.21.15.134:3300/0 conn(0x7fe35014e7f0 0x7fe35014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7fe35496c640 1 -- 172.21.15.134:0/2835071198 >> v1:172.21.15.134:6789/0 conn(0x7fe35014f1a0 legacy=0x7fe35014b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7fe35496c640 1 -- 172.21.15.134:0/2835071198 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3500b0680 con 0x7fe350072a70 2024-02-17T14:28:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.146+0000 7f47a7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f47a8099d00 0x7f47a809a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.146+0000 7f47a7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f47a8099d00 0x7f47a809a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46120/0 (socket says 172.21.15.134:46120) 2024-02-17T14:28:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.146+0000 7f47a7fff640 1 -- 172.21.15.134:0/3011744475 learned_addr learned my addr 172.21.15.134:0/3011744475 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.146+0000 7f47ac974640 1 --2- 172.21.15.134:0/3011744475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a8143a40 0x7f47a814d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f47a7fff640 1 -- 172.21.15.134:0/3011744475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a8143a40 msgr2=0x7f47a814d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f47a7fff640 1 --2- 172.21.15.134:0/3011744475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a8143a40 0x7f47a814d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f47a7fff640 1 -- 172.21.15.134:0/3011744475 >> v1:172.21.15.134:6789/0 conn(0x7f47a809aac0 legacy=0x7f47a8143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f47a7fff640 1 -- 172.21.15.134:0/3011744475 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a80ae860 con 0x7f47a8099d00 2024-02-17T14:28:27.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7fe796d9d640 1 --2- 172.21.15.134:0/193954208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7980b3170 0x7fe798072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.147+0000 7f12c3fff640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12bc033c80 0x7f12bc0d7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7f12c2ffd640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc033800 0x7f12bc0b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7f12c37fe640 1 -- 172.21.15.134:0/1448763171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc033800 msgr2=0x7f12bc0b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7f12c37fe640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc033800 0x7f12bc0b97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7f12c37fe640 1 -- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12bc033c80 msgr2=0x7f12bc0d7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7f3d49be2640 1 Processor -- start 2024-02-17T14:28:27.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7fe79559a640 1 -- 172.21.15.134:0/193954208 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530701489 0 0) 0x7fe7980b47a0 con 0x7fe79814b0f0 2024-02-17T14:28:27.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7fe79559a640 1 -- 172.21.15.134:0/193954208 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe780003520 con 0x7fe79814b0f0 2024-02-17T14:28:27.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7f12c37fe640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12bc033c80 0x7f12bc0d7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7f47a7fff640 1 --2- 172.21.15.134:0/3011744475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47a8099d00 0x7f47a809a580 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009410 tx=0x7f47a0030660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6516c0da5d44fcf3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7f12c37fe640 1 -- 172.21.15.134:0/1448763171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0d5e30 con 0x7f12bc006ed0 2024-02-17T14:28:27.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7f12c3fff640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12bc033c80 0x7f12bc0d7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7f3d49be2640 1 -- start start 2024-02-17T14:28:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7fe796d9d640 1 -- 172.21.15.134:0/193954208 >> v1:172.21.15.142:6789/0 conn(0x7fe7980b43c0 legacy=0x7fe7980ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7fe796d9d640 1 -- 172.21.15.134:0/193954208 >> v1:172.21.15.134:6789/0 conn(0x7fe79814b0f0 legacy=0x7fe7980b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.148+0000 7fe796d9d640 1 -- 172.21.15.134:0/193954208 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79814bc40 con 0x7fe7980b3170 2024-02-17T14:28:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7f47a6ffd640 1 -- 172.21.15.134:0/3011744475 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0037600 con 0x7f47a8099d00 2024-02-17T14:28:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7f47a6ffd640 1 -- 172.21.15.134:0/3011744475 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a0033050 con 0x7f47a8099d00 2024-02-17T14:28:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7f47a6ffd640 1 -- 172.21.15.134:0/3011744475 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0037980 con 0x7f47a8099d00 2024-02-17T14:28:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7fe35496c640 1 --2- 172.21.15.134:0/2835071198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe350072a70 0x7fe3500afc40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3500b90a0 tx=0x7fe34402b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24b585fa00085138 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7f3d49be2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3d440b00f0 0x7f3d44071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7fe34f7fe640 1 -- 172.21.15.134:0/2835071198 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344031740 con 0x7fe350072a70 2024-02-17T14:28:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7f3d49be2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d440b8980 0x7f3d440b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7f3d49be2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d440b0c10 con 0x7f3d440afc30 2024-02-17T14:28:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7f3d49be2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d440af7d0 con 0x7f3d440b00f0 2024-02-17T14:28:27.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7f3d49be2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d440b0e60 con 0x7f3d440b8980 2024-02-17T14:28:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7fe34f7fe640 1 -- 172.21.15.134:0/2835071198 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3440318a0 con 0x7fe350072a70 2024-02-17T14:28:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7fe34f7fe640 1 -- 172.21.15.134:0/2835071198 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344031c50 con 0x7fe350072a70 2024-02-17T14:28:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7f3d437fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3d440b00f0 0x7f3d44071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7f3d42ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3d440afc30 0x7f3d44142e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:41696/0 (socket says 172.21.15.134:41696) 2024-02-17T14:28:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7f3d42ffd640 1 -- 172.21.15.134:0/288895466 learned_addr learned my addr 172.21.15.134:0/288895466 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:27.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7f3d43fff640 1 --2- 172.21.15.134:0/288895466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d440b8980 0x7f3d440b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.149+0000 7fe796d9d640 1 --2- 172.21.15.134:0/193954208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7980b3170 0x7fe798072110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe790009dc0 tx=0x7fe79002bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42adc9e4348d52e6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f3d437fe640 1 -- 172.21.15.134:0/288895466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d440b8980 msgr2=0x7f3d440b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f3d437fe640 1 --2- 172.21.15.134:0/288895466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d440b8980 0x7f3d440b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f12c37fe640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc006ed0 0x7f12bc169b00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12b800e9b0 tx=0x7f12b800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f3d437fe640 1 -- 172.21.15.134:0/288895466 >> v1:172.21.15.142:6789/0 conn(0x7f3d440afc30 legacy=0x7f3d44142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f3d437fe640 1 -- 172.21.15.134:0/288895466 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d44072c40 con 0x7f3d440b00f0 2024-02-17T14:28:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7fe79559a640 1 -- 172.21.15.134:0/193954208 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79002cba0 con 0x7fe7980b3170 2024-02-17T14:28:27.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7fe79559a640 1 -- 172.21.15.134:0/193954208 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79002cd00 con 0x7fe7980b3170 2024-02-17T14:28:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f47ad175640 1 -- 172.21.15.134:0/3011744475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47a8099d00 msgr2=0x7f47a809a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f47ad175640 1 --2- 172.21.15.134:0/3011744475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47a8099d00 0x7f47a809a580 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009410 tx=0x7f47a0030660 comp rx=0 tx=0).stop 2024-02-17T14:28:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f47ad175640 1 -- 172.21.15.134:0/3011744475 shutdown_connections 2024-02-17T14:28:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f47ad175640 1 --2- 172.21.15.134:0/3011744475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a8143a40 0x7f47a814d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f47ad175640 1 --2- 172.21.15.134:0/3011744475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47a8099d00 0x7f47a809a580 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f47ad175640 1 -- 172.21.15.134:0/3011744475 >> 172.21.15.134:0/3011744475 conn(0x7f47a80b4b60 msgr2=0x7f47a80b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f12affff640 1 -- 172.21.15.134:0/1448763171 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8009670 con 0x7f12bc006ed0 2024-02-17T14:28:27.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f12affff640 1 -- 172.21.15.134:0/1448763171 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b800c9a0 con 0x7f12bc006ed0 2024-02-17T14:28:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f12affff640 1 -- 172.21.15.134:0/1448763171 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b800cd50 con 0x7f12bc006ed0 2024-02-17T14:28:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7fe356bd0640 1 -- 172.21.15.134:0/2835071198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe350072a70 msgr2=0x7fe3500afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.150+0000 7f12c9f0d640 1 -- 172.21.15.134:0/1448763171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12bc0d6110 con 0x7f12bc006ed0 2024-02-17T14:28:27.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7f12c9f0d640 1 -- 172.21.15.134:0/1448763171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc0b9cf0 con 0x7f12bc006ed0 2024-02-17T14:28:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7f47ad175640 1 -- 172.21.15.134:0/3011744475 shutdown_connections 2024-02-17T14:28:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7f47ad175640 1 -- 172.21.15.134:0/3011744475 wait complete. 2024-02-17T14:28:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7fe356bd0640 1 --2- 172.21.15.134:0/2835071198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe350072a70 0x7fe3500afc40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3500b90a0 tx=0x7fe34402b7e0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7fe79759e640 1 -- 172.21.15.134:0/193954208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7980b3170 msgr2=0x7fe798072110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7fe79759e640 1 --2- 172.21.15.134:0/193954208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7980b3170 0x7fe798072110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe790009dc0 tx=0x7fe79002bdf0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7fe356bd0640 1 -- 172.21.15.134:0/2835071198 shutdown_connections 2024-02-17T14:28:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7fe356bd0640 1 --2- 172.21.15.134:0/2835071198 >> v2:172.21.15.134:3300/0 conn(0x7fe35014e7f0 0x7fe35014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7fe356bd0640 1 --2- 172.21.15.134:0/2835071198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe350072a70 0x7fe3500afc40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7fe356bd0640 1 -- 172.21.15.134:0/2835071198 >> 172.21.15.134:0/2835071198 conn(0x7fe35006b480 msgr2=0x7fe3500b8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7fe79759e640 1 -- 172.21.15.134:0/193954208 shutdown_connections 2024-02-17T14:28:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7fe79759e640 1 --2- 172.21.15.134:0/193954208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7980b3170 0x7fe798072110 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7fe79759e640 1 -- 172.21.15.134:0/193954208 >> 172.21.15.134:0/193954208 conn(0x7fe7980b4b60 msgr2=0x7fe7980b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7fe356bd0640 1 -- 172.21.15.134:0/2835071198 shutdown_connections 2024-02-17T14:28:27.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.152+0000 7f12c9f0d640 1 -- 172.21.15.134:0/1448763171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12a4001030 con 0x7f12bc006ed0 2024-02-17T14:28:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7f07baeb5640 1 Processor -- start 2024-02-17T14:28:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.151+0000 7f07baeb5640 1 -- start start 2024-02-17T14:28:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.152+0000 7fe356bd0640 1 -- 172.21.15.134:0/2835071198 wait complete. 2024-02-17T14:28:27.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.152+0000 7fbbc8bc1640 1 Processor -- start 2024-02-17T14:28:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.152+0000 7fbbc8bc1640 1 -- start start 2024-02-17T14:28:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.152+0000 7f07baeb5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f07b40b1a40 0x7f07b4072060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.152+0000 7f47ad175640 1 Processor -- start 2024-02-17T14:28:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.152+0000 7f07baeb5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b4146ca0 con 0x7f07b406da40 2024-02-17T14:28:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.152+0000 7f07baeb5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b406f480 con 0x7f07b40b21a0 2024-02-17T14:28:27.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.152+0000 7f07baeb5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b4146f50 con 0x7f07b40b1a40 2024-02-17T14:28:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.152+0000 7f47ad175640 1 -- start start 2024-02-17T14:28:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f12affff640 1 -- 172.21.15.134:0/1448763171 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f12b8005990 con 0x7f12bc006ed0 2024-02-17T14:28:27.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f3d437fe640 1 --2- 172.21.15.134:0/288895466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d440b00f0 0x7f3d44071f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009d90 tx=0x7f3d3c02e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd9b29a1b541914 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b3fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f07b40b21a0 0x7f07b40afeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:41708/0 (socket says 172.21.15.134:41708) 2024-02-17T14:28:27.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b3fff640 1 -- 172.21.15.134:0/3131877309 learned_addr learned my addr 172.21.15.134:0/3131877309 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:27.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b8c51640 1 --2- 172.21.15.134:0/3131877309 >> v2:172.21.15.134:3300/0 conn(0x7f07b40b1a40 0x7f07b4072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543760052 0 0) 0x7f07b406f480 con 0x7f07b40b21a0 2024-02-17T14:28:27.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a4007930 con 0x7f07b40b21a0 2024-02-17T14:28:27.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7fbbc8bc1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc0369c0 0x7fbbbc035920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7fbbc8bc1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbbbc036da0 0x7fbbbc0d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f12affff640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f12a806b860 0x7f12a806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f3d427fc640 1 -- 172.21.15.134:0/288895466 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c02ede0 con 0x7f3d440b00f0 2024-02-17T14:28:27.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7fbbc37fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc0369c0 0x7fbbbc035920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7fe356bd0640 1 Processor -- start 2024-02-17T14:28:27.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f3d427fc640 1 -- 172.21.15.134:0/288895466 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c036440 con 0x7f3d440b00f0 2024-02-17T14:28:27.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f3d427fc640 1 -- 172.21.15.134:0/288895466 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c0367d0 con 0x7f3d440b00f0 2024-02-17T14:28:27.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7fe356bd0640 1 -- start start 2024-02-17T14:28:27.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3440303185 0 0) 0x7f07a4007930 con 0x7f07b40b21a0 2024-02-17T14:28:27.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7fbbc37fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc0369c0 0x7fbbbc035920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:41292/0 (socket says 172.21.15.134:41292) 2024-02-17T14:28:27.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7fbbc2ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbbbc036da0 0x7fbbbc0d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7fbbc2ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbbbc036da0 0x7fbbbc0d1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:41540/0 (socket says 172.21.15.134:41540) 2024-02-17T14:28:27.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7fbbc37fe640 1 -- 172.21.15.134:0/2577171887 learned_addr learned my addr 172.21.15.134:0/2577171887 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 >> v2:172.21.15.134:3300/0 conn(0x7f07b40b1a40 msgr2=0x7f07b4072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f12affff640 1 -- 172.21.15.134:0/1448763171 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f12b808afe0 con 0x7f12bc006ed0 2024-02-17T14:28:27.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f12affff640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] conn(0x7f12a8074fd0 0x7f12a8077410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f12affff640 1 -- 172.21.15.134:0/1448763171 --> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12a8077ae0 con 0x7f12a8074fd0 2024-02-17T14:28:27.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f12affff640 1 -- 172.21.15.134:0/1448763171 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12b808b350 con 0x7f12bc006ed0 2024-02-17T14:28:27.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 --2- 172.21.15.134:0/3131877309 >> v2:172.21.15.134:3300/0 conn(0x7f07b40b1a40 0x7f07b4072060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 >> v1:172.21.15.134:6789/0 conn(0x7f07b406da40 legacy=0x7f07b414d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b4147230 con 0x7f07b40b21a0 2024-02-17T14:28:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f07a0001670 con 0x7f07b40b21a0 2024-02-17T14:28:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 >> v1:172.21.15.142:6789/0 conn(0x7f07b40b21a0 legacy=0x7f07b40afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 --2- 172.21.15.134:0/3131877309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07a4007da0 0x7f07a40081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 --2- 172.21.15.134:0/3131877309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07a4008bd0 0x7f07a4009050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 --2- 172.21.15.134:0/3131877309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a4009590 0x7f07a400fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b4146f50 con 0x7f07a4009590 2024-02-17T14:28:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40104c0 con 0x7f07a4007da0 2024-02-17T14:28:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.153+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a4010680 con 0x7f07a4008bd0 2024-02-17T14:28:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f07b3fff640 1 --2- 172.21.15.134:0/3131877309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07a4008bd0 0x7f07a4009050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f07b8c51640 1 --2- 172.21.15.134:0/3131877309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07a4007da0 0x7f07a40081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/2577171887 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbbc0d0cb0 con 0x7fbbbc0d1680 2024-02-17T14:28:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f12c2ffd640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f12a806b860 0x7f12a806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/2577171887 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbbc0387d0 con 0x7fbbbc036da0 2024-02-17T14:28:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/2577171887 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc0d0960 con 0x7fbbbc0369c0 2024-02-17T14:28:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f47ad175640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a8099d00 0x7f47a80719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f47ad175640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47a809aac0 0x7f47a80b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f07b3fff640 1 -- 172.21.15.134:0/3131877309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07a4007da0 msgr2=0x7f07a40081e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f07b3fff640 1 --2- 172.21.15.134:0/3131877309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07a4007da0 0x7f07a40081e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f07b3fff640 1 -- 172.21.15.134:0/3131877309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a4009590 msgr2=0x7f07a400fd90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T14:28:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f07b3fff640 1 --2- 172.21.15.134:0/3131877309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a4009590 0x7f07a400fd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f07b3fff640 1 -- 172.21.15.134:0/3131877309 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b4147230 con 0x7f07a4008bd0 2024-02-17T14:28:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f12c2ffd640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f12a806b860 0x7f12a806dd20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f12bc029ef0 tx=0x7f12c406e030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f07b8c51640 1 --2- 172.21.15.134:0/3131877309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07a4007da0 0x7f07a40081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f07b9452640 1 -- 172.21.15.134:0/3131877309 reap_dead start 2024-02-17T14:28:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fe356bd0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe350072a70 0x7fe350141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fe356bd0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe35014e7f0 0x7fe35013eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f47a7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a8099d00 0x7f47a80719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.154+0000 7f47a7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a8099d00 0x7f47a80719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:41316/0 (socket says 172.21.15.134:41316) 2024-02-17T14:28:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f47a77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47a809aac0 0x7f47a80b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f47a7fff640 1 -- 172.21.15.134:0/3914887794 learned_addr learned my addr 172.21.15.134:0/3914887794 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fe356bd0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe35014f1a0 0x7fe35013f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f47ad175640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a8143a40 0x7f47a81d3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f47ad175640 1 -- 172.21.15.134:0/3914887794 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a81e1c00 con 0x7f47a809aac0 2024-02-17T14:28:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f47ad175640 1 -- 172.21.15.134:0/3914887794 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8071f20 con 0x7f47a8143a40 2024-02-17T14:28:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f47ad175640 1 -- 172.21.15.134:0/3914887794 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a81e1310 con 0x7f47a8099d00 2024-02-17T14:28:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f3d49be2640 1 -- 172.21.15.134:0/288895466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d440b00f0 msgr2=0x7f3d44071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f3d49be2640 1 --2- 172.21.15.134:0/288895466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d440b00f0 0x7f3d44071f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009d90 tx=0x7f3d3c02e030 comp rx=0 tx=0).stop 2024-02-17T14:28:27.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f07b3fff640 1 --2- 172.21.15.134:0/3131877309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07a4008bd0 0x7f07a4009050 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f07b40b25a0 tx=0x7f07a4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e6936d461ac20b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107257231 0 0) 0x7fbbbc0d0cb0 con 0x7fbbbc0d1680 2024-02-17T14:28:27.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fe356bd0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3501413b0 con 0x7fe35014e7f0 2024-02-17T14:28:27.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fe356bd0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35014a6d0 con 0x7fe35014f1a0 2024-02-17T14:28:27.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fe356bd0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe350142900 con 0x7fe350072a70 2024-02-17T14:28:27.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb4003520 con 0x7fbbbc0d1680 2024-02-17T14:28:27.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1526860976 0 0) 0x7fbbb4003520 con 0x7fbbbc0d1680 2024-02-17T14:28:27.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f3d49be2640 1 -- 172.21.15.134:0/288895466 shutdown_connections 2024-02-17T14:28:27.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fe35496c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe350072a70 0x7fe350141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc0369c0 msgr2=0x7fbbbc035920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fbbc27fc640 1 --2- 172.21.15.134:0/2577171887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc0369c0 0x7fbbbc035920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 >> v2:172.21.15.142:3300/0 conn(0x7fbbbc036da0 msgr2=0x7fbbbc0d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fbbc27fc640 1 --2- 172.21.15.134:0/2577171887 >> v2:172.21.15.142:3300/0 conn(0x7fbbbc036da0 0x7fbbbc0d1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fe34ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe35014e7f0 0x7fe35013eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fe34ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe35014e7f0 0x7fe35013eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46172/0 (socket says 172.21.15.134:46172) 2024-02-17T14:28:27.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fe34ffff640 1 -- 172.21.15.134:0/72500022 learned_addr learned my addr 172.21.15.134:0/72500022 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc038170 con 0x7fbbbc0d1680 2024-02-17T14:28:27.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7fbbc404f730 con 0x7fbbbc0d1680 2024-02-17T14:28:27.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f3d49be2640 1 --2- 172.21.15.134:0/288895466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d440b8980 0x7f3d440b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f3d49be2640 1 --2- 172.21.15.134:0/288895466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d440b00f0 0x7f3d44071f20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f3d49be2640 1 -- 172.21.15.134:0/288895466 >> 172.21.15.134:0/288895466 conn(0x7f3d4406b480 msgr2=0x7f3d440b8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 >> v1:172.21.15.134:6789/0 conn(0x7fbbbc0d1680 legacy=0x7fbbbc0ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fbbc27fc640 1 --2- 172.21.15.134:0/2577171887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb4003970 0x7fbbb4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f12c3fff640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] conn(0x7f12a8074fd0 0x7f12a8077410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fbbc27fc640 1 --2- 172.21.15.134:0/2577171887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc0369c0 0x7fbbb40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fbbc27fc640 1 --2- 172.21.15.134:0/2577171887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbb4004d00 0x7fbbb4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc0387d0 con 0x7fbbb4003970 2024-02-17T14:28:27.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc0d0960 con 0x7fbbb4004d00 2024-02-17T14:28:27.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb400b980 con 0x7fbbbc0369c0 2024-02-17T14:28:27.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fbbc37fe640 1 --2- 172.21.15.134:0/2577171887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb4003970 0x7fbbb4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fbbc2ffd640 1 --2- 172.21.15.134:0/2577171887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc0369c0 0x7fbbb40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fe79759e640 1 -- 172.21.15.134:0/193954208 shutdown_connections 2024-02-17T14:28:27.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fe79759e640 1 -- 172.21.15.134:0/193954208 wait complete. 2024-02-17T14:28:27.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a002cb70 con 0x7f07a4008bd0 2024-02-17T14:28:27.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a002ccd0 con 0x7f07a4008bd0 2024-02-17T14:28:27.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f07b37fe640 1 -- 172.21.15.134:0/3131877309 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a002cb70 con 0x7f07a4008bd0 2024-02-17T14:28:27.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7fe35516d640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe35014f1a0 0x7fe35013f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fbbc3fff640 1 --2- 172.21.15.134:0/2577171887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbb4004d00 0x7fbbb4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7f12c3fff640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] conn(0x7f12a8074fd0 0x7f12a8077410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7f3d49be2640 1 -- 172.21.15.134:0/288895466 shutdown_connections 2024-02-17T14:28:27.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fbbc2ffd640 1 -- 172.21.15.134:0/2577171887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbb4004d00 msgr2=0x7fbbb4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fbbc2ffd640 1 --2- 172.21.15.134:0/2577171887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbb4004d00 0x7fbbb4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fbbc2ffd640 1 -- 172.21.15.134:0/2577171887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb4003970 msgr2=0x7fbbb4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fbbc2ffd640 1 --2- 172.21.15.134:0/2577171887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb4003970 0x7fbbb4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fbbc2ffd640 1 -- 172.21.15.134:0/2577171887 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb4003520 con 0x7fbbbc0369c0 2024-02-17T14:28:27.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fe35516d640 1 -- 172.21.15.134:0/72500022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe350072a70 msgr2=0x7fe350141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fe35516d640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe350072a70 0x7fe350141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fe35516d640 1 -- 172.21.15.134:0/72500022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe35014e7f0 msgr2=0x7fe35013eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fe35516d640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe35014e7f0 0x7fe35013eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fe35516d640 1 -- 172.21.15.134:0/72500022 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe344009400 con 0x7fe35014f1a0 2024-02-17T14:28:27.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7fe35496c640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe350072a70 0x7fe350141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7f07baeb5640 1 -- 172.21.15.134:0/3131877309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07a4008bd0 msgr2=0x7f07a4009050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7f07baeb5640 1 --2- 172.21.15.134:0/3131877309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07a4008bd0 0x7f07a4009050 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f07b40b25a0 tx=0x7f07a4009c00 comp rx=0 tx=0).stop 2024-02-17T14:28:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7f07baeb5640 1 -- 172.21.15.134:0/3131877309 shutdown_connections 2024-02-17T14:28:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7f07baeb5640 1 --2- 172.21.15.134:0/3131877309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07a4008bd0 0x7f07a4009050 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.157+0000 7f07baeb5640 1 -- 172.21.15.134:0/3131877309 >> 172.21.15.134:0/3131877309 conn(0x7f07b40b8270 msgr2=0x7f07b40b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7f3d49be2640 1 -- 172.21.15.134:0/288895466 wait complete. 2024-02-17T14:28:27.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.157+0000 7f07baeb5640 1 -- 172.21.15.134:0/3131877309 shutdown_connections 2024-02-17T14:28:27.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.157+0000 7f07baeb5640 1 -- 172.21.15.134:0/3131877309 wait complete. 2024-02-17T14:28:27.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f47ac974640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a8143a40 0x7f47a81d3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f47a7fff640 1 -- 172.21.15.134:0/3914887794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a8143a40 msgr2=0x7f47a81d3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f47a7fff640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a8143a40 0x7f47a81d3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f47a7fff640 1 -- 172.21.15.134:0/3914887794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47a809aac0 msgr2=0x7f47a80b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f47a7fff640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47a809aac0 0x7f47a80b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.155+0000 7f47a7fff640 1 -- 172.21.15.134:0/3914887794 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a0009830 con 0x7f47a8099d00 2024-02-17T14:28:27.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7f47a77fe640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47a809aac0 0x7f47a80b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:27.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7f47a7fff640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a8099d00 0x7f47a80719e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f47a0000f80 tx=0x7f47a0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.157+0000 7fe35516d640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe35014f1a0 0x7fe35013f2e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe34800ca70 tx=0x7fe34800cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.157+0000 7f12affff640 1 -- 172.21.15.134:0/1448763171 <== osd.3 v2:172.21.15.134:6818/2845314185 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f12a8077ae0 con 0x7f12a8074fd0 2024-02-17T14:28:27.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7f47a4ff9640 1 -- 172.21.15.134:0/3914887794 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0045070 con 0x7f47a8099d00 2024-02-17T14:28:27.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.156+0000 7f47a4ff9640 1 -- 172.21.15.134:0/3914887794 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a0010e70 con 0x7f47a8099d00 2024-02-17T14:28:27.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.157+0000 7f47a4ff9640 1 -- 172.21.15.134:0/3914887794 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0014540 con 0x7f47a8099d00 2024-02-17T14:28:27.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.157+0000 7f47ad175640 1 -- 172.21.15.134:0/3914887794 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a81e15b0 con 0x7f47a8099d00 2024-02-17T14:28:27.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.157+0000 7f47ad175640 1 -- 172.21.15.134:0/3914887794 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a813aaf0 con 0x7f47a8099d00 2024-02-17T14:28:27.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.157+0000 7fe79759e640 1 Processor -- start 2024-02-17T14:28:27.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.157+0000 7fe79759e640 1 -- start start 2024-02-17T14:28:27.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7fe34d7fa640 1 -- 172.21.15.134:0/72500022 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800ab10 con 0x7fe35014f1a0 2024-02-17T14:28:27.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7fe34d7fa640 1 -- 172.21.15.134:0/72500022 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34800ac70 con 0x7fe35014f1a0 2024-02-17T14:28:27.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7fe34d7fa640 1 -- 172.21.15.134:0/72500022 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348012400 con 0x7fe35014f1a0 2024-02-17T14:28:27.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7f3d49be2640 1 Processor -- start 2024-02-17T14:28:27.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7fbbc2ffd640 1 --2- 172.21.15.134:0/2577171887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc0369c0 0x7fbbb40047c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009ac0 tx=0x7fbbb40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48013b8171cfc864 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7f07baeb5640 1 Processor -- start 2024-02-17T14:28:27.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7fe356bd0640 1 -- 172.21.15.134:0/72500022 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35014a360 con 0x7fe35014f1a0 2024-02-17T14:28:27.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7f3d49be2640 1 -- start start 2024-02-17T14:28:27.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7fe356bd0640 1 -- 172.21.15.134:0/72500022 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35014bf70 con 0x7fe35014f1a0 2024-02-17T14:28:27.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.159+0000 7f07baeb5640 1 -- start start 2024-02-17T14:28:27.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.159+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb002c710 con 0x7fbbbc0369c0 2024-02-17T14:28:27.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.159+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb002c870 con 0x7fbbbc0369c0 2024-02-17T14:28:27.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.159+0000 7fbbc27fc640 1 -- 172.21.15.134:0/2577171887 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb002cc00 con 0x7fbbbc0369c0 2024-02-17T14:28:27.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.159+0000 7f3817457640 1 Processor -- start 2024-02-17T14:28:27.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.159+0000 7f3817457640 1 -- start start 2024-02-17T14:28:27.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7fe79759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7980b43c0 0x7fe798071750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7fe79759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe79814b0f0 0x7fe79812ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7fe79759e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79812e310 0x7fe798131250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7fe79759e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7981340a0 con 0x7fe79812e310 2024-02-17T14:28:27.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7fe79759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe798132590 con 0x7fe7980b43c0 2024-02-17T14:28:27.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.158+0000 7fe79759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79812e7c0 con 0x7fe79814b0f0 2024-02-17T14:28:27.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.159+0000 7fe796d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79812e310 0x7fe798131250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.159+0000 7f3d49be2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d440afc30 0x7f3d440aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.159+0000 7f3d49be2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d440b8980 0x7f3d44140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.159+0000 7f3d49be2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d440abf00 0x7f3d441e4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.159+0000 7f3d49be2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d440ac3c0 con 0x7f3d440b8980 2024-02-17T14:28:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.159+0000 7f3d49be2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d440ace50 con 0x7f3d440abf00 2024-02-17T14:28:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.159+0000 7f3d49be2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d440aa4f0 con 0x7f3d440afc30 2024-02-17T14:28:27.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3d42ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d440b8980 0x7f3d44140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7fe79659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7980b43c0 0x7fe798071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7fe79659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7980b43c0 0x7fe798071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:41576/0 (socket says 172.21.15.134:41576) 2024-02-17T14:28:27.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7fe79659c640 1 -- 172.21.15.134:0/2204337405 learned_addr learned my addr 172.21.15.134:0/2204337405 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/2577171887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc0369c0 msgr2=0x7fbbb40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7fbbc8bc1640 1 --2- 172.21.15.134:0/2577171887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc0369c0 0x7fbbb40047c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009ac0 tx=0x7fbbb40057f0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3d42ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d440b8980 0x7f3d44140060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46206/0 (socket says 172.21.15.134:46206) 2024-02-17T14:28:27.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3d42ffd640 1 -- 172.21.15.134:0/2435208520 learned_addr learned my addr 172.21.15.134:0/2435208520 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7fbbc3fff640 1 -- 172.21.15.134:0/2577171887 reap_dead start 2024-02-17T14:28:27.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3817457640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3810072060 0x7f3810146410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3817457640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3810072440 0x7f3810146950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3817457640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381006f480 con 0x7f38100b1a40 2024-02-17T14:28:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3817457640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3810146f50 con 0x7f3810072060 2024-02-17T14:28:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3817457640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3810147230 con 0x7f3810072440 2024-02-17T14:28:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f47ad175640 1 -- 172.21.15.134:0/3914887794 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f47a806cd30 con 0x7f47a8099d00 2024-02-17T14:28:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7fe795d9b640 1 --2- 172.21.15.134:0/2204337405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe79814b0f0 0x7fe79812ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f38149f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3810072440 0x7f3810146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3d437fe640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d440afc30 0x7f3d440aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f38151f3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3810072060 0x7f3810146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f38151f3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3810072060 0x7f3810146410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46232/0 (socket says 172.21.15.134:46232) 2024-02-17T14:28:27.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f38151f3640 1 -- 172.21.15.134:0/559818949 learned_addr learned my addr 172.21.15.134:0/559818949 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f47a4ff9640 1 -- 172.21.15.134:0/3914887794 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f47a00146a0 con 0x7f47a8099d00 2024-02-17T14:28:27.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f07baeb5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a4008bd0 0x7f07b4142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f07baeb5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b413f4c0 0x7f07b413f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f07baeb5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b413ab10 0x7f07b413af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f07baeb5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b41402a0 con 0x7f07a4008bd0 2024-02-17T14:28:27.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f07baeb5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40a91c0 con 0x7f07b413ab10 2024-02-17T14:28:27.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f07baeb5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b413f030 con 0x7f07b413f4c0 2024-02-17T14:28:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3d43fff640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d440abf00 0x7f3d441e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3d42ffd640 1 -- 172.21.15.134:0/2435208520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d440afc30 msgr2=0x7f3d440aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3d42ffd640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d440afc30 0x7f3d440aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7fe79659c640 1 -- 172.21.15.134:0/2204337405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe79814b0f0 msgr2=0x7fe79812ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7fe79659c640 1 --2- 172.21.15.134:0/2204337405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe79814b0f0 0x7fe79812ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7fe79659c640 1 -- 172.21.15.134:0/2204337405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79812e310 msgr2=0x7fe798131250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7fe79659c640 1 --2- 172.21.15.134:0/2204337405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe79812e310 0x7fe798131250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7fe79659c640 1 -- 172.21.15.134:0/2204337405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe790009a70 con 0x7fe7980b43c0 2024-02-17T14:28:27.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3d42ffd640 1 -- 172.21.15.134:0/2435208520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d440abf00 msgr2=0x7f3d441e4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f07b8c51640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a4008bd0 0x7f07b4142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f07b8c51640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a4008bd0 0x7f07b4142d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46216/0 (socket says 172.21.15.134:46216) 2024-02-17T14:28:27.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f07b8c51640 1 -- 172.21.15.134:0/4027482477 learned_addr learned my addr 172.21.15.134:0/4027482477 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3d42ffd640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d440abf00 0x7f3d441e4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3d42ffd640 1 -- 172.21.15.134:0/2435208520 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c009a70 con 0x7f3d440b8980 2024-02-17T14:28:27.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f07b3fff640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b413f4c0 0x7f07b413f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.160+0000 7f3d437fe640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d440afc30 0x7f3d440aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:27.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f47a4ff9640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f479406b8e0 0x7f479406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f3d42ffd640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d440b8980 0x7f3d44140060 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400c530 tx=0x7f3d3400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7fe79659c640 1 --2- 172.21.15.134:0/2204337405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7980b43c0 0x7fe798071750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe78800c430 tx=0x7fe78800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f3d2bfff640 1 -- 172.21.15.134:0/2435208520 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34005ce0 con 0x7f3d440b8980 2024-02-17T14:28:27.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f38149f2640 1 -- 172.21.15.134:0/559818949 >> v2:172.21.15.134:3300/0 conn(0x7f3810072060 msgr2=0x7f3810146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f38149f2640 1 --2- 172.21.15.134:0/559818949 >> v2:172.21.15.134:3300/0 conn(0x7f3810072060 0x7f3810146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f38149f2640 1 -- 172.21.15.134:0/559818949 >> v1:172.21.15.134:6789/0 conn(0x7f38100b1a40 legacy=0x7f38100afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f38149f2640 1 -- 172.21.15.134:0/559818949 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3810072d10 con 0x7f3810072440 2024-02-17T14:28:27.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f07b9452640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b413ab10 0x7f07b413af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f3d2bfff640 1 -- 172.21.15.134:0/2435208520 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d34005e40 con 0x7f3d440b8980 2024-02-17T14:28:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f3d2bfff640 1 -- 172.21.15.134:0/2435208520 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34007270 con 0x7f3d440b8980 2024-02-17T14:28:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f3d49be2640 1 -- 172.21.15.134:0/2435208520 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d440ad380 con 0x7f3d440b8980 2024-02-17T14:28:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7fe786ffd640 1 -- 172.21.15.134:0/2204337405 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788011790 con 0x7fe7980b43c0 2024-02-17T14:28:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7fe79759e640 1 -- 172.21.15.134:0/2204337405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe798134d70 con 0x7fe7980b43c0 2024-02-17T14:28:27.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7fe79759e640 1 -- 172.21.15.134:0/2204337405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe798132ac0 con 0x7fe7980b43c0 2024-02-17T14:28:27.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7f07b3fff640 1 -- 172.21.15.134:0/4027482477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b413ab10 msgr2=0x7f07b413af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7f07b3fff640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b413ab10 0x7f07b413af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7f07b3fff640 1 -- 172.21.15.134:0/4027482477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a4008bd0 msgr2=0x7f07b4142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7f07b3fff640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07a4008bd0 0x7f07b4142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7f07b3fff640 1 -- 172.21.15.134:0/4027482477 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b40a96d0 con 0x7f07b413f4c0 2024-02-17T14:28:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f47a77fe640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f479406b8e0 0x7f479406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7f47a77fe640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f479406b8e0 0x7f479406dda0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47a809d2b0 tx=0x7f4798009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7f3d49be2640 1 -- 172.21.15.134:0/2435208520 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d440aaa20 con 0x7f3d440b8980 2024-02-17T14:28:27.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7fe786ffd640 1 -- 172.21.15.134:0/2204337405 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7880118f0 con 0x7fe7980b43c0 2024-02-17T14:28:27.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7fe786ffd640 1 -- 172.21.15.134:0/2204337405 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788011790 con 0x7fe7980b43c0 2024-02-17T14:28:27.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7f47a4ff9640 1 -- 172.21.15.134:0/3914887794 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f47a00ac480 con 0x7f47a8099d00 2024-02-17T14:28:27.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/2577171887 shutdown_connections 2024-02-17T14:28:27.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/2577171887 >> 172.21.15.134:0/2577171887 conn(0x7fbbbc03acf0 msgr2=0x7fbbbc03b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7f38149f2640 1 --2- 172.21.15.134:0/559818949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3810072440 0x7f3810146950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f38000071d0 tx=0x7f380002da40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4a29a396befce31 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7f3807fff640 1 -- 172.21.15.134:0/559818949 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3800008df0 con 0x7f3810072440 2024-02-17T14:28:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7f3807fff640 1 -- 172.21.15.134:0/559818949 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380000a0d0 con 0x7f3810072440 2024-02-17T14:28:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7f3807fff640 1 -- 172.21.15.134:0/559818949 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380000a460 con 0x7f3810072440 2024-02-17T14:28:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7f47a4ff9640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] conn(0x7f4794074fe0 0x7f4794077420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.163+0000 7f47a4ff9640 1 -- 172.21.15.134:0/3914887794 --> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4794077af0 con 0x7f4794074fe0 2024-02-17T14:28:27.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.163+0000 7fe79759e640 1 -- 172.21.15.134:0/2204337405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe798074d50 con 0x7fe7980b43c0 2024-02-17T14:28:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.163+0000 7f47a4ff9640 1 -- 172.21.15.134:0/3914887794 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47a00aeaa0 con 0x7f47a8099d00 2024-02-17T14:28:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7fe34d7fa640 1 -- 172.21.15.134:0/72500022 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe348007070 con 0x7fe35014f1a0 2024-02-17T14:28:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.161+0000 7fe34d7fa640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe33406b890 0x7fe33406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.162+0000 7fe356bd0640 1 -- 172.21.15.134:0/72500022 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3500b0d80 con 0x7fe35014f1a0 2024-02-17T14:28:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.163+0000 7fe35496c640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe33406b890 0x7fe33406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.163+0000 7f47ac974640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] conn(0x7f4794074fe0 0x7f4794077420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.163+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/2577171887 shutdown_connections 2024-02-17T14:28:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.163+0000 7f3817457640 1 -- 172.21.15.134:0/559818949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3810072440 msgr2=0x7f3810146950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.163+0000 7f3817457640 1 --2- 172.21.15.134:0/559818949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3810072440 0x7f3810146950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f38000071d0 tx=0x7f380002da40 comp rx=0 tx=0).stop 2024-02-17T14:28:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.163+0000 7f3817457640 1 -- 172.21.15.134:0/559818949 shutdown_connections 2024-02-17T14:28:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.163+0000 7f3817457640 1 --2- 172.21.15.134:0/559818949 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3810072440 0x7f3810146950 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.163+0000 7f3817457640 1 --2- 172.21.15.134:0/559818949 >> v2:172.21.15.134:3300/0 conn(0x7f3810072060 0x7f3810146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.163+0000 7f3817457640 1 -- 172.21.15.134:0/559818949 >> 172.21.15.134:0/559818949 conn(0x7f38100b8270 msgr2=0x7f38100b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.164+0000 7f3817457640 1 -- 172.21.15.134:0/559818949 shutdown_connections 2024-02-17T14:28:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.164+0000 7f3d2bfff640 1 -- 172.21.15.134:0/2435208520 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3d340073d0 con 0x7f3d440b8980 2024-02-17T14:28:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.164+0000 7f3817457640 1 -- 172.21.15.134:0/559818949 wait complete. 2024-02-17T14:28:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.164+0000 7f47ac974640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] conn(0x7f4794074fe0 0x7f4794077420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.164+0000 7fe786ffd640 1 -- 172.21.15.134:0/2204337405 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe788011aa0 con 0x7fe7980b43c0 2024-02-17T14:28:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.164+0000 7f3d2bfff640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f3d3006b840 0x7f3d3006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.164+0000 7f3d2bfff640 1 -- 172.21.15.134:0/2435208520 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3d340898b0 con 0x7f3d440b8980 2024-02-17T14:28:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.164+0000 7f3d437fe640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f3d3006b840 0x7f3d3006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.164+0000 7fe786ffd640 1 --2- 172.21.15.134:0/2204337405 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe77806b870 0x7fe77806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.163+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/2577171887 wait complete. 2024-02-17T14:28:27.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7fe786ffd640 1 -- 172.21.15.134:0/2204337405 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe78808ac30 con 0x7fe7980b43c0 2024-02-17T14:28:27.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7f47a4ff9640 1 -- 172.21.15.134:0/3914887794 <== osd.5 v2:172.21.15.142:6824/819337168 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4794077af0 con 0x7f4794074fe0 2024-02-17T14:28:27.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7fe786ffd640 1 --2- 172.21.15.134:0/2204337405 >> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] conn(0x7fe778074ee0 0x7fe778077320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7fe34d7fa640 1 -- 172.21.15.134:0/72500022 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe3480587e0 con 0x7fe35014f1a0 2024-02-17T14:28:27.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7fe34d7fa640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] conn(0x7fe334075d20 0x7fe3340781c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7fe34d7fa640 1 -- 172.21.15.134:0/72500022 --> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe334078890 con 0x7fe334075d20 2024-02-17T14:28:27.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7fe34d7fa640 1 -- 172.21.15.134:0/72500022 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3480585b0 con 0x7fe35014f1a0 2024-02-17T14:28:27.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7fe34ffff640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] conn(0x7fe334075d20 0x7fe3340781c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7fe35496c640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe33406b890 0x7fe33406dd50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe344035000 tx=0x7fe344008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7fbbc8bc1640 1 Processor -- start 2024-02-17T14:28:27.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7fbbc8bc1640 1 -- start start 2024-02-17T14:28:27.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7f3817457640 1 Processor -- start 2024-02-17T14:28:27.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7f3817457640 1 -- start start 2024-02-17T14:28:27.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.165+0000 7fe796d9d640 1 --2- 172.21.15.134:0/2204337405 >> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] conn(0x7fe778074ee0 0x7fe778077320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f3d437fe640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f3d3006b840 0x7f3d3006dd00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c038000 tx=0x7f3d3c032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7fe786ffd640 1 -- 172.21.15.134:0/2204337405 --> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7780779f0 con 0x7fe778074ee0 2024-02-17T14:28:27.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f3d49be2640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] conn(0x7f3d24001650 0x7f3d24003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7fe34ffff640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] conn(0x7fe334075d20 0x7fe3340781c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f3d49be2640 1 -- 172.21.15.134:0/2435208520 --> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d24006bb0 con 0x7f3d24001650 2024-02-17T14:28:27.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f3817457640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3810072060 0x7f381013fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f3817457640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3810072440 0x7f38101377b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7fbbc8bc1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbbc0369c0 0x7fbbbc02a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f3817457640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38100b1a40 0x7f38101e0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f3817457640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3810141b20 con 0x7f3810072060 2024-02-17T14:28:27.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7fbbc8bc1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbbc033bf0 0x7fbbbc165de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7fbbc37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbbc0369c0 0x7fbbbc02a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f3d43fff640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] conn(0x7f3d24001650 0x7f3d24003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7fbbc8bc1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc166320 0x7fbbbc0c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7fbbc37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbbc0369c0 0x7fbbbc02a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46238/0 (socket says 172.21.15.134:46238) 2024-02-17T14:28:27.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7fbbc8bc1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc0cdbe0 con 0x7fbbbc0369c0 2024-02-17T14:28:27.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7fbbc8bc1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc0ce2d0 con 0x7fbbbc033bf0 2024-02-17T14:28:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7fbbc8bc1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc034030 con 0x7fbbbc166320 2024-02-17T14:28:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7fbbc37fe640 1 -- 172.21.15.134:0/3258604836 learned_addr learned my addr 172.21.15.134:0/3258604836 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7fbbc2ffd640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbbc033bf0 0x7fbbbc165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f3817457640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381013f6b0 con 0x7f3810072440 2024-02-17T14:28:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f3817457640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3810143d40 con 0x7f38100b1a40 2024-02-17T14:28:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f38159f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38100b1a40 0x7f38101e0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f38159f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38100b1a40 0x7f38101e0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:41358/0 (socket says 172.21.15.134:41358) 2024-02-17T14:28:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f38159f4640 1 -- 172.21.15.134:0/3809585859 learned_addr learned my addr 172.21.15.134:0/3809585859 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7f38151f3640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3810072060 0x7f381013fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.166+0000 7fe795d9b640 1 --2- 172.21.15.134:0/2204337405 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe77806b870 0x7fe77806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7fe795d9b640 1 --2- 172.21.15.134:0/2204337405 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe77806b870 0x7fe77806dd30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe7981366c0 tx=0x7fe78c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7fe786ffd640 1 -- 172.21.15.134:0/2204337405 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe788055280 con 0x7fe7980b43c0 2024-02-17T14:28:27.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7fe34d7fa640 1 -- 172.21.15.134:0/72500022 <== osd.2 v2:172.21.15.134:6800/1064515362 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe334078890 con 0x7fe334075d20 2024-02-17T14:28:27.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7fbbc3fff640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc166320 0x7fbbbc0c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7f07b3fff640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b413f4c0 0x7f07b413f940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f07a0005000 tx=0x7f07a002e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7fe796d9d640 1 --2- 172.21.15.134:0/2204337405 >> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] conn(0x7fe778074ee0 0x7fe778077320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7f38149f2640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3810072440 0x7f38101377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7f07b17fa640 1 -- 172.21.15.134:0/4027482477 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a003c070 con 0x7f07b413f4c0 2024-02-17T14:28:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7f07b17fa640 1 -- 172.21.15.134:0/4027482477 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a0004b30 con 0x7f07b413f4c0 2024-02-17T14:28:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7f07b17fa640 1 -- 172.21.15.134:0/4027482477 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a002cb70 con 0x7f07b413f4c0 2024-02-17T14:28:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7fbbc37fe640 1 -- 172.21.15.134:0/3258604836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc166320 msgr2=0x7fbbbc0c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7fbbc37fe640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbbc166320 0x7fbbbc0c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7fbbc37fe640 1 -- 172.21.15.134:0/3258604836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbbc033bf0 msgr2=0x7fbbbc165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7fbbc37fe640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbbc033bf0 0x7fbbbc165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7fbbc37fe640 1 -- 172.21.15.134:0/3258604836 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc1667a0 con 0x7fbbbc0369c0 2024-02-17T14:28:27.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7fbbc2ffd640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbbc033bf0 0x7fbbbc165de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:27.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7f07baeb5640 1 -- 172.21.15.134:0/4027482477 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b41408d0 con 0x7f07b413f4c0 2024-02-17T14:28:27.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.167+0000 7f07baeb5640 1 -- 172.21.15.134:0/4027482477 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b41e09d0 con 0x7f07b413f4c0 2024-02-17T14:28:27.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7fbbc37fe640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbbc0369c0 0x7fbbbc02a100 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8011940 tx=0x7fbbb8011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7f079effd640 1 -- 172.21.15.134:0/4027482477 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f078c001030 con 0x7f07b413f4c0 2024-02-17T14:28:27.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7fbbaffff640 1 -- 172.21.15.134:0/3258604836 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb800faf0 con 0x7fbbbc0369c0 2024-02-17T14:28:27.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7fe786ffd640 1 -- 172.21.15.134:0/2204337405 <== osd.1 v2:172.21.15.134:6808/3862322423 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe7780779f0 con 0x7fe778074ee0 2024-02-17T14:28:27.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.169+0000 7fbbaffff640 1 -- 172.21.15.134:0/3258604836 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb800fc50 con 0x7fbbbc0369c0 2024-02-17T14:28:27.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.169+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/3258604836 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbbc0cd520 con 0x7fbbbc0369c0 2024-02-17T14:28:27.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.169+0000 7f3d43fff640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] conn(0x7f3d24001650 0x7f3d24003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7f38151f3640 1 -- 172.21.15.134:0/3809585859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38100b1a40 msgr2=0x7f38101e0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7f38151f3640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38100b1a40 0x7f38101e0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7f38151f3640 1 -- 172.21.15.134:0/3809585859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3810072440 msgr2=0x7f38101377b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7f38151f3640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3810072440 0x7f38101377b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7f38151f3640 1 -- 172.21.15.134:0/3809585859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380000ae30 con 0x7f3810072060 2024-02-17T14:28:27.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7f38151f3640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3810072060 0x7f381013fe10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f380800e8a0 tx=0x7f380800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7f3805ffb640 1 -- 172.21.15.134:0/3809585859 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808009e60 con 0x7f3810072060 2024-02-17T14:28:27.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7f3805ffb640 1 -- 172.21.15.134:0/3809585859 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380800c940 con 0x7f3810072060 2024-02-17T14:28:27.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7f3805ffb640 1 -- 172.21.15.134:0/3809585859 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380800ccb0 con 0x7f3810072060 2024-02-17T14:28:27.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.168+0000 7f3817457640 1 -- 172.21.15.134:0/3809585859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381013eff0 con 0x7f3810072060 2024-02-17T14:28:27.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.169+0000 7f3817457640 1 -- 172.21.15.134:0/3809585859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381013dbb0 con 0x7f3810072060 2024-02-17T14:28:27.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.170+0000 7f3d2bfff640 1 -- 172.21.15.134:0/2435208520 <== osd.0 v2:172.21.15.134:6809/3803014718 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3d24006bb0 con 0x7f3d24001650 2024-02-17T14:28:27.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.170+0000 7f07b17fa640 1 -- 172.21.15.134:0/4027482477 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f07a0004ca0 con 0x7f07b413f4c0 2024-02-17T14:28:27.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.170+0000 7f07b17fa640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f079806b890 0x7f079806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.170+0000 7f07b17fa640 1 -- 172.21.15.134:0/4027482477 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f07a00ab250 con 0x7f07b413f4c0 2024-02-17T14:28:27.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.170+0000 7f07b17fa640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] conn(0x7f0798075000 0x7f0798077440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.170+0000 7f07b17fa640 1 -- 172.21.15.134:0/4027482477 --> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0798077b10 con 0x7f0798075000 2024-02-17T14:28:27.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.170+0000 7f07b17fa640 1 -- 172.21.15.134:0/4027482477 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07a00ab6f0 con 0x7f07b413f4c0 2024-02-17T14:28:27.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.170+0000 7fbbaffff640 1 -- 172.21.15.134:0/3258604836 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8014440 con 0x7fbbbc0369c0 2024-02-17T14:28:27.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.171+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/3258604836 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbbc0c8bb0 con 0x7fbbbc0369c0 2024-02-17T14:28:27.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.171+0000 7f07b8c51640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f079806b890 0x7f079806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.172+0000 7f07b9452640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] conn(0x7f0798075000 0x7f0798077440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.173+0000 7fbbadffb640 1 -- 172.21.15.134:0/3258604836 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbbbc0057e0 con 0x7fbbbc0369c0 2024-02-17T14:28:27.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.173+0000 7f07b8c51640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f079806b890 0x7f079806dd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f07b41e5000 tx=0x7f07a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.173+0000 7f07b9452640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] conn(0x7f0798075000 0x7f0798077440 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.171+0000 7f3817457640 1 -- 172.21.15.134:0/3809585859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37f0001030 con 0x7f3810072060 2024-02-17T14:28:27.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.172+0000 7f3805ffb640 1 -- 172.21.15.134:0/3809585859 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f3808013470 con 0x7f3810072060 2024-02-17T14:28:27.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.172+0000 7f3805ffb640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f37f406b860 0x7f37f406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.172+0000 7f3805ffb640 1 -- 172.21.15.134:0/3809585859 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f38080588f0 con 0x7f3810072060 2024-02-17T14:28:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.173+0000 7f3805ffb640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] conn(0x7f37f4075c20 0x7f37f40780c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.173+0000 7f3805ffb640 1 -- 172.21.15.134:0/3809585859 --> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37f4078790 con 0x7f37f4075c20 2024-02-17T14:28:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.173+0000 7f38149f2640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f37f406b860 0x7f37f406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.173+0000 7f3805ffb640 1 -- 172.21.15.134:0/3809585859 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38080586c0 con 0x7f3810072060 2024-02-17T14:28:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.174+0000 7f38149f2640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f37f406b860 0x7f37f406dd20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3800037000 tx=0x7f380003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.174+0000 7f38159f4640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] conn(0x7f37f4075c20 0x7f37f40780c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.174+0000 7fbbaffff640 1 -- 172.21.15.134:0/3258604836 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbbb80145a0 con 0x7fbbbc0369c0 2024-02-17T14:28:27.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.174+0000 7f07b17fa640 1 -- 172.21.15.134:0/4027482477 <== osd.7 v2:172.21.15.142:6808/2672906066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0798077b10 con 0x7f0798075000 2024-02-17T14:28:27.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.175+0000 7fbbaffff640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbba806b860 0x7fbba806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.175+0000 7fbbc2ffd640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbba806b860 0x7fbba806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.176+0000 7fbbaffff640 1 -- 172.21.15.134:0/3258604836 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbbb808a040 con 0x7fbbbc0369c0 2024-02-17T14:28:27.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.176+0000 7fbbaffff640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] conn(0x7fbba8074fe0 0x7fbba8077420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.176+0000 7fbbaffff640 1 -- 172.21.15.134:0/3258604836 --> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbba8077af0 con 0x7fbba8074fe0 2024-02-17T14:28:27.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.176+0000 7fbbaffff640 1 -- 172.21.15.134:0/3258604836 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbb808a380 con 0x7fbbbc0369c0 2024-02-17T14:28:27.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.176+0000 7fbbc3fff640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] conn(0x7fbba8074fe0 0x7fbba8077420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.176+0000 7fbbc2ffd640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbba806b860 0x7fbba806dd20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0036000 tx=0x7fbbb0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.176+0000 7f38159f4640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] conn(0x7f37f4075c20 0x7f37f40780c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.177+0000 7fbbc3fff640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] conn(0x7fbba8074fe0 0x7fbba8077420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.177+0000 7f3805ffb640 1 -- 172.21.15.134:0/3809585859 <== osd.6 v2:172.21.15.142:6816/756473126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f37f4078790 con 0x7f37f4075c20 2024-02-17T14:28:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.177+0000 7fbbaffff640 1 -- 172.21.15.134:0/3258604836 <== osd.4 v2:172.21.15.142:6800/2415773380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbba8077af0 con 0x7fbba8074fe0 2024-02-17T14:28:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.184+0000 7f12c9f0d640 1 -- 172.21.15.134:0/1448763171 --> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f12a4002d30 con 0x7f12a8074fd0 2024-02-17T14:28:27.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.185+0000 7f12affff640 1 -- 172.21.15.134:0/1448763171 <== osd.3 v2:172.21.15.134:6818/2845314185 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f12a4002d30 con 0x7f12a8074fd0 2024-02-17T14:28:27.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.186+0000 7f12adffb640 1 -- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] conn(0x7f12a8074fd0 msgr2=0x7f12a8077410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.186+0000 7f12adffb640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] conn(0x7f12a8074fd0 0x7f12a8077410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.186+0000 7f12adffb640 1 -- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f12a806b860 msgr2=0x7f12a806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.186+0000 7f12adffb640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f12a806b860 0x7f12a806dd20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f12bc029ef0 tx=0x7f12c406e030 comp rx=0 tx=0).stop 2024-02-17T14:28:27.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.187+0000 7f12adffb640 1 -- 172.21.15.134:0/1448763171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc006ed0 msgr2=0x7f12bc169b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.187+0000 7f12adffb640 1 --2- 172.21.15.134:0/1448763171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc006ed0 0x7f12bc169b00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12b800e9b0 tx=0x7f12b800ee70 comp rx=0 tx=0).stop 2024-02-17T14:28:27.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.187+0000 7f12c3fff640 1 -- 172.21.15.134:0/1448763171 reap_dead start 2024-02-17T14:28:27.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.187+0000 7f12adffb640 1 -- 172.21.15.134:0/1448763171 shutdown_connections 2024-02-17T14:28:27.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.187+0000 7f12adffb640 1 -- 172.21.15.134:0/1448763171 >> 172.21.15.134:0/1448763171 conn(0x7f12bc03a8d0 msgr2=0x7f12bc03ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.187+0000 7f12adffb640 1 -- 172.21.15.134:0/1448763171 shutdown_connections 2024-02-17T14:28:27.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.187+0000 7f12adffb640 1 -- 172.21.15.134:0/1448763171 wait complete. 2024-02-17T14:28:27.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.195+0000 7f47ad175640 1 -- 172.21.15.134:0/3914887794 --> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f47a806cd30 con 0x7f4794074fe0 2024-02-17T14:28:27.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.195+0000 7f47a4ff9640 1 -- 172.21.15.134:0/3914887794 <== osd.5 v2:172.21.15.142:6824/819337168 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f47a806cd30 con 0x7f4794074fe0 2024-02-17T14:28:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.196+0000 7f478e7fc640 1 -- 172.21.15.134:0/3914887794 >> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] conn(0x7f4794074fe0 msgr2=0x7f4794077420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.196+0000 7f478e7fc640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] conn(0x7f4794074fe0 0x7f4794077420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.196+0000 7f478e7fc640 1 -- 172.21.15.134:0/3914887794 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f479406b8e0 msgr2=0x7f479406dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.197+0000 7f478e7fc640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f479406b8e0 0x7f479406dda0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47a809d2b0 tx=0x7f4798009040 comp rx=0 tx=0).stop 2024-02-17T14:28:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.197+0000 7f478e7fc640 1 -- 172.21.15.134:0/3914887794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a8099d00 msgr2=0x7f47a80719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.197+0000 7f478e7fc640 1 --2- 172.21.15.134:0/3914887794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a8099d00 0x7f47a80719e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f47a0000f80 tx=0x7f47a0004a40 comp rx=0 tx=0).stop 2024-02-17T14:28:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.197+0000 7f47ac974640 1 -- 172.21.15.134:0/3914887794 reap_dead start 2024-02-17T14:28:27.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.197+0000 7f478e7fc640 1 -- 172.21.15.134:0/3914887794 shutdown_connections 2024-02-17T14:28:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.197+0000 7f478e7fc640 1 -- 172.21.15.134:0/3914887794 >> 172.21.15.134:0/3914887794 conn(0x7f47a80b4b60 msgr2=0x7f47a8073a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.197+0000 7f478e7fc640 1 -- 172.21.15.134:0/3914887794 shutdown_connections 2024-02-17T14:28:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.198+0000 7f478e7fc640 1 -- 172.21.15.134:0/3914887794 wait complete. 2024-02-17T14:28:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.199+0000 7fe356bd0640 1 -- 172.21.15.134:0/72500022 --> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe35014f5c0 con 0x7fe334075d20 2024-02-17T14:28:27.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.199+0000 7fe34d7fa640 1 -- 172.21.15.134:0/72500022 <== osd.2 v2:172.21.15.134:6800/1064515362 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe33c009690 con 0x7fe334075d20 2024-02-17T14:28:27.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.200+0000 7fe33affd640 1 -- 172.21.15.134:0/72500022 >> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] conn(0x7fe334075d20 msgr2=0x7fe3340781c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.200+0000 7fe33affd640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] conn(0x7fe334075d20 0x7fe3340781c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.200+0000 7fe33affd640 1 -- 172.21.15.134:0/72500022 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe33406b890 msgr2=0x7fe33406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.200+0000 7fe33affd640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe33406b890 0x7fe33406dd50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe344035000 tx=0x7fe344008030 comp rx=0 tx=0).stop 2024-02-17T14:28:27.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.201+0000 7fe33affd640 1 -- 172.21.15.134:0/72500022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe35014f1a0 msgr2=0x7fe35013f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.201+0000 7fe33affd640 1 --2- 172.21.15.134:0/72500022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe35014f1a0 0x7fe35013f2e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe34800ca70 tx=0x7fe34800cf30 comp rx=0 tx=0).stop 2024-02-17T14:28:27.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.201+0000 7fe35516d640 1 -- 172.21.15.134:0/72500022 reap_dead start 2024-02-17T14:28:27.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.202+0000 7f3d49be2640 1 -- 172.21.15.134:0/2435208520 --> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d24005c90 con 0x7f3d24001650 2024-02-17T14:28:27.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.202+0000 7fe33affd640 1 -- 172.21.15.134:0/72500022 shutdown_connections 2024-02-17T14:28:27.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.202+0000 7fe33affd640 1 -- 172.21.15.134:0/72500022 >> 172.21.15.134:0/72500022 conn(0x7fe35006b480 msgr2=0x7fe3500b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.202+0000 7fe33affd640 1 -- 172.21.15.134:0/72500022 shutdown_connections 2024-02-17T14:28:27.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.202+0000 7fe33affd640 1 -- 172.21.15.134:0/72500022 wait complete. 2024-02-17T14:28:27.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.202+0000 7f3d2bfff640 1 -- 172.21.15.134:0/2435208520 <== osd.0 v2:172.21.15.134:6809/3803014718 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d24005c90 con 0x7f3d24001650 2024-02-17T14:28:27.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.202+0000 7fe79759e640 1 -- 172.21.15.134:0/2204337405 --> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe79814ae70 con 0x7fe778074ee0 2024-02-17T14:28:27.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.203+0000 7f3d29ffb640 1 -- 172.21.15.134:0/2435208520 >> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] conn(0x7f3d24001650 msgr2=0x7f3d24003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.203+0000 7f3d29ffb640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] conn(0x7f3d24001650 0x7f3d24003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.203+0000 7f3d29ffb640 1 -- 172.21.15.134:0/2435208520 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f3d3006b840 msgr2=0x7f3d3006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.203+0000 7f3d29ffb640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f3d3006b840 0x7f3d3006dd00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c038000 tx=0x7f3d3c032000 comp rx=0 tx=0).stop 2024-02-17T14:28:27.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.203+0000 7f3d29ffb640 1 -- 172.21.15.134:0/2435208520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d440b8980 msgr2=0x7f3d44140060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.203+0000 7f3d29ffb640 1 --2- 172.21.15.134:0/2435208520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d440b8980 0x7f3d44140060 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400c530 tx=0x7f3d3400c9f0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.204+0000 7f3d43fff640 1 -- 172.21.15.134:0/2435208520 reap_dead start 2024-02-17T14:28:27.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.204+0000 7f3d29ffb640 1 -- 172.21.15.134:0/2435208520 shutdown_connections 2024-02-17T14:28:27.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.204+0000 7f3d29ffb640 1 -- 172.21.15.134:0/2435208520 >> 172.21.15.134:0/2435208520 conn(0x7f3d4406b480 msgr2=0x7f3d44070460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.204+0000 7fe786ffd640 1 -- 172.21.15.134:0/2204337405 <== osd.1 v2:172.21.15.134:6808/3862322423 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe79814ae70 con 0x7fe778074ee0 2024-02-17T14:28:27.262 INFO:teuthology.orchestra.run.smithi134.stdout:55834574856 2024-02-17T14:28:27.263 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-17T14:28:27.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.204+0000 7f3d29ffb640 1 -- 172.21.15.134:0/2435208520 shutdown_connections 2024-02-17T14:28:27.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.204+0000 7f3d29ffb640 1 -- 172.21.15.134:0/2435208520 wait complete. 2024-02-17T14:28:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.204+0000 7fe784ff9640 1 -- 172.21.15.134:0/2204337405 >> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] conn(0x7fe778074ee0 msgr2=0x7fe778077320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.205+0000 7fe784ff9640 1 --2- 172.21.15.134:0/2204337405 >> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] conn(0x7fe778074ee0 0x7fe778077320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.205+0000 7fe784ff9640 1 -- 172.21.15.134:0/2204337405 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe77806b870 msgr2=0x7fe77806dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.205+0000 7fe784ff9640 1 --2- 172.21.15.134:0/2204337405 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe77806b870 0x7fe77806dd30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe7981366c0 tx=0x7fe78c009040 comp rx=0 tx=0).stop 2024-02-17T14:28:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.205+0000 7fe784ff9640 1 -- 172.21.15.134:0/2204337405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7980b43c0 msgr2=0x7fe798071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.205+0000 7fe784ff9640 1 --2- 172.21.15.134:0/2204337405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7980b43c0 0x7fe798071750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe78800c430 tx=0x7fe78800c8f0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.205+0000 7fe796d9d640 1 -- 172.21.15.134:0/2204337405 reap_dead start 2024-02-17T14:28:27.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.205+0000 7fe784ff9640 1 -- 172.21.15.134:0/2204337405 shutdown_connections 2024-02-17T14:28:27.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.205+0000 7fe784ff9640 1 -- 172.21.15.134:0/2204337405 >> 172.21.15.134:0/2204337405 conn(0x7fe7980b4b60 msgr2=0x7fe7980ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.206+0000 7fe784ff9640 1 -- 172.21.15.134:0/2204337405 shutdown_connections 2024-02-17T14:28:27.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.206+0000 7fe784ff9640 1 -- 172.21.15.134:0/2204337405 wait complete. 2024-02-17T14:28:27.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.206+0000 7f079effd640 1 -- 172.21.15.134:0/4027482477 --> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f078c002d30 con 0x7f0798075000 2024-02-17T14:28:27.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.206+0000 7f3817457640 1 -- 172.21.15.134:0/3809585859 --> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f37f0002d30 con 0x7f37f4075c20 2024-02-17T14:28:27.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.206+0000 7f07b17fa640 1 -- 172.21.15.134:0/4027482477 <== osd.7 v2:172.21.15.142:6808/2672906066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f078c002d30 con 0x7f0798075000 2024-02-17T14:28:27.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.206+0000 7f3805ffb640 1 -- 172.21.15.134:0/3809585859 <== osd.6 v2:172.21.15.142:6816/756473126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f37f0002d30 con 0x7f37f4075c20 2024-02-17T14:28:27.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.207+0000 7f079effd640 1 -- 172.21.15.134:0/4027482477 >> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] conn(0x7f0798075000 msgr2=0x7f0798077440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.207+0000 7f3817457640 1 -- 172.21.15.134:0/3809585859 >> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] conn(0x7f37f4075c20 msgr2=0x7f37f40780c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.207+0000 7f3817457640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] conn(0x7f37f4075c20 0x7f37f40780c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.207+0000 7f079effd640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] conn(0x7f0798075000 0x7f0798077440 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.207+0000 7f079effd640 1 -- 172.21.15.134:0/4027482477 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f079806b890 msgr2=0x7f079806dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.207+0000 7f079effd640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f079806b890 0x7f079806dd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f07b41e5000 tx=0x7f07a8009040 comp rx=0 tx=0).stop 2024-02-17T14:28:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.207+0000 7f079effd640 1 -- 172.21.15.134:0/4027482477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b413f4c0 msgr2=0x7f07b413f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.207+0000 7f079effd640 1 --2- 172.21.15.134:0/4027482477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b413f4c0 0x7f07b413f940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f07a0005000 tx=0x7f07a002e070 comp rx=0 tx=0).stop 2024-02-17T14:28:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.207+0000 7f07b9452640 1 -- 172.21.15.134:0/4027482477 reap_dead start 2024-02-17T14:28:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.207+0000 7f3817457640 1 -- 172.21.15.134:0/3809585859 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f37f406b860 msgr2=0x7f37f406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.207+0000 7f3817457640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f37f406b860 0x7f37f406dd20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3800037000 tx=0x7f380003d040 comp rx=0 tx=0).stop 2024-02-17T14:28:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.208+0000 7fbbadffb640 1 -- 172.21.15.134:0/3258604836 --> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbbbc03d5f0 con 0x7fbba8074fe0 2024-02-17T14:28:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.208+0000 7f079effd640 1 -- 172.21.15.134:0/4027482477 shutdown_connections 2024-02-17T14:28:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.208+0000 7f079effd640 1 -- 172.21.15.134:0/4027482477 >> 172.21.15.134:0/4027482477 conn(0x7f07b40b8270 msgr2=0x7f07b40b6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.208+0000 7f3817457640 1 -- 172.21.15.134:0/3809585859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3810072060 msgr2=0x7f381013fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.208+0000 7f3817457640 1 --2- 172.21.15.134:0/3809585859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3810072060 0x7f381013fe10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f380800e8a0 tx=0x7f380800ed60 comp rx=0 tx=0).stop 2024-02-17T14:28:27.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.208+0000 7f38159f4640 1 -- 172.21.15.134:0/3809585859 reap_dead start 2024-02-17T14:28:27.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.208+0000 7f079effd640 1 -- 172.21.15.134:0/4027482477 shutdown_connections 2024-02-17T14:28:27.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.208+0000 7f079effd640 1 -- 172.21.15.134:0/4027482477 wait complete. 2024-02-17T14:28:27.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.208+0000 7f3817457640 1 -- 172.21.15.134:0/3809585859 shutdown_connections 2024-02-17T14:28:27.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.208+0000 7f3817457640 1 -- 172.21.15.134:0/3809585859 >> 172.21.15.134:0/3809585859 conn(0x7f38100b8270 msgr2=0x7f38100b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.208+0000 7f3817457640 1 -- 172.21.15.134:0/3809585859 shutdown_connections 2024-02-17T14:28:27.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.208+0000 7fbbaffff640 1 -- 172.21.15.134:0/3258604836 <== osd.4 v2:172.21.15.142:6800/2415773380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbbbc03d5f0 con 0x7fbba8074fe0 2024-02-17T14:28:27.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.208+0000 7f3817457640 1 -- 172.21.15.134:0/3809585859 wait complete. 2024-02-17T14:28:27.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.209+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/3258604836 >> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] conn(0x7fbba8074fe0 msgr2=0x7fbba8077420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.209+0000 7fbbc8bc1640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] conn(0x7fbba8074fe0 0x7fbba8077420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.209+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/3258604836 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbba806b860 msgr2=0x7fbba806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.209+0000 7fbbc8bc1640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbba806b860 0x7fbba806dd20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0036000 tx=0x7fbbb0030000 comp rx=0 tx=0).stop 2024-02-17T14:28:27.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.209+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/3258604836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbbc0369c0 msgr2=0x7fbbbc02a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.209+0000 7fbbc8bc1640 1 --2- 172.21.15.134:0/3258604836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbbc0369c0 0x7fbbbc02a100 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8011940 tx=0x7fbbb8011e00 comp rx=0 tx=0).stop 2024-02-17T14:28:27.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.209+0000 7fbbc3fff640 1 -- 172.21.15.134:0/3258604836 reap_dead start 2024-02-17T14:28:27.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.209+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/3258604836 shutdown_connections 2024-02-17T14:28:27.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.209+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/3258604836 >> 172.21.15.134:0/3258604836 conn(0x7fbbbc03acf0 msgr2=0x7fbbbc03bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.209+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/3258604836 shutdown_connections 2024-02-17T14:28:27.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.210+0000 7fbbc8bc1640 1 -- 172.21.15.134:0/3258604836 wait complete. 2024-02-17T14:28:27.275 INFO:teuthology.orchestra.run.smithi134.stdout:55834574856 2024-02-17T14:28:27.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-17T14:28:27.276 INFO:teuthology.orchestra.run.smithi134.stdout:55834574855 2024-02-17T14:28:27.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-17T14:28:27.277 INFO:teuthology.orchestra.run.smithi134.stdout:55834574857 2024-02-17T14:28:27.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-17T14:28:27.278 INFO:teuthology.orchestra.run.smithi134.stdout:55834574856 2024-02-17T14:28:27.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-17T14:28:27.279 INFO:teuthology.orchestra.run.smithi134.stdout:55834574857 2024-02-17T14:28:27.279 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-17T14:28:27.280 INFO:teuthology.orchestra.run.smithi134.stdout:55834574855 2024-02-17T14:28:27.280 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-17T14:28:27.281 INFO:teuthology.orchestra.run.smithi134.stdout:55834574856 2024-02-17T14:28:27.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-17T14:28:27.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.487+0000 7f414cf3f640 1 Processor -- start 2024-02-17T14:28:27.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.487+0000 7f414cf3f640 1 -- start start 2024-02-17T14:28:27.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.488+0000 7f414cf3f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41480b43c0 0x7f41480ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.488+0000 7f414cf3f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f414814b0f0 0x7f41480b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.488+0000 7f414cf3f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41480b47a0 con 0x7f41480b2fa0 2024-02-17T14:28:27.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.488+0000 7f414cf3f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41480b3410 con 0x7f414814b0f0 2024-02-17T14:28:27.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.488+0000 7f414cf3f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414814b680 con 0x7f41480b43c0 2024-02-17T14:28:27.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.488+0000 7f41477fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41480b43c0 0x7f41480ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.488+0000 7f41477fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41480b43c0 0x7f41480ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:41374/0 (socket says 172.21.15.134:41374) 2024-02-17T14:28:27.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.488+0000 7f41477fe640 1 -- 172.21.15.134:0/1735771265 learned_addr learned my addr 172.21.15.134:0/1735771265 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.489+0000 7f41477fe640 1 -- 172.21.15.134:0/1735771265 >> v2:172.21.15.142:3300/0 conn(0x7f414814b0f0 msgr2=0x7f41480b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.489+0000 7f41477fe640 1 --2- 172.21.15.134:0/1735771265 >> v2:172.21.15.142:3300/0 conn(0x7f414814b0f0 0x7f41480b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.489+0000 7f41477fe640 1 -- 172.21.15.134:0/1735771265 >> v1:172.21.15.134:6789/0 conn(0x7f41480b2fa0 legacy=0x7f4148072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.489+0000 7f41477fe640 1 -- 172.21.15.134:0/1735771265 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414814b960 con 0x7f41480b43c0 2024-02-17T14:28:27.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.488+0000 7f10cf313640 1 Processor -- start 2024-02-17T14:28:27.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.489+0000 7f10cf313640 1 -- start start 2024-02-17T14:28:27.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.489+0000 7f0d812d4640 1 Processor -- start 2024-02-17T14:28:27.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.489+0000 7f0d812d4640 1 -- start start 2024-02-17T14:28:27.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7f0d812d4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0d7403b1a0 0x7f0d740203a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7f41477fe640 1 --2- 172.21.15.134:0/1735771265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41480b43c0 0x7f41480ae910 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4138009870 tx=0x7f413802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edf60e353269008b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7f0d812d4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0d740c9d80 0x7f0d740208e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7fa7cccd0640 1 Processor -- start 2024-02-17T14:28:27.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7fa7cccd0640 1 -- start start 2024-02-17T14:28:27.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7f0d812d4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7401ecf0 con 0x7f0d7401cc10 2024-02-17T14:28:27.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7f10cf313640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c8072a70 0x7f10c80afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7f10cf313640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c814c210 con 0x7f10c814f340 2024-02-17T14:28:27.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7f10cf313640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c80b24c0 con 0x7f10c814e7f0 2024-02-17T14:28:27.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7f10cf313640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c80af7f0 con 0x7f10c8072a70 2024-02-17T14:28:27.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7f10cd0af640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c8072a70 0x7f10c80afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7f10cd0af640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c8072a70 0x7f10c80afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:41390/0 (socket says 172.21.15.134:41390) 2024-02-17T14:28:27.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7f10cd0af640 1 -- 172.21.15.134:0/598808235 learned_addr learned my addr 172.21.15.134:0/598808235 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f0d7b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0d740c9d80 0x7f0d740208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7fe3398f4640 1 Processor -- start 2024-02-17T14:28:27.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f0d7a7fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0d7403b1a0 0x7f0d740203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f0d7affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0d7401cc10 0x7f0d740c9670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51112/0 (socket says 172.21.15.134:51112) 2024-02-17T14:28:27.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f08bf8eb640 1 Processor -- start 2024-02-17T14:28:27.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f10cd0af640 1 -- 172.21.15.134:0/598808235 >> v1:172.21.15.142:6789/0 conn(0x7f10c814e7f0 legacy=0x7f10c814ec30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T14:28:27.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f0d7affd640 1 -- 172.21.15.134:0/2442481486 learned_addr learned my addr 172.21.15.134:0/2442481486 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:27.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f0d7b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0d740c9d80 0x7f0d740208e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46252/0 (socket says 172.21.15.134:46252) 2024-02-17T14:28:27.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f10bffff640 1 -- 172.21.15.134:0/598808235 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431435224 0 0) 0x7f10c814c210 con 0x7f10c814f340 2024-02-17T14:28:27.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f10cd0af640 1 -- 172.21.15.134:0/598808235 >> v1:172.21.15.134:6789/0 conn(0x7f10c814f340 legacy=0x7f10c8155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f0d812d4640 1 -- 172.21.15.134:0/2442481486 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d74032190 con 0x7f0d740c9d80 2024-02-17T14:28:27.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f10cd0af640 1 -- 172.21.15.134:0/598808235 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8072e50 con 0x7f10c8072a70 2024-02-17T14:28:27.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7fe3398f4640 1 -- start start 2024-02-17T14:28:27.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f0d812d4640 1 -- 172.21.15.134:0/2442481486 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7401cff0 con 0x7f0d7403b1a0 2024-02-17T14:28:27.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215130845 0 0) 0x7f0d7401ecf0 con 0x7f0d7401cc10 2024-02-17T14:28:27.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f08bf8eb640 1 -- start start 2024-02-17T14:28:27.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d64003520 con 0x7f0d7401cc10 2024-02-17T14:28:27.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f8a4ffff640 1 Processor -- start 2024-02-17T14:28:27.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.490+0000 7f41467fc640 1 -- 172.21.15.134:0/1735771265 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138031640 con 0x7f41480b43c0 2024-02-17T14:28:27.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fa7cccd0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa7c814a990 0x7fa7c80b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fa7cccd0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c8072ce0 0x7fa7c80b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fa7cccd0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c80af800 con 0x7fa7c814a5b0 2024-02-17T14:28:27.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fa7cccd0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c80ad830 con 0x7fa7c814a990 2024-02-17T14:28:27.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fa7cccd0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c80afae0 con 0x7fa7c8072ce0 2024-02-17T14:28:27.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fe3398f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3340b3000 0x7fe33409dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f41467fc640 1 -- 172.21.15.134:0/1735771265 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41380317a0 con 0x7f41480b43c0 2024-02-17T14:28:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fa7c5d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa7c814a990 0x7fa7c80b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fa7c5d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa7c814a990 0x7fa7c80b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46262/0 (socket says 172.21.15.134:46262) 2024-02-17T14:28:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fa7c5d9b640 1 -- 172.21.15.134:0/991447475 learned_addr learned my addr 172.21.15.134:0/991447475 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fe3398f4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3340b44d0 con 0x7fe3340b5810 2024-02-17T14:28:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fe3398f4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3340b3500 con 0x7fe3340b5bf0 2024-02-17T14:28:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f41467fc640 1 -- 172.21.15.134:0/1735771265 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138031b30 con 0x7f41480b43c0 2024-02-17T14:28:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fe3398f4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe334143080 con 0x7fe3340b3000 2024-02-17T14:28:27.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f414cf3f640 1 -- 172.21.15.134:0/1735771265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41480b43c0 msgr2=0x7f41480ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fa7c6d9d640 1 --2- 172.21.15.134:0/991447475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c8072ce0 0x7fa7c80b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f414cf3f640 1 --2- 172.21.15.134:0/1735771265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41480b43c0 0x7f41480ae910 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4138009870 tx=0x7f413802b8f0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f08bf8eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08b0035630 0x7f08b00365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f08bf8eb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f08b00c85f0 0x7f08b00c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f08bf8eb640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b002a020 con 0x7f08b0035a10 2024-02-17T14:28:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f08bf8eb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b0036410 con 0x7f08b00c85f0 2024-02-17T14:28:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f08bf8eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b0029db0 con 0x7f08b0035630 2024-02-17T14:28:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fd3a9815640 1 Processor -- start 2024-02-17T14:28:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fd3a9815640 1 -- start start 2024-02-17T14:28:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fe3337fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe3340b5bf0 0x7fe33414d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:41738/0 (socket says 172.21.15.134:41738) 2024-02-17T14:28:27.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fe3337fe640 1 -- 172.21.15.134:0/708056704 learned_addr learned my addr 172.21.15.134:0/708056704 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1681202769 0 0) 0x7f0d64003520 con 0x7f0d7401cc10 2024-02-17T14:28:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f414cf3f640 1 -- 172.21.15.134:0/1735771265 shutdown_connections 2024-02-17T14:28:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f414cf3f640 1 --2- 172.21.15.134:0/1735771265 >> v2:172.21.15.142:3300/0 conn(0x7f414814b0f0 0x7f41480b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f414cf3f640 1 --2- 172.21.15.134:0/1735771265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41480b43c0 0x7f41480ae910 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f414cf3f640 1 -- 172.21.15.134:0/1735771265 >> 172.21.15.134:0/1735771265 conn(0x7f41480b4b60 msgr2=0x7f41480b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 >> v2:172.21.15.142:3300/0 conn(0x7f0d7403b1a0 msgr2=0x7f0d740203a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f0d79ffb640 1 --2- 172.21.15.134:0/2442481486 >> v2:172.21.15.142:3300/0 conn(0x7f0d7403b1a0 0x7f0d740203a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f414cf3f640 1 -- 172.21.15.134:0/1735771265 shutdown_connections 2024-02-17T14:28:27.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 >> v2:172.21.15.134:3300/0 conn(0x7f0d740c9d80 msgr2=0x7f0d740208e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f0d79ffb640 1 --2- 172.21.15.134:0/2442481486 >> v2:172.21.15.134:3300/0 conn(0x7f0d740c9d80 0x7f0d740208e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f414cf3f640 1 -- 172.21.15.134:0/1735771265 wait complete. 2024-02-17T14:28:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d740323e0 con 0x7f0d7401cc10 2024-02-17T14:28:27.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7fe3327fc640 1 --2- 172.21.15.134:0/708056704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3340b3000 0x7fe33409dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.491+0000 7f8a4ffff640 1 -- start start 2024-02-17T14:28:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f8a4ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a48036c70 0x7f8a480cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f8a4ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8a48037050 0x7f8a480c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f8a4ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8a480c9250 0x7f8a480bec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f8a4ffff640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a480ccb70 con 0x7f8a480c9250 2024-02-17T14:28:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f8a4ffff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a480c85e0 con 0x7f8a48037050 2024-02-17T14:28:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f8a4ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480387c0 con 0x7f8a48036c70 2024-02-17T14:28:27.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f0d6c001670 con 0x7f0d7401cc10 2024-02-17T14:28:27.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f0d7b7fe640 1 --2- 172.21.15.134:0/2442481486 >> v2:172.21.15.134:3300/0 conn(0x7f0d740c9d80 0x7f0d740208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:27.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 >> v1:172.21.15.134:6789/0 conn(0x7f0d7401cc10 legacy=0x7f0d740c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f0d79ffb640 1 --2- 172.21.15.134:0/2442481486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d640039c0 0x7f0d64003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fa7c5d9b640 1 -- 172.21.15.134:0/991447475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c8072ce0 msgr2=0x7fa7c80b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fa7c5d9b640 1 --2- 172.21.15.134:0/991447475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c8072ce0 0x7fa7c80b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fa7c5d9b640 1 -- 172.21.15.134:0/991447475 >> v1:172.21.15.134:6789/0 conn(0x7fa7c814a5b0 legacy=0x7fa7c80725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7fa7c5d9b640 1 -- 172.21.15.134:0/991447475 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c80ada20 con 0x7fa7c814a990 2024-02-17T14:28:27.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f0d7affd640 1 --2- 172.21.15.134:0/2442481486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d640039c0 0x7f0d64003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7fe331ffb640 1 -- 172.21.15.134:0/708056704 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591837966 0 0) 0x7fe3340b3500 con 0x7fe3340b5bf0 2024-02-17T14:28:27.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7fe331ffb640 1 -- 172.21.15.134:0/708056704 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe320003520 con 0x7fe3340b5bf0 2024-02-17T14:28:27.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7fd3a9815640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3a40b36f0 0x7fd3a413d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7fa7c5d9b640 1 --2- 172.21.15.134:0/991447475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c814a990 0x7fa7c80b21a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009870 tx=0x7fa7bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4b5571e683dbd4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7fe331ffb640 1 -- 172.21.15.134:0/708056704 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777520242 0 0) 0x7fe3340b44d0 con 0x7fe3340b5810 2024-02-17T14:28:27.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7fe331ffb640 1 -- 172.21.15.134:0/708056704 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3340b3500 con 0x7fe3340b5810 2024-02-17T14:28:27.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f0d79ffb640 1 --2- 172.21.15.134:0/2442481486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d640047c0 0x7f0d64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7fd3a9815640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd3a41439d0 0x7fd3a414dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f10cd0af640 1 --2- 172.21.15.134:0/598808235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c8072a70 0x7f10c80afc40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f10c80af930 tx=0x7f10b802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33e4a54700abd40d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f0d79ffb640 1 --2- 172.21.15.134:0/2442481486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d640051d0 0x7f0d6400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7fd3a9815640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a40b0e10 con 0x7fd3a413d5c0 2024-02-17T14:28:27.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d74032190 con 0x7f0d640039c0 2024-02-17T14:28:27.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f0d7a7fc640 1 --2- 172.21.15.134:0/2442481486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d640047c0 0x7f0d64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fd3a37fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd3a41439d0 0x7fd3a414dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fe3327fc640 1 -- 172.21.15.134:0/708056704 >> v1:172.21.15.142:6789/0 conn(0x7fe3340b5bf0 legacy=0x7fe33414d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7401cff0 con 0x7f0d640047c0 2024-02-17T14:28:27.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fe3327fc640 1 -- 172.21.15.134:0/708056704 >> v1:172.21.15.134:6789/0 conn(0x7fe3340b5810 legacy=0x7fe334143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fd3a9815640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a40b1c70 con 0x7fd3a41439d0 2024-02-17T14:28:27.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f10bffff640 1 -- 172.21.15.134:0/598808235 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80317c0 con 0x7f10c8072a70 2024-02-17T14:28:27.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6400c180 con 0x7f0d640051d0 2024-02-17T14:28:27.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fd3a9815640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a406f830 con 0x7fd3a40b36f0 2024-02-17T14:28:27.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fe3327fc640 1 -- 172.21.15.134:0/708056704 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3340b37e0 con 0x7fe3340b3000 2024-02-17T14:28:27.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fd3a2ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3a40b36f0 0x7fd3a413d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f0d7b7fe640 1 --2- 172.21.15.134:0/2442481486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d640051d0 0x7f0d6400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f08bce86640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f08b0035a10 0x7f08b0033800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51120/0 (socket says 172.21.15.134:51120) 2024-02-17T14:28:27.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f08bce86640 1 -- 172.21.15.134:0/3344909508 learned_addr learned my addr 172.21.15.134:0/3344909508 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:27.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fd3a2ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3a40b36f0 0x7fd3a413d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:41414/0 (socket says 172.21.15.134:41414) 2024-02-17T14:28:27.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fd3a2ffd640 1 -- 172.21.15.134:0/3516581255 learned_addr learned my addr 172.21.15.134:0/3516581255 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.492+0000 7f08bd687640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08b0035630 0x7f08b00365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f08bd687640 1 -- 172.21.15.134:0/3344909508 >> v2:172.21.15.142:3300/0 conn(0x7f08b00c85f0 msgr2=0x7f08b00c8a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T14:28:27.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f08bd687640 1 --2- 172.21.15.134:0/3344909508 >> v2:172.21.15.142:3300/0 conn(0x7f08b00c85f0 0x7f08b00c8a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f08bd687640 1 -- 172.21.15.134:0/3344909508 >> v1:172.21.15.134:6789/0 conn(0x7f08b0035a10 legacy=0x7f08b0033800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f08bd687640 1 -- 172.21.15.134:0/3344909508 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b0035e90 con 0x7f08b0035630 2024-02-17T14:28:27.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f8a4effd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a48036c70 0x7f8a480cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f8a4effd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a48036c70 0x7f8a480cc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:41404/0 (socket says 172.21.15.134:41404) 2024-02-17T14:28:27.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fa7c559a640 1 -- 172.21.15.134:0/991447475 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc031870 con 0x7fa7c814a990 2024-02-17T14:28:27.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f414cf3f640 1 Processor -- start 2024-02-17T14:28:27.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fa7c559a640 1 -- 172.21.15.134:0/991447475 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc0319d0 con 0x7fa7c814a990 2024-02-17T14:28:27.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fa7c559a640 1 -- 172.21.15.134:0/991447475 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc031d40 con 0x7fa7c814a990 2024-02-17T14:28:27.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fd3a2ffd640 1 -- 172.21.15.134:0/3516581255 >> v2:172.21.15.134:3300/0 conn(0x7fd3a41439d0 msgr2=0x7fd3a414dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fd3a2ffd640 1 --2- 172.21.15.134:0/3516581255 >> v2:172.21.15.134:3300/0 conn(0x7fd3a41439d0 0x7fd3a414dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fd3a2ffd640 1 -- 172.21.15.134:0/3516581255 >> v1:172.21.15.142:6789/0 conn(0x7fd3a413d5c0 legacy=0x7fd3a41432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fd3a2ffd640 1 -- 172.21.15.134:0/3516581255 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a40b3ad0 con 0x7fd3a40b36f0 2024-02-17T14:28:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7fd3a37fe640 1 --2- 172.21.15.134:0/3516581255 >> v2:172.21.15.134:3300/0 conn(0x7fd3a41439d0 0x7fd3a414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f0d7b7fe640 1 -- 172.21.15.134:0/2442481486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d640047c0 msgr2=0x7f0d64004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f0d7b7fe640 1 --2- 172.21.15.134:0/2442481486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d640047c0 0x7f0d64004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f0d7b7fe640 1 -- 172.21.15.134:0/2442481486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d640039c0 msgr2=0x7f0d64003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f0d7b7fe640 1 --2- 172.21.15.134:0/2442481486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d640039c0 0x7f0d64003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f0d7b7fe640 1 -- 172.21.15.134:0/2442481486 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d64003520 con 0x7f0d640051d0 2024-02-17T14:28:27.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f08bd687640 1 --2- 172.21.15.134:0/3344909508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08b0035630 0x7f08b00365d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f08b8000b60 tx=0x7f08b806a5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9a99c2e35f660b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f08affff640 1 -- 172.21.15.134:0/3344909508 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b80afdf0 con 0x7f08b0035630 2024-02-17T14:28:27.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f08affff640 1 -- 172.21.15.134:0/3344909508 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b80b3070 con 0x7f08b0035630 2024-02-17T14:28:27.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f08affff640 1 -- 172.21.15.134:0/3344909508 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b80b9620 con 0x7f08b0035630 2024-02-17T14:28:27.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f414cf3f640 1 -- start start 2024-02-17T14:28:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f8a4effd640 1 -- 172.21.15.134:0/2257061848 learned_addr learned my addr 172.21.15.134:0/2257061848 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.493+0000 7f8a4e7fc640 1 --2- 172.21.15.134:0/2257061848 >> v2:172.21.15.142:3300/0 conn(0x7f8a48037050 0x7f8a480c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f8a4effd640 1 -- 172.21.15.134:0/2257061848 >> v2:172.21.15.142:3300/0 conn(0x7f8a48037050 msgr2=0x7f8a480c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f8a4effd640 1 --2- 172.21.15.134:0/2257061848 >> v2:172.21.15.142:3300/0 conn(0x7f8a48037050 0x7f8a480c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f8a4effd640 1 -- 172.21.15.134:0/2257061848 >> v2:172.21.15.134:3300/0 conn(0x7f8a480c9250 msgr2=0x7f8a480bec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f8a4effd640 1 --2- 172.21.15.134:0/2257061848 >> v2:172.21.15.134:3300/0 conn(0x7f8a480c9250 0x7f8a480bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.494+0000 7f8a4effd640 1 -- 172.21.15.134:0/2257061848 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a48037fb0 con 0x7f8a48036c70 2024-02-17T14:28:27.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f10bffff640 1 -- 172.21.15.134:0/598808235 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b8031920 con 0x7f10c8072a70 2024-02-17T14:28:27.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f0d7b7fe640 1 -- 172.21.15.134:0/2442481486 reap_dead start 2024-02-17T14:28:27.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7fa7cccd0640 1 -- 172.21.15.134:0/991447475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c814a990 msgr2=0x7fa7c80b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f0d7a7fc640 1 --2- 172.21.15.134:0/2442481486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d640047c0 0x7f0d64004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:27.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7fa7cccd0640 1 --2- 172.21.15.134:0/991447475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c814a990 0x7fa7c80b21a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009870 tx=0x7fa7bc02b910 comp rx=0 tx=0).stop 2024-02-17T14:28:27.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f414cf3f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41480b2fa0 0x7f4148099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f8a4effd640 1 --2- 172.21.15.134:0/2257061848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a48036c70 0x7f8a480cc0b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8a480077a0 tx=0x7f8a40030090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dfb12aa852301f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7fd3a2ffd640 1 --2- 172.21.15.134:0/3516581255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3a40b36f0 0x7fd3a413d080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd39c009e50 tx=0x7fd39c02dfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26b9316bf5d4c23 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7fa7cccd0640 1 -- 172.21.15.134:0/991447475 shutdown_connections 2024-02-17T14:28:27.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7fa7cccd0640 1 --2- 172.21.15.134:0/991447475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c8072ce0 0x7fa7c80b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7fa7cccd0640 1 --2- 172.21.15.134:0/991447475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c814a990 0x7fa7c80b21a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7fa7cccd0640 1 -- 172.21.15.134:0/991447475 >> 172.21.15.134:0/991447475 conn(0x7fa7c806b480 msgr2=0x7fa7c80b8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f0d7b7fe640 1 --2- 172.21.15.134:0/2442481486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d640051d0 0x7f0d6400b980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c050150 tx=0x7f0d640057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e7192c46aef5b2e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7fa7cccd0640 1 -- 172.21.15.134:0/991447475 shutdown_connections 2024-02-17T14:28:27.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7fa7cccd0640 1 -- 172.21.15.134:0/991447475 wait complete. 2024-02-17T14:28:27.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7fe3327fc640 1 --2- 172.21.15.134:0/708056704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3340b3000 0x7fe33409dc10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0097d0 tx=0x7fe32c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8aa5c7f0e99568 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f8a4dffb640 1 -- 172.21.15.134:0/2257061848 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40030e40 con 0x7f8a48036c70 2024-02-17T14:28:27.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0abc00 con 0x7f0d640051d0 2024-02-17T14:28:27.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c0abd60 con 0x7f0d640051d0 2024-02-17T14:28:27.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f0d79ffb640 1 -- 172.21.15.134:0/2442481486 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0b3640 con 0x7f0d640051d0 2024-02-17T14:28:27.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f8a4dffb640 1 -- 172.21.15.134:0/2257061848 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a40034070 con 0x7f8a48036c70 2024-02-17T14:28:27.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f8a4dffb640 1 -- 172.21.15.134:0/2257061848 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4003a620 con 0x7f8a48036c70 2024-02-17T14:28:27.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7fd3a1ffb640 1 -- 172.21.15.134:0/3516581255 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c02eb70 con 0x7fd3a40b36f0 2024-02-17T14:28:27.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7fd3a1ffb640 1 -- 172.21.15.134:0/3516581255 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39c02ecd0 con 0x7fd3a40b36f0 2024-02-17T14:28:27.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7fd3a1ffb640 1 -- 172.21.15.134:0/3516581255 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c036610 con 0x7fd3a40b36f0 2024-02-17T14:28:27.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f10bffff640 1 -- 172.21.15.134:0/598808235 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b8031cb0 con 0x7f10c8072a70 2024-02-17T14:28:27.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f10cf313640 1 -- 172.21.15.134:0/598808235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c8072a70 msgr2=0x7f10c80afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f10cf313640 1 --2- 172.21.15.134:0/598808235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c8072a70 0x7f10c80afc40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f10c80af930 tx=0x7f10b802b860 comp rx=0 tx=0).stop 2024-02-17T14:28:27.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f414cf3f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41480b43c0 0x7f414809c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f414cf3f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414814b0f0 0x7f41481e4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f414cf3f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41481e3e20 con 0x7f41480b2fa0 2024-02-17T14:28:27.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f414cf3f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41480b2290 con 0x7f414814b0f0 2024-02-17T14:28:27.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f414cf3f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41481e4070 con 0x7f41480b43c0 2024-02-17T14:28:27.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f41477fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41480b2fa0 0x7f4148099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f41477fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41480b2fa0 0x7f4148099a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46298/0 (socket says 172.21.15.134:46298) 2024-02-17T14:28:27.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f41477fe640 1 -- 172.21.15.134:0/3560459483 learned_addr learned my addr 172.21.15.134:0/3560459483 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.495+0000 7f4146ffd640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41480b43c0 0x7f414809c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f4147fff640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414814b0f0 0x7f41481e4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f41477fe640 1 -- 172.21.15.134:0/3560459483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41480b43c0 msgr2=0x7f414809c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f41477fe640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41480b43c0 0x7f414809c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f41477fe640 1 -- 172.21.15.134:0/3560459483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414814b0f0 msgr2=0x7f41481e4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f41477fe640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414814b0f0 0x7f41481e4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f41477fe640 1 -- 172.21.15.134:0/3560459483 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41380094d0 con 0x7f41480b2fa0 2024-02-17T14:28:27.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f41477fe640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41480b2fa0 0x7f4148099a30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4138009870 tx=0x7f41380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f10cf313640 1 -- 172.21.15.134:0/598808235 shutdown_connections 2024-02-17T14:28:27.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f10cf313640 1 --2- 172.21.15.134:0/598808235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c8072a70 0x7f10c80afc40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f10cf313640 1 -- 172.21.15.134:0/598808235 >> 172.21.15.134:0/598808235 conn(0x7f10c806b480 msgr2=0x7f10c80b8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f10cf313640 1 -- 172.21.15.134:0/598808235 shutdown_connections 2024-02-17T14:28:27.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f10cf313640 1 -- 172.21.15.134:0/598808235 wait complete. 2024-02-17T14:28:27.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f08bf8eb640 1 -- 172.21.15.134:0/3344909508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08b0035630 msgr2=0x7f08b00365d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f08bf8eb640 1 --2- 172.21.15.134:0/3344909508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08b0035630 0x7f08b00365d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f08b8000b60 tx=0x7f08b806a5c0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.496+0000 7f412ffff640 1 -- 172.21.15.134:0/3560459483 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413803ac60 con 0x7f41480b2fa0 2024-02-17T14:28:27.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f08bf8eb640 1 -- 172.21.15.134:0/3344909508 shutdown_connections 2024-02-17T14:28:27.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f08bf8eb640 1 --2- 172.21.15.134:0/3344909508 >> v2:172.21.15.142:3300/0 conn(0x7f08b00c85f0 0x7f08b00c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f08bf8eb640 1 --2- 172.21.15.134:0/3344909508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08b0035630 0x7f08b00365d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f08bf8eb640 1 -- 172.21.15.134:0/3344909508 >> 172.21.15.134:0/3344909508 conn(0x7f08b003a8d0 msgr2=0x7f08b003ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f0d812d4640 1 -- 172.21.15.134:0/2442481486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d640051d0 msgr2=0x7f0d6400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f0d812d4640 1 --2- 172.21.15.134:0/2442481486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d640051d0 0x7f0d6400b980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c050150 tx=0x7f0d640057f0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f0d812d4640 1 -- 172.21.15.134:0/2442481486 shutdown_connections 2024-02-17T14:28:27.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f0d812d4640 1 --2- 172.21.15.134:0/2442481486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d640051d0 0x7f0d6400b980 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f0d812d4640 1 -- 172.21.15.134:0/2442481486 >> 172.21.15.134:0/2442481486 conn(0x7f0d7403b580 msgr2=0x7f0d7403b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f08bf8eb640 1 -- 172.21.15.134:0/3344909508 shutdown_connections 2024-02-17T14:28:27.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7fa7cccd0640 1 Processor -- start 2024-02-17T14:28:27.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7fa7cccd0640 1 -- start start 2024-02-17T14:28:27.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2257061848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a48036c70 msgr2=0x7f8a480cc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f8a4ffff640 1 --2- 172.21.15.134:0/2257061848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a48036c70 0x7f8a480cc0b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8a480077a0 tx=0x7f8a40030090 comp rx=0 tx=0).stop 2024-02-17T14:28:27.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7fd3a9815640 1 -- 172.21.15.134:0/3516581255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3a40b36f0 msgr2=0x7fd3a413d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7fd3a9815640 1 --2- 172.21.15.134:0/3516581255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3a40b36f0 0x7fd3a413d080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd39c009e50 tx=0x7fd39c02dfd0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7fd3a9815640 1 -- 172.21.15.134:0/3516581255 shutdown_connections 2024-02-17T14:28:27.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7fd3a9815640 1 --2- 172.21.15.134:0/3516581255 >> v2:172.21.15.134:3300/0 conn(0x7fd3a41439d0 0x7fd3a414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7fd3a9815640 1 --2- 172.21.15.134:0/3516581255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3a40b36f0 0x7fd3a413d080 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7fd3a9815640 1 -- 172.21.15.134:0/3516581255 >> 172.21.15.134:0/3516581255 conn(0x7fd3a40b8270 msgr2=0x7fd3a40b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7fe331ffb640 1 -- 172.21.15.134:0/708056704 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c02e070 con 0x7fe3340b3000 2024-02-17T14:28:27.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7fe331ffb640 1 -- 172.21.15.134:0/708056704 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c0315a0 con 0x7fe3340b3000 2024-02-17T14:28:27.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7fe331ffb640 1 -- 172.21.15.134:0/708056704 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c031970 con 0x7fe3340b3000 2024-02-17T14:28:27.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7fd3a9815640 1 -- 172.21.15.134:0/3516581255 shutdown_connections 2024-02-17T14:28:27.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7fd3a9815640 1 -- 172.21.15.134:0/3516581255 wait complete. 2024-02-17T14:28:27.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f08bf8eb640 1 -- 172.21.15.134:0/3344909508 wait complete. 2024-02-17T14:28:27.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f414cf3f640 1 -- 172.21.15.134:0/3560459483 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41481e4350 con 0x7f41480b2fa0 2024-02-17T14:28:27.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.497+0000 7f414cf3f640 1 -- 172.21.15.134:0/3560459483 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414809d280 con 0x7f41480b2fa0 2024-02-17T14:28:27.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.498+0000 7f412ffff640 1 -- 172.21.15.134:0/3560459483 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413803adc0 con 0x7f41480b2fa0 2024-02-17T14:28:27.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.498+0000 7f412ffff640 1 -- 172.21.15.134:0/3560459483 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138044630 con 0x7f41480b2fa0 2024-02-17T14:28:27.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.498+0000 7f0d812d4640 1 -- 172.21.15.134:0/2442481486 shutdown_connections 2024-02-17T14:28:27.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.498+0000 7f10cf313640 1 Processor -- start 2024-02-17T14:28:27.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.498+0000 7fa7cccd0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c8072ce0 0x7fa7c8120940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.498+0000 7fa7cccd0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c814a5b0 0x7fa7c81427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.498+0000 7fe3398f4640 1 -- 172.21.15.134:0/708056704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3340b3000 msgr2=0x7fe33409dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.498+0000 7fe3398f4640 1 --2- 172.21.15.134:0/708056704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3340b3000 0x7fe33409dc10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0097d0 tx=0x7fe32c02b840 comp rx=0 tx=0).stop 2024-02-17T14:28:27.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.498+0000 7f0d812d4640 1 -- 172.21.15.134:0/2442481486 wait complete. 2024-02-17T14:28:27.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.498+0000 7f08bf8eb640 1 Processor -- start 2024-02-17T14:28:27.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.498+0000 7fa7c659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c8072ce0 0x7fa7c8120940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.498+0000 7fa7c659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c8072ce0 0x7fa7c8120940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:41442/0 (socket says 172.21.15.134:41442) 2024-02-17T14:28:27.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.498+0000 7f10cf313640 1 -- start start 2024-02-17T14:28:27.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fe3398f4640 1 -- 172.21.15.134:0/708056704 shutdown_connections 2024-02-17T14:28:27.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fe3398f4640 1 --2- 172.21.15.134:0/708056704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3340b3000 0x7fe33409dc10 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0097d0 tx=0x7fe32c02b840 comp rx=0 tx=0).stop 2024-02-17T14:28:27.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fe3398f4640 1 -- 172.21.15.134:0/708056704 >> 172.21.15.134:0/708056704 conn(0x7fe3340b8cb0 msgr2=0x7fe3340b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fa7cccd0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c814a990 0x7fa7c8142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fa7cccd0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c8070d20 con 0x7fa7c814a5b0 2024-02-17T14:28:27.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fa7cccd0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c8121c10 con 0x7fa7c814a990 2024-02-17T14:28:27.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f10cf313640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c8072a70 0x7f10c8147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f10cf313640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c814e7f0 0x7f10c8148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f10cf313640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10c814f340 0x7f10c81e0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fd3a9815640 1 Processor -- start 2024-02-17T14:28:27.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f10cf313640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c814b9b0 con 0x7f10c814f340 2024-02-17T14:28:27.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f10cf313640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c8146790 con 0x7f10c8072a70 2024-02-17T14:28:27.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f10cf313640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c81d4910 con 0x7f10c814e7f0 2024-02-17T14:28:27.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fa7cccd0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c81dc440 con 0x7fa7c8072ce0 2024-02-17T14:28:27.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fa7c5d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c814a5b0 0x7fa7c81427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fa7c5d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c814a5b0 0x7fa7c81427d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46312/0 (socket says 172.21.15.134:46312) 2024-02-17T14:28:27.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fa7c5d9b640 1 -- 172.21.15.134:0/2643066901 learned_addr learned my addr 172.21.15.134:0/2643066901 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fa7c5d9b640 1 -- 172.21.15.134:0/2643066901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c8072ce0 msgr2=0x7fa7c8120940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f10cd0af640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c8072a70 0x7f10c8147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f10cd0af640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c8072a70 0x7f10c8147d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:41670/0 (socket says 172.21.15.134:41670) 2024-02-17T14:28:27.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f10cd0af640 1 -- 172.21.15.134:0/937958228 learned_addr learned my addr 172.21.15.134:0/937958228 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fd3a9815640 1 -- start start 2024-02-17T14:28:27.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f10cd8b0640 1 --2- 172.21.15.134:0/937958228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10c814f340 0x7f10c81e0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fa7c5d9b640 1 --2- 172.21.15.134:0/2643066901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c8072ce0 0x7fa7c8120940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fa7c5d9b640 1 -- 172.21.15.134:0/2643066901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c814a990 msgr2=0x7fa7c8142d10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-17T14:28:27.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fa7c5d9b640 1 --2- 172.21.15.134:0/2643066901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c814a990 0x7fa7c8142d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7fa7c5d9b640 1 -- 172.21.15.134:0/2643066901 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0094d0 con 0x7fa7c814a5b0 2024-02-17T14:28:27.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f08bf8eb640 1 -- start start 2024-02-17T14:28:27.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f08bf8eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08b0035630 0x7f08b015dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f08bf8eb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08b0035a10 0x7f08b002b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.499+0000 7f08bf8eb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b00c85f0 0x7f08b002bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f08bf8eb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b002de10 con 0x7f08b0035a10 2024-02-17T14:28:27.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f08bf8eb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b002b160 con 0x7f08b00c85f0 2024-02-17T14:28:27.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f08bf8eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b015e460 con 0x7f08b0035630 2024-02-17T14:28:27.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7fa7c5d9b640 1 --2- 172.21.15.134:0/2643066901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c814a5b0 0x7fa7c81427d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc000c00 tx=0x7fa7bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7fe3398f4640 1 -- 172.21.15.134:0/708056704 shutdown_connections 2024-02-17T14:28:27.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f08bde88640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b00c85f0 0x7f08b002bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f08bce86640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08b0035a10 0x7f08b002b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f08bde88640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b00c85f0 0x7f08b002bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:41686/0 (socket says 172.21.15.134:41686) 2024-02-17T14:28:27.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f08bde88640 1 -- 172.21.15.134:0/2135370612 learned_addr learned my addr 172.21.15.134:0/2135370612 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f10cd0af640 1 -- 172.21.15.134:0/937958228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c814e7f0 msgr2=0x7f10c8148700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-17T14:28:27.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f10cd0af640 1 --2- 172.21.15.134:0/937958228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c814e7f0 0x7f10c8148700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f10cd0af640 1 -- 172.21.15.134:0/937958228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10c814f340 msgr2=0x7f10c81e0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f10cd0af640 1 --2- 172.21.15.134:0/937958228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10c814f340 0x7f10c81e0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f10cd0af640 1 -- 172.21.15.134:0/937958228 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b80094d0 con 0x7f10c8072a70 2024-02-17T14:28:27.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7fe3398f4640 1 -- 172.21.15.134:0/708056704 wait complete. 2024-02-17T14:28:27.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7fd3a9815640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3a40b36f0 0x7fd3a413de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f412ffff640 1 -- 172.21.15.134:0/3560459483 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f413802f050 con 0x7f41480b2fa0 2024-02-17T14:28:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7fd3a9815640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3a413d5c0 0x7fd3a4142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7fd3a9815640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a41439d0 0x7fd3a41d8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7fd3a9815640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a413ea60 con 0x7fd3a41439d0 2024-02-17T14:28:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7fd3a9815640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a4146b30 con 0x7fd3a413d5c0 2024-02-17T14:28:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7fd3a9815640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a413e4d0 con 0x7fd3a40b36f0 2024-02-17T14:28:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f414cf3f640 1 -- 172.21.15.134:0/3560459483 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4128005290 con 0x7f41480b2fa0 2024-02-17T14:28:27.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7fa7b6ffd640 1 -- 172.21.15.134:0/2643066901 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc046070 con 0x7fa7c814a5b0 2024-02-17T14:28:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f0d812d4640 1 Processor -- start 2024-02-17T14:28:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7fa7b6ffd640 1 -- 172.21.15.134:0/2643066901 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc032e80 con 0x7fa7c814a5b0 2024-02-17T14:28:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f08bde88640 1 -- 172.21.15.134:0/2135370612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08b0035630 msgr2=0x7f08b015dc20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-17T14:28:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f08bde88640 1 --2- 172.21.15.134:0/2135370612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08b0035630 0x7f08b015dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f08bde88640 1 -- 172.21.15.134:0/2135370612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08b0035a10 msgr2=0x7f08b002b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f08bde88640 1 --2- 172.21.15.134:0/2135370612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08b0035a10 0x7f08b002b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.500+0000 7f08bde88640 1 -- 172.21.15.134:0/2135370612 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8068f10 con 0x7f08b00c85f0 2024-02-17T14:28:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f08bde88640 1 --2- 172.21.15.134:0/2135370612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b00c85f0 0x7f08b002bb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f08b400b410 tx=0x7f08b400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f0d812d4640 1 -- start start 2024-02-17T14:28:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7fa7b6ffd640 1 -- 172.21.15.134:0/2643066901 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc004240 con 0x7fa7c814a5b0 2024-02-17T14:28:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7fa7cccd0640 1 -- 172.21.15.134:0/2643066901 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c8071cf0 con 0x7fa7c814a5b0 2024-02-17T14:28:27.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7fa7cccd0640 1 -- 172.21.15.134:0/2643066901 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c811feb0 con 0x7fa7c814a5b0 2024-02-17T14:28:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2257061848 shutdown_connections 2024-02-17T14:28:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f8a4ffff640 1 --2- 172.21.15.134:0/2257061848 >> v2:172.21.15.134:3300/0 conn(0x7f8a480c9250 0x7f8a480bec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f8a4ffff640 1 --2- 172.21.15.134:0/2257061848 >> v2:172.21.15.142:3300/0 conn(0x7f8a48037050 0x7f8a480c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f8a4ffff640 1 --2- 172.21.15.134:0/2257061848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a48036c70 0x7f8a480cc0b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2257061848 >> 172.21.15.134:0/2257061848 conn(0x7f8a4803ace0 msgr2=0x7f8a4803b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2257061848 shutdown_connections 2024-02-17T14:28:27.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f412ffff640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f413406b860 0x7f413406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f412ffff640 1 -- 172.21.15.134:0/3560459483 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f41380ac300 con 0x7f41480b2fa0 2024-02-17T14:28:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f4146ffd640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f413406b860 0x7f413406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f10cd0af640 1 --2- 172.21.15.134:0/937958228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c8072a70 0x7f10c8147d90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10b80097f0 tx=0x7f10b80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7f4146ffd640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f413406b860 0x7f413406dd20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f41480ad480 tx=0x7f41400094f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7f0d812d4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d640051d0 0x7f0d74033720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7fd3a2ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3a40b36f0 0x7fd3a413de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7fd3a37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a41439d0 0x7fd3a41d8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7fe3398f4640 1 Processor -- start 2024-02-17T14:28:27.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7fd3a37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a41439d0 0x7fd3a41d8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46336/0 (socket says 172.21.15.134:46336) 2024-02-17T14:28:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7fd3a37fe640 1 -- 172.21.15.134:0/2023946079 learned_addr learned my addr 172.21.15.134:0/2023946079 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7fd3a27fc640 1 --2- 172.21.15.134:0/2023946079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3a413d5c0 0x7fd3a4142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7f10bdffb640 1 -- 172.21.15.134:0/937958228 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b8032960 con 0x7f10c8072a70 2024-02-17T14:28:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7f10bdffb640 1 -- 172.21.15.134:0/937958228 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b8032ac0 con 0x7f10c8072a70 2024-02-17T14:28:27.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7f10bdffb640 1 -- 172.21.15.134:0/937958228 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b8032e50 con 0x7f10c8072a70 2024-02-17T14:28:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7f0d7affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d640051d0 0x7f0d74033720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7fe3398f4640 1 -- start start 2024-02-17T14:28:27.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7f0d7affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d640051d0 0x7f0d74033720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46342/0 (socket says 172.21.15.134:46342) 2024-02-17T14:28:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7fd3a37fe640 1 -- 172.21.15.134:0/2023946079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3a40b36f0 msgr2=0x7fd3a413de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7fd3a37fe640 1 --2- 172.21.15.134:0/2023946079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3a40b36f0 0x7fd3a413de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7fd3a37fe640 1 -- 172.21.15.134:0/2023946079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3a413d5c0 msgr2=0x7fd3a4142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7fd3a37fe640 1 --2- 172.21.15.134:0/2023946079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3a413d5c0 0x7fd3a4142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.502+0000 7fd3a37fe640 1 -- 172.21.15.134:0/2023946079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c009b30 con 0x7fd3a41439d0 2024-02-17T14:28:27.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f0d7affd640 1 -- 172.21.15.134:0/4288995601 learned_addr learned my addr 172.21.15.134:0/4288995601 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7fd3a37fe640 1 --2- 172.21.15.134:0/2023946079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a41439d0 0x7fd3a41d8200 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd39400c7c0 tx=0x7fd39400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f0d812d4640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d74034470 0x7f0d74023b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7fa7cccd0640 1 -- 172.21.15.134:0/2643066901 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c8074650 con 0x7fa7c814a5b0 2024-02-17T14:28:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.501+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2257061848 wait complete. 2024-02-17T14:28:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f8a4ffff640 1 Processor -- start 2024-02-17T14:28:27.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f0d812d4640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d740247f0 0x7f0d74024090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f0d812d4640 1 -- 172.21.15.134:0/4288995601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d74022440 con 0x7f0d640051d0 2024-02-17T14:28:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f8a4ffff640 1 -- start start 2024-02-17T14:28:27.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f0d812d4640 1 -- 172.21.15.134:0/4288995601 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d74034900 con 0x7f0d740247f0 2024-02-17T14:28:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f0d812d4640 1 -- 172.21.15.134:0/4288995601 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d74034be0 con 0x7f0d74034470 2024-02-17T14:28:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f0d7a7fc640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d74034470 0x7f0d74023b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f08adffb640 1 -- 172.21.15.134:0/2135370612 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4011830 con 0x7f08b00c85f0 2024-02-17T14:28:27.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f08adffb640 1 -- 172.21.15.134:0/2135370612 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b4011990 con 0x7f08b00c85f0 2024-02-17T14:28:27.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f0d7b7fe640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d740247f0 0x7f0d74024090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f0d7a7fc640 1 -- 172.21.15.134:0/4288995601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d740247f0 msgr2=0x7f0d74024090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7fe3398f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3340b5810 0x7fe3340b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f0d7a7fc640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d740247f0 0x7f0d74024090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f0d7a7fc640 1 -- 172.21.15.134:0/4288995601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d640051d0 msgr2=0x7f0d74033720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f10cf313640 1 -- 172.21.15.134:0/937958228 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c8146a70 con 0x7f10c8072a70 2024-02-17T14:28:27.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f0d7a7fc640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d640051d0 0x7f0d74033720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f08adffb640 1 -- 172.21.15.134:0/2135370612 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4011d40 con 0x7f08b00c85f0 2024-02-17T14:28:27.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe3398f4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3340b5bf0 0x7fe3340afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f10cf313640 1 -- 172.21.15.134:0/937958228 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c8148c40 con 0x7f10c8072a70 2024-02-17T14:28:27.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe3398f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3341d88d0 0x7fe3341d8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe332ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3340b5810 0x7fe3340b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe3398f4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3341d92a0 con 0x7fe3340b5810 2024-02-17T14:28:27.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe3398f4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340b2810 con 0x7fe3340b5bf0 2024-02-17T14:28:27.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe332ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3340b5810 0x7fe3340b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46348/0 (socket says 172.21.15.134:46348) 2024-02-17T14:28:27.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe3398f4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340b0280 con 0x7fe3341d88d0 2024-02-17T14:28:27.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe332ffd640 1 -- 172.21.15.134:0/1388594569 learned_addr learned my addr 172.21.15.134:0/1388594569 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe3337fe640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3341d88d0 0x7fe3341d8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f08bf8eb640 1 -- 172.21.15.134:0/2135370612 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b015e740 con 0x7f08b00c85f0 2024-02-17T14:28:27.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f08bf8eb640 1 -- 172.21.15.134:0/2135370612 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b015e160 con 0x7f08b00c85f0 2024-02-17T14:28:27.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f8a4ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a48036c70 0x7f8a480cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f8a4ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a48037050 0x7f8a480c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f8a4ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a480c9250 0x7f8a480c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f8a4ffff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a48034730 con 0x7f8a48036c70 2024-02-17T14:28:27.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f8a4ffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4802a980 con 0x7f8a480c9250 2024-02-17T14:28:27.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f8a4ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4802a6a0 con 0x7f8a48037050 2024-02-17T14:28:27.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe3327fc640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3340b5bf0 0x7fe3340afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f8a4f7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a480c9250 0x7f8a480c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f8a4f7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a480c9250 0x7f8a480c2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:41720/0 (socket says 172.21.15.134:41720) 2024-02-17T14:28:27.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7f8a4f7fe640 1 -- 172.21.15.134:0/2874460944 learned_addr learned my addr 172.21.15.134:0/2874460944 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:27.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.503+0000 7f0d7a7fc640 1 -- 172.21.15.134:0/4288995601 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d74034ec0 con 0x7f0d74034470 2024-02-17T14:28:27.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe332ffd640 1 -- 172.21.15.134:0/1388594569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3341d88d0 msgr2=0x7fe3341d8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe332ffd640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3341d88d0 0x7fe3341d8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe332ffd640 1 -- 172.21.15.134:0/1388594569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3340b5bf0 msgr2=0x7fe3340afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe332ffd640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3340b5bf0 0x7fe3340afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.504+0000 7fe332ffd640 1 -- 172.21.15.134:0/1388594569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c009400 con 0x7fe3340b5810 2024-02-17T14:28:27.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f8a4effd640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a48036c70 0x7f8a480cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f8a4e7fc640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a48037050 0x7f8a480c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f0d7a7fc640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d74034470 0x7f0d74023b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d74004180 tx=0x7f0d70010c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7fe332ffd640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3340b5810 0x7fe3340b1a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c4c0 tx=0x7fe31c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f0d637fe640 1 -- 172.21.15.134:0/4288995601 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7000e990 con 0x7f0d74034470 2024-02-17T14:28:27.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f0d637fe640 1 -- 172.21.15.134:0/4288995601 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7000eaf0 con 0x7f0d74034470 2024-02-17T14:28:27.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f8a4e7fc640 1 -- 172.21.15.134:0/2874460944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a480c9250 msgr2=0x7f8a480c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f8a4e7fc640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a480c9250 0x7f8a480c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f8a4e7fc640 1 -- 172.21.15.134:0/2874460944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a48036c70 msgr2=0x7f8a480cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f8a4e7fc640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a48036c70 0x7f8a480cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f8a4e7fc640 1 -- 172.21.15.134:0/2874460944 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4000a570 con 0x7f8a48037050 2024-02-17T14:28:27.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f0d637fe640 1 -- 172.21.15.134:0/4288995601 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7000ee80 con 0x7f0d74034470 2024-02-17T14:28:27.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f0d812d4640 1 -- 172.21.15.134:0/4288995601 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d74032950 con 0x7f0d74034470 2024-02-17T14:28:27.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f0d812d4640 1 -- 172.21.15.134:0/4288995601 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d74160a60 con 0x7f0d74034470 2024-02-17T14:28:27.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f8a4e7fc640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a48037050 0x7f8a480c4fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8a50000b60 tx=0x7f8a50068710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.505+0000 7f08bf8eb640 1 -- 172.21.15.134:0/2135370612 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b0037030 con 0x7f08b00c85f0 2024-02-17T14:28:27.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.506+0000 7f08adffb640 1 -- 172.21.15.134:0/2135370612 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f08b401a400 con 0x7f08b00c85f0 2024-02-17T14:28:27.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.506+0000 7f10cf313640 1 -- 172.21.15.134:0/937958228 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c81465f0 con 0x7f10c8072a70 2024-02-17T14:28:27.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.506+0000 7f10bdffb640 1 -- 172.21.15.134:0/937958228 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f10b804e450 con 0x7f10c8072a70 2024-02-17T14:28:27.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.507+0000 7f10bdffb640 1 --2- 172.21.15.134:0/937958228 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f10ac06b8e0 0x7f10ac06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.506+0000 7f08adffb640 1 --2- 172.21.15.134:0/2135370612 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f089c06b8e0 0x7f089c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.507+0000 7f08bd687640 1 --2- 172.21.15.134:0/2135370612 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f089c06b8e0 0x7f089c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.506+0000 7f8a37fff640 1 -- 172.21.15.134:0/2874460944 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50071ba0 con 0x7f8a48037050 2024-02-17T14:28:27.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.506+0000 7f8a37fff640 1 -- 172.21.15.134:0/2874460944 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a50071d00 con 0x7f8a48037050 2024-02-17T14:28:27.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.506+0000 7f8a37fff640 1 -- 172.21.15.134:0/2874460944 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50094630 con 0x7f8a48037050 2024-02-17T14:28:27.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.506+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2874460944 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a480c1bb0 con 0x7f8a48037050 2024-02-17T14:28:27.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.506+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2874460944 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a480343c0 con 0x7f8a48037050 2024-02-17T14:28:27.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.507+0000 7f0d812d4640 1 -- 172.21.15.134:0/4288995601 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d740057e0 con 0x7f0d74034470 2024-02-17T14:28:27.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.507+0000 7f10bdffb640 1 -- 172.21.15.134:0/937958228 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f10b80ac870 con 0x7f10c8072a70 2024-02-17T14:28:27.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.507+0000 7f0d637fe640 1 -- 172.21.15.134:0/4288995601 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0d70016480 con 0x7f0d74034470 2024-02-17T14:28:27.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.507+0000 7f10cc8ae640 1 --2- 172.21.15.134:0/937958228 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f10ac06b8e0 0x7f10ac06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.507+0000 7f08adffb640 1 -- 172.21.15.134:0/2135370612 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f08b408a4d0 con 0x7f08b00c85f0 2024-02-17T14:28:27.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.507+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2874460944 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4802a500 con 0x7f8a48037050 2024-02-17T14:28:27.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.508+0000 7f0d637fe640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0d6806b840 0x7f0d6806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.508+0000 7f0d637fe640 1 -- 172.21.15.134:0/4288995601 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0d7008aaa0 con 0x7f0d74034470 2024-02-17T14:28:27.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.508+0000 7f10cc8ae640 1 --2- 172.21.15.134:0/937958228 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f10ac06b8e0 0x7f10ac06dda0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f10c8071110 tx=0x7f10c4006bd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.508+0000 7f08bd687640 1 --2- 172.21.15.134:0/2135370612 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f089c06b8e0 0x7f089c06dda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f08b0039f70 tx=0x7f08b80b5000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.508+0000 7f0d7affd640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0d6806b840 0x7f0d6806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.508+0000 7f8a37fff640 1 -- 172.21.15.134:0/2874460944 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f8a50094790 con 0x7f8a48037050 2024-02-17T14:28:27.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.509+0000 7f0d7affd640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0d6806b840 0x7f0d6806dd00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c001050 tx=0x7f0d6c001b00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.509+0000 7f8a37fff640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f8a3c06b860 0x7f8a3c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.509+0000 7f8a4effd640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f8a3c06b860 0x7f8a3c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.509+0000 7f8a37fff640 1 -- 172.21.15.134:0/2874460944 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8a50104cd0 con 0x7f8a48037050 2024-02-17T14:28:27.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.509+0000 7f8a4effd640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f8a3c06b860 0x7f8a3c06dd20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8a480077a0 tx=0x7f8a4000d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.510+0000 7f412ffff640 1 -- 172.21.15.134:0/3560459483 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4138076b50 con 0x7f41480b2fa0 2024-02-17T14:28:27.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.510+0000 7fd38bfff640 1 -- 172.21.15.134:0/2023946079 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394004230 con 0x7fd3a41439d0 2024-02-17T14:28:27.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.511+0000 7fd3a9815640 1 -- 172.21.15.134:0/2023946079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a4146330 con 0x7fd3a41439d0 2024-02-17T14:28:27.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.511+0000 7fd3a9815640 1 -- 172.21.15.134:0/2023946079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a4145770 con 0x7fd3a41439d0 2024-02-17T14:28:27.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.511+0000 7fd38bfff640 1 -- 172.21.15.134:0/2023946079 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd394004390 con 0x7fd3a41439d0 2024-02-17T14:28:27.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.511+0000 7fd38bfff640 1 -- 172.21.15.134:0/2023946079 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39400a3d0 con 0x7fd3a41439d0 2024-02-17T14:28:27.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.511+0000 7fe32bfff640 1 -- 172.21.15.134:0/1388594569 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0035f0 con 0x7fe3340b5810 2024-02-17T14:28:27.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.511+0000 7fe32bfff640 1 -- 172.21.15.134:0/1388594569 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c003770 con 0x7fe3340b5810 2024-02-17T14:28:27.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.511+0000 7fe32bfff640 1 -- 172.21.15.134:0/1388594569 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c003b60 con 0x7fe3340b5810 2024-02-17T14:28:27.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.511+0000 7f08adffb640 1 -- 172.21.15.134:0/2135370612 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f08b0037030 con 0x7f08b00c85f0 2024-02-17T14:28:27.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.511+0000 7fe3398f4640 1 -- 172.21.15.134:0/1388594569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3340b20a0 con 0x7fe3340b5810 2024-02-17T14:28:27.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.512+0000 7fe3398f4640 1 -- 172.21.15.134:0/1388594569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3340b2a20 con 0x7fe3340b5810 2024-02-17T14:28:27.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.512+0000 7fa7b6ffd640 1 -- 172.21.15.134:0/2643066901 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa7bc04a070 con 0x7fa7c814a5b0 2024-02-17T14:28:27.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.512+0000 7fd3a9815640 1 -- 172.21.15.134:0/2023946079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd384005290 con 0x7fd3a41439d0 2024-02-17T14:28:27.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.512+0000 7fa7b6ffd640 1 --2- 172.21.15.134:0/2643066901 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa7a806b860 0x7fa7a806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.512+0000 7f0d637fe640 1 -- 172.21.15.134:0/4288995601 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0d70055170 con 0x7f0d74034470 2024-02-17T14:28:27.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.512+0000 7fa7b6ffd640 1 -- 172.21.15.134:0/2643066901 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa7bc02d040 con 0x7fa7c814a5b0 2024-02-17T14:28:27.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.513+0000 7fa7c659c640 1 --2- 172.21.15.134:0/2643066901 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa7a806b860 0x7fa7a806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.513+0000 7fe3398f4640 1 -- 172.21.15.134:0/1388594569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe334068280 con 0x7fe3340b5810 2024-02-17T14:28:27.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.513+0000 7fa7c659c640 1 --2- 172.21.15.134:0/2643066901 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa7a806b860 0x7fa7a806dd20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8000f60 tx=0x7fa7b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.516+0000 7f10bdffb640 1 -- 172.21.15.134:0/937958228 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10c81465f0 con 0x7f10c8072a70 2024-02-17T14:28:27.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.517+0000 7fa7b6ffd640 1 -- 172.21.15.134:0/2643066901 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa7bc07f730 con 0x7fa7c814a5b0 2024-02-17T14:28:27.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.517+0000 7f8a37fff640 1 -- 172.21.15.134:0/2874460944 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8a4802a500 con 0x7f8a48037050 2024-02-17T14:28:27.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.519+0000 7fd38bfff640 1 -- 172.21.15.134:0/2023946079 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd394003810 con 0x7fd3a41439d0 2024-02-17T14:28:27.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.519+0000 7fd38bfff640 1 --2- 172.21.15.134:0/2023946079 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd39006b810 0x7fd39006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.519+0000 7fd38bfff640 1 -- 172.21.15.134:0/2023946079 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd39408ac80 con 0x7fd3a41439d0 2024-02-17T14:28:27.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.520+0000 7fd3a2ffd640 1 --2- 172.21.15.134:0/2023946079 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd39006b810 0x7fd39006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.521+0000 7fd3a2ffd640 1 --2- 172.21.15.134:0/2023946079 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd39006b810 0x7fd39006dcd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd39c037000 tx=0x7fd39c032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.522+0000 7fe32bfff640 1 -- 172.21.15.134:0/1388594569 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe31c003cc0 con 0x7fe3340b5810 2024-02-17T14:28:27.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.523+0000 7fe32bfff640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe31406b810 0x7fe31406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:27.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.523+0000 7fe32bfff640 1 -- 172.21.15.134:0/1388594569 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe31c089c70 con 0x7fe3340b5810 2024-02-17T14:28:27.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.523+0000 7fe3327fc640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe31406b810 0x7fe31406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:27.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.524+0000 7fe3327fc640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe31406b810 0x7fe31406dcd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe32c036000 tx=0x7fe32c03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:27.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.527+0000 7fd38bfff640 1 -- 172.21.15.134:0/2023946079 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd394055370 con 0x7fd3a41439d0 2024-02-17T14:28:27.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.536+0000 7fe32bfff640 1 -- 172.21.15.134:0/1388594569 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe31c054330 con 0x7fe3340b5810 2024-02-17T14:28:27.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.923+0000 7f0d812d4640 1 -- 172.21.15.134:0/4288995601 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0d74035050 con 0x7f0d74034470 2024-02-17T14:28:27.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.923+0000 7f0d637fe640 1 -- 172.21.15.134:0/4288995601 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d70058830 con 0x7f0d74034470 2024-02-17T14:28:27.923 INFO:teuthology.orchestra.run.smithi134.stdout:55834574854 2024-02-17T14:28:27.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.925+0000 7f10cf313640 1 -- 172.21.15.134:0/937958228 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10c81465f0 con 0x7f10c8072a70 2024-02-17T14:28:27.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.926+0000 7f10bdffb640 1 -- 172.21.15.134:0/937958228 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10c81465f0 con 0x7f10c8072a70 2024-02-17T14:28:27.926 INFO:teuthology.orchestra.run.smithi134.stdout:55834574854 2024-02-17T14:28:27.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7f0d812d4640 1 -- 172.21.15.134:0/4288995601 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0d6806b840 msgr2=0x7f0d6806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7f0d812d4640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0d6806b840 0x7f0d6806dd00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c001050 tx=0x7f0d6c001b00 comp rx=0 tx=0).stop 2024-02-17T14:28:27.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7fa7cccd0640 1 -- 172.21.15.134:0/2643066901 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa7c8067b70 con 0x7fa7c814a5b0 2024-02-17T14:28:27.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7f0d812d4640 1 -- 172.21.15.134:0/4288995601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d74034470 msgr2=0x7f0d74023b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7f0d812d4640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d74034470 0x7f0d74023b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d74004180 tx=0x7f0d70010c80 comp rx=0 tx=0).stop 2024-02-17T14:28:27.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7f0d812d4640 1 -- 172.21.15.134:0/4288995601 shutdown_connections 2024-02-17T14:28:27.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7f0d812d4640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d740247f0 0x7f0d74024090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7f0d812d4640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d74034470 0x7f0d74023b50 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d74004180 tx=0x7f0d70010c80 comp rx=0 tx=0).stop 2024-02-17T14:28:27.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7f0d812d4640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0d6806b840 0x7f0d6806dd00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7f0d812d4640 1 --2- 172.21.15.134:0/4288995601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d640051d0 0x7f0d74033720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7f0d812d4640 1 -- 172.21.15.134:0/4288995601 >> 172.21.15.134:0/4288995601 conn(0x7f0d7403b580 msgr2=0x7f0d7400ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7f0d812d4640 1 -- 172.21.15.134:0/4288995601 shutdown_connections 2024-02-17T14:28:27.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7f0d812d4640 1 -- 172.21.15.134:0/4288995601 wait complete. 2024-02-17T14:28:27.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.927+0000 7fa7b6ffd640 1 -- 172.21.15.134:0/2643066901 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7bc035090 con 0x7fa7c814a5b0 2024-02-17T14:28:27.929 INFO:teuthology.orchestra.run.smithi134.stdout:55834574855 2024-02-17T14:28:27.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.929+0000 7f10ab7fe640 1 -- 172.21.15.134:0/937958228 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f10ac06b8e0 msgr2=0x7f10ac06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.929+0000 7f10ab7fe640 1 --2- 172.21.15.134:0/937958228 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f10ac06b8e0 0x7f10ac06dda0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f10c8071110 tx=0x7f10c4006bd0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.929+0000 7f10ab7fe640 1 -- 172.21.15.134:0/937958228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c8072a70 msgr2=0x7f10c8147d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.929+0000 7f10ab7fe640 1 --2- 172.21.15.134:0/937958228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c8072a70 0x7f10c8147d90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10b80097f0 tx=0x7f10b80046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.929+0000 7f10ab7fe640 1 -- 172.21.15.134:0/937958228 shutdown_connections 2024-02-17T14:28:27.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.929+0000 7f10ab7fe640 1 --2- 172.21.15.134:0/937958228 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f10ac06b8e0 0x7f10ac06dda0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.929+0000 7f10ab7fe640 1 --2- 172.21.15.134:0/937958228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10c814f340 0x7f10c81e0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.929+0000 7f10ab7fe640 1 --2- 172.21.15.134:0/937958228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10c814e7f0 0x7f10c8148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.930+0000 7f10ab7fe640 1 --2- 172.21.15.134:0/937958228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c8072a70 0x7f10c8147d90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.930+0000 7f10ab7fe640 1 -- 172.21.15.134:0/937958228 >> 172.21.15.134:0/937958228 conn(0x7f10c806b480 msgr2=0x7f10c80b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.930+0000 7f10ab7fe640 1 -- 172.21.15.134:0/937958228 shutdown_connections 2024-02-17T14:28:27.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.930+0000 7f10ab7fe640 1 -- 172.21.15.134:0/937958228 wait complete. 2024-02-17T14:28:27.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.929+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2874460944 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8a4802a500 con 0x7f8a48037050 2024-02-17T14:28:27.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.930+0000 7f8a37fff640 1 -- 172.21.15.134:0/2874460944 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a4802a500 con 0x7f8a48037050 2024-02-17T14:28:27.931 INFO:teuthology.orchestra.run.smithi134.stdout:55834574856 2024-02-17T14:28:27.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.931+0000 7fa7cccd0640 1 -- 172.21.15.134:0/2643066901 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa7a806b860 msgr2=0x7fa7a806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.931+0000 7fa7cccd0640 1 --2- 172.21.15.134:0/2643066901 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa7a806b860 0x7fa7a806dd20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8000f60 tx=0x7fa7b8009040 comp rx=0 tx=0).stop 2024-02-17T14:28:27.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.931+0000 7fa7cccd0640 1 -- 172.21.15.134:0/2643066901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c814a5b0 msgr2=0x7fa7c81427d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.932+0000 7fa7cccd0640 1 --2- 172.21.15.134:0/2643066901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c814a5b0 0x7fa7c81427d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc000c00 tx=0x7fa7bc0046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.932+0000 7f414cf3f640 1 -- 172.21.15.134:0/3560459483 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4128005810 con 0x7f41480b2fa0 2024-02-17T14:28:27.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.932+0000 7fa7cccd0640 1 -- 172.21.15.134:0/2643066901 shutdown_connections 2024-02-17T14:28:27.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.932+0000 7fa7cccd0640 1 --2- 172.21.15.134:0/2643066901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c814a990 0x7fa7c8142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.932+0000 7fa7cccd0640 1 --2- 172.21.15.134:0/2643066901 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa7a806b860 0x7fa7a806dd20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.932+0000 7fa7cccd0640 1 --2- 172.21.15.134:0/2643066901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7c814a5b0 0x7fa7c81427d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.932+0000 7fa7cccd0640 1 --2- 172.21.15.134:0/2643066901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c8072ce0 0x7fa7c8120940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.932+0000 7fa7cccd0640 1 -- 172.21.15.134:0/2643066901 >> 172.21.15.134:0/2643066901 conn(0x7fa7c806b480 msgr2=0x7fa7c8147a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.932+0000 7fa7cccd0640 1 -- 172.21.15.134:0/2643066901 shutdown_connections 2024-02-17T14:28:27.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.933+0000 7fa7cccd0640 1 -- 172.21.15.134:0/2643066901 wait complete. 2024-02-17T14:28:27.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.933+0000 7f412ffff640 1 -- 172.21.15.134:0/3560459483 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f413807a210 con 0x7f41480b2fa0 2024-02-17T14:28:27.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.934+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2874460944 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f8a3c06b860 msgr2=0x7f8a3c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.934+0000 7f8a4ffff640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f8a3c06b860 0x7f8a3c06dd20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8a480077a0 tx=0x7f8a4000d040 comp rx=0 tx=0).stop 2024-02-17T14:28:27.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.934+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2874460944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a48037050 msgr2=0x7f8a480c4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.934+0000 7f8a4ffff640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a48037050 0x7f8a480c4fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8a50000b60 tx=0x7f8a50068710 comp rx=0 tx=0).stop 2024-02-17T14:28:27.936 INFO:teuthology.orchestra.run.smithi134.stdout:55834574855 2024-02-17T14:28:27.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.934+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2874460944 shutdown_connections 2024-02-17T14:28:27.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.934+0000 7f8a4ffff640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a480c9250 0x7f8a480c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.934+0000 7f8a4ffff640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a48037050 0x7f8a480c4fa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.934+0000 7f8a4ffff640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f8a3c06b860 0x7f8a3c06dd20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.934+0000 7f8a4ffff640 1 --2- 172.21.15.134:0/2874460944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a48036c70 0x7f8a480cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.934+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2874460944 >> 172.21.15.134:0/2874460944 conn(0x7f8a4803ace0 msgr2=0x7f8a480c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.934+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2874460944 shutdown_connections 2024-02-17T14:28:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.934+0000 7f8a4ffff640 1 -- 172.21.15.134:0/2874460944 wait complete. 2024-02-17T14:28:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.937+0000 7f414cf3f640 1 -- 172.21.15.134:0/3560459483 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f413406b860 msgr2=0x7f413406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.937+0000 7f414cf3f640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f413406b860 0x7f413406dd20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f41480ad480 tx=0x7f41400094f0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.937+0000 7f414cf3f640 1 -- 172.21.15.134:0/3560459483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41480b2fa0 msgr2=0x7f4148099a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.937+0000 7f414cf3f640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41480b2fa0 0x7f4148099a30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4138009870 tx=0x7f41380046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.937+0000 7f414cf3f640 1 -- 172.21.15.134:0/3560459483 shutdown_connections 2024-02-17T14:28:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.937+0000 7f414cf3f640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414814b0f0 0x7f41481e4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.937+0000 7f414cf3f640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41480b43c0 0x7f414809c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.937+0000 7f414cf3f640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f413406b860 0x7f413406dd20 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f41480ad480 tx=0x7f41400094f0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.937+0000 7f414cf3f640 1 --2- 172.21.15.134:0/3560459483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41480b2fa0 0x7f4148099a30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.937+0000 7f414cf3f640 1 -- 172.21.15.134:0/3560459483 >> 172.21.15.134:0/3560459483 conn(0x7f41480b4b60 msgr2=0x7f41480b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.938+0000 7f414cf3f640 1 -- 172.21.15.134:0/3560459483 shutdown_connections 2024-02-17T14:28:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.938+0000 7f414cf3f640 1 -- 172.21.15.134:0/3560459483 wait complete. 2024-02-17T14:28:27.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.939+0000 7fd3a9815640 1 -- 172.21.15.134:0/2023946079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd384005810 con 0x7fd3a41439d0 2024-02-17T14:28:27.940 INFO:teuthology.orchestra.run.smithi134.stdout:55834574855 2024-02-17T14:28:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.939+0000 7fd38bfff640 1 -- 172.21.15.134:0/2023946079 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd394058a30 con 0x7fd3a41439d0 2024-02-17T14:28:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.941+0000 7f08bf8eb640 1 -- 172.21.15.134:0/2135370612 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f08b0006e90 con 0x7f08b00c85f0 2024-02-17T14:28:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.942+0000 7f08adffb640 1 -- 172.21.15.134:0/2135370612 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08b4015090 con 0x7f08b00c85f0 2024-02-17T14:28:27.941 INFO:teuthology.orchestra.run.smithi134.stdout:55834574855 2024-02-17T14:28:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.944+0000 7fd3a9815640 1 -- 172.21.15.134:0/2023946079 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd39006b810 msgr2=0x7fd39006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.944+0000 7fd3a9815640 1 --2- 172.21.15.134:0/2023946079 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd39006b810 0x7fd39006dcd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd39c037000 tx=0x7fd39c032000 comp rx=0 tx=0).stop 2024-02-17T14:28:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.944+0000 7fd3a9815640 1 -- 172.21.15.134:0/2023946079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a41439d0 msgr2=0x7fd3a41d8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.944+0000 7fd3a9815640 1 --2- 172.21.15.134:0/2023946079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a41439d0 0x7fd3a41d8200 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd39400c7c0 tx=0x7fd39400cc80 comp rx=0 tx=0).stop 2024-02-17T14:28:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.944+0000 7fd3a9815640 1 -- 172.21.15.134:0/2023946079 shutdown_connections 2024-02-17T14:28:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.944+0000 7fd3a9815640 1 --2- 172.21.15.134:0/2023946079 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd39006b810 0x7fd39006dcd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.944+0000 7fd3a9815640 1 --2- 172.21.15.134:0/2023946079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a41439d0 0x7fd3a41d8200 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.944+0000 7fd3a9815640 1 --2- 172.21.15.134:0/2023946079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3a413d5c0 0x7fd3a4142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.944+0000 7fd3a9815640 1 --2- 172.21.15.134:0/2023946079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3a40b36f0 0x7fd3a413de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.944+0000 7fd3a9815640 1 -- 172.21.15.134:0/2023946079 >> 172.21.15.134:0/2023946079 conn(0x7fd3a40b8270 msgr2=0x7fd3a413b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.944+0000 7fd3a9815640 1 -- 172.21.15.134:0/2023946079 shutdown_connections 2024-02-17T14:28:27.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.944+0000 7fd3a9815640 1 -- 172.21.15.134:0/2023946079 wait complete. 2024-02-17T14:28:27.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.945+0000 7fe3398f4640 1 -- 172.21.15.134:0/1388594569 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe3340b0870 con 0x7fe3340b5810 2024-02-17T14:28:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.945+0000 7f08bf8eb640 1 -- 172.21.15.134:0/2135370612 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f089c06b8e0 msgr2=0x7f089c06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.946+0000 7f08bf8eb640 1 --2- 172.21.15.134:0/2135370612 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f089c06b8e0 0x7f089c06dda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f08b0039f70 tx=0x7f08b80b5000 comp rx=0 tx=0).stop 2024-02-17T14:28:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.946+0000 7f08bf8eb640 1 -- 172.21.15.134:0/2135370612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b00c85f0 msgr2=0x7f08b002bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.946+0000 7f08bf8eb640 1 --2- 172.21.15.134:0/2135370612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b00c85f0 0x7f08b002bb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f08b400b410 tx=0x7f08b400b8d0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.946+0000 7f08bf8eb640 1 -- 172.21.15.134:0/2135370612 shutdown_connections 2024-02-17T14:28:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.946+0000 7f08bf8eb640 1 --2- 172.21.15.134:0/2135370612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08b00c85f0 0x7f08b002bb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.946+0000 7f08bf8eb640 1 --2- 172.21.15.134:0/2135370612 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f089c06b8e0 0x7f089c06dda0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.946+0000 7f08bf8eb640 1 --2- 172.21.15.134:0/2135370612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08b0035a10 0x7f08b002b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.946+0000 7f08bf8eb640 1 --2- 172.21.15.134:0/2135370612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08b0035630 0x7f08b015dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.946+0000 7f08bf8eb640 1 -- 172.21.15.134:0/2135370612 >> 172.21.15.134:0/2135370612 conn(0x7f08b003a8d0 msgr2=0x7f08b00c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.946+0000 7fe32bfff640 1 -- 172.21.15.134:0/1388594569 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe31c017020 con 0x7fe3340b5810 2024-02-17T14:28:27.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.946+0000 7f08bf8eb640 1 -- 172.21.15.134:0/2135370612 shutdown_connections 2024-02-17T14:28:27.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.946+0000 7f08bf8eb640 1 -- 172.21.15.134:0/2135370612 wait complete. 2024-02-17T14:28:27.948 INFO:teuthology.orchestra.run.smithi134.stdout:55834574856 2024-02-17T14:28:27.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-02-17T14:28:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.950+0000 7fe3398f4640 1 -- 172.21.15.134:0/1388594569 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe31406b810 msgr2=0x7fe31406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.950+0000 7fe3398f4640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe31406b810 0x7fe31406dcd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe32c036000 tx=0x7fe32c03d040 comp rx=0 tx=0).stop 2024-02-17T14:28:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.950+0000 7fe3398f4640 1 -- 172.21.15.134:0/1388594569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3340b5810 msgr2=0x7fe3340b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.950+0000 7fe3398f4640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3340b5810 0x7fe3340b1a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c4c0 tx=0x7fe31c00c980 comp rx=0 tx=0).stop 2024-02-17T14:28:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.951+0000 7fe3398f4640 1 -- 172.21.15.134:0/1388594569 shutdown_connections 2024-02-17T14:28:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.951+0000 7fe3398f4640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3341d88d0 0x7fe3341d8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.951+0000 7fe3398f4640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3340b5bf0 0x7fe3340afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.951+0000 7fe3398f4640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe31406b810 0x7fe31406dcd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.951+0000 7fe3398f4640 1 --2- 172.21.15.134:0/1388594569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3340b5810 0x7fe3340b1a20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.951+0000 7fe3398f4640 1 -- 172.21.15.134:0/1388594569 >> 172.21.15.134:0/1388594569 conn(0x7fe3340b8cb0 msgr2=0x7fe3340b7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.951+0000 7fe3398f4640 1 -- 172.21.15.134:0/1388594569 shutdown_connections 2024-02-17T14:28:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:27.951+0000 7fe3398f4640 1 -- 172.21.15.134:0/1388594569 wait complete. 2024-02-17T14:28:27.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-02-17T14:28:27.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2024-02-17T14:28:27.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-02-17T14:28:27.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2024-02-17T14:28:27.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-02-17T14:28:27.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-02-17T14:28:27.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-02-17T14:28:28.950 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-17T14:28:28.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-17T14:28:28.958 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-17T14:28:28.961 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-17T14:28:28.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-17T14:28:28.965 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-17T14:28:28.967 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-17T14:28:28.968 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-17T14:28:29.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.113+0000 7f0f88861640 1 Processor -- start 2024-02-17T14:28:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.113+0000 7f0f88861640 1 -- start start 2024-02-17T14:28:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.114+0000 7f0f88861640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f84143330 0x7f0f841437c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.115+0000 7f0f88861640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0f8414b620 0x7f0f8414da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.115+0000 7f0f88861640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f8409a0e0 con 0x7f0f84099d00 2024-02-17T14:28:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.115+0000 7f0f88861640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f840ae080 con 0x7f0f84143330 2024-02-17T14:28:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.115+0000 7f0f88861640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f840ade10 con 0x7f0f8414b620 2024-02-17T14:28:29.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.115+0000 7f0f8259c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f84143330 0x7f0f841437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.115+0000 7f0f8259c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f84143330 0x7f0f841437c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46362/0 (socket says 172.21.15.134:46362) 2024-02-17T14:28:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.115+0000 7f0f8259c640 1 -- 172.21.15.134:0/2225454372 learned_addr learned my addr 172.21.15.134:0/2225454372 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.115+0000 7f0f8259c640 1 -- 172.21.15.134:0/2225454372 >> v2:172.21.15.142:3300/0 conn(0x7f0f8414b620 msgr2=0x7f0f8414da10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T14:28:29.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.116+0000 7f0f8359e640 1 --2- 172.21.15.134:0/2225454372 >> v2:172.21.15.142:3300/0 conn(0x7f0f8414b620 0x7f0f8414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.116+0000 7f0f8259c640 1 --2- 172.21.15.134:0/2225454372 >> v2:172.21.15.142:3300/0 conn(0x7f0f8414b620 0x7f0f8414da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.116+0000 7f0f8259c640 1 -- 172.21.15.134:0/2225454372 >> v1:172.21.15.134:6789/0 conn(0x7f0f84099d00 legacy=0x7f0f8409a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.116+0000 7f0f8259c640 1 -- 172.21.15.134:0/2225454372 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f840ae860 con 0x7f0f84143330 2024-02-17T14:28:29.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.117+0000 7f0f8259c640 1 --2- 172.21.15.134:0/2225454372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f84143330 0x7f0f841437c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0f8406e4e0 tx=0x7f0f7c02e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d138e3a596f2e570 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.117+0000 7f0f8359e640 1 --2- 172.21.15.134:0/2225454372 >> v2:172.21.15.142:3300/0 conn(0x7f0f8414b620 0x7f0f8414da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:29.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.118+0000 7f0f81d9b640 1 -- 172.21.15.134:0/2225454372 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c02ee20 con 0x7f0f84143330 2024-02-17T14:28:29.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.118+0000 7f0f81d9b640 1 -- 172.21.15.134:0/2225454372 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c032070 con 0x7f0f84143330 2024-02-17T14:28:29.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.119+0000 7f0f88861640 1 -- 172.21.15.134:0/2225454372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f84143330 msgr2=0x7f0f841437c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.119+0000 7f0f88861640 1 --2- 172.21.15.134:0/2225454372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f84143330 0x7f0f841437c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0f8406e4e0 tx=0x7f0f7c02e0f0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.120+0000 7f0f88861640 1 -- 172.21.15.134:0/2225454372 shutdown_connections 2024-02-17T14:28:29.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.120+0000 7f0f88861640 1 --2- 172.21.15.134:0/2225454372 >> v2:172.21.15.142:3300/0 conn(0x7f0f8414b620 0x7f0f8414da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.120+0000 7f0f88861640 1 --2- 172.21.15.134:0/2225454372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f84143330 0x7f0f841437c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.120+0000 7f0f88861640 1 -- 172.21.15.134:0/2225454372 >> 172.21.15.134:0/2225454372 conn(0x7f0f840b4b60 msgr2=0x7f0f840b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.120+0000 7f0f88861640 1 -- 172.21.15.134:0/2225454372 shutdown_connections 2024-02-17T14:28:29.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.120+0000 7f0f88861640 1 -- 172.21.15.134:0/2225454372 wait complete. 2024-02-17T14:28:29.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.122+0000 7f0f88861640 1 Processor -- start 2024-02-17T14:28:29.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.122+0000 7f0f88861640 1 -- start start 2024-02-17T14:28:29.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.123+0000 7f0f88861640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f84099d00 0x7f0f8406fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.123+0000 7f0f88861640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f84143330 0x7f0f841e9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.124+0000 7f0f82d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f84099d00 0x7f0f8406fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.124+0000 7f0f82d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f84099d00 0x7f0f8406fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46376/0 (socket says 172.21.15.134:46376) 2024-02-17T14:28:29.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.124+0000 7f0f82d9d640 1 -- 172.21.15.134:0/1017363487 learned_addr learned my addr 172.21.15.134:0/1017363487 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:29.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.124+0000 7f0f88861640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8414b620 0x7f0f84071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.125+0000 7f0f88861640 1 -- 172.21.15.134:0/1017363487 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f84141210 con 0x7f0f84099d00 2024-02-17T14:28:29.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.125+0000 7f0f8259c640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f84143330 0x7f0f841e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.125+0000 7f0f88861640 1 -- 172.21.15.134:0/1017363487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f84070bd0 con 0x7f0f84143330 2024-02-17T14:28:29.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.125+0000 7f0f88861640 1 -- 172.21.15.134:0/1017363487 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f84144480 con 0x7f0f8414b620 2024-02-17T14:28:29.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.126+0000 7f0f8259c640 1 -- 172.21.15.134:0/1017363487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8414b620 msgr2=0x7f0f84071bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-17T14:28:29.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.126+0000 7f0f8259c640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8414b620 0x7f0f84071bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.126+0000 7f0f8259c640 1 -- 172.21.15.134:0/1017363487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f84099d00 msgr2=0x7f0f8406fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.126+0000 7f0f8259c640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f84099d00 0x7f0f8406fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.126+0000 7f0f8259c640 1 -- 172.21.15.134:0/1017363487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c00d050 con 0x7f0f84143330 2024-02-17T14:28:29.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.126+0000 7f0f82d9d640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f84099d00 0x7f0f8406fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:29.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.127+0000 7f0f8259c640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f84143330 0x7f0f841e9080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c036000 tx=0x7f0f7c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.127+0000 7f0f6b7fe640 1 -- 172.21.15.134:0/1017363487 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c007ca0 con 0x7f0f84143330 2024-02-17T14:28:29.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.127+0000 7f0f88861640 1 -- 172.21.15.134:0/1017363487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f84071220 con 0x7f0f84143330 2024-02-17T14:28:29.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.127+0000 7f0f88861640 1 -- 172.21.15.134:0/1017363487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f841e95c0 con 0x7f0f84143330 2024-02-17T14:28:29.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.127+0000 7f0f6b7fe640 1 -- 172.21.15.134:0/1017363487 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c007e00 con 0x7f0f84143330 2024-02-17T14:28:29.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.128+0000 7f0f6b7fe640 1 -- 172.21.15.134:0/1017363487 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c004260 con 0x7f0f84143330 2024-02-17T14:28:29.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.129+0000 7f0f88861640 1 -- 172.21.15.134:0/1017363487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f70005290 con 0x7f0f84143330 2024-02-17T14:28:29.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.131+0000 7f0f6b7fe640 1 -- 172.21.15.134:0/1017363487 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0f7c038400 con 0x7f0f84143330 2024-02-17T14:28:29.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.131+0000 7f0f6b7fe640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0f6c06ba30 0x7f0f6c06def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.131+0000 7f0f6b7fe640 1 -- 172.21.15.134:0/1017363487 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0f7c0aca10 con 0x7f0f84143330 2024-02-17T14:28:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.132+0000 7f0f82d9d640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0f6c06ba30 0x7f0f6c06def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.132+0000 7f0f82d9d640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0f6c06ba30 0x7f0f6c06def0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0f74000f60 tx=0x7f0f74009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.135+0000 7f0f6b7fe640 1 -- 172.21.15.134:0/1017363487 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0f7c077210 con 0x7f0f84143330 2024-02-17T14:28:29.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.169+0000 7f01621ec640 1 Processor -- start 2024-02-17T14:28:29.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.170+0000 7f01621ec640 1 -- start start 2024-02-17T14:28:29.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.170+0000 7ff85e16e640 1 Processor -- start 2024-02-17T14:28:29.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7ff85e16e640 1 -- start start 2024-02-17T14:28:29.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7f86f4481640 1 Processor -- start 2024-02-17T14:28:29.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7f86f4481640 1 -- start start 2024-02-17T14:28:29.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7ff85e16e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff858143330 0x7ff8581437c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7ff85e16e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff85814b620 0x7ff85814da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7ff85e16e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85809a0e0 con 0x7ff858099d00 2024-02-17T14:28:29.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7ff85e16e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8580ae080 con 0x7ff858143330 2024-02-17T14:28:29.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7ff85e16e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580ade10 con 0x7ff85814b620 2024-02-17T14:28:29.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7f01621ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01540365a0 0x7f01540359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7f01621ec640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f01540c85c0 0x7f01540c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7f01621ec640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0154036a20 con 0x7f0154035600 2024-02-17T14:28:29.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7f01621ec640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01540363e0 con 0x7f01540c85c0 2024-02-17T14:28:29.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7f01621ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0154035f20 con 0x7f01540365a0 2024-02-17T14:28:29.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7f01611ea640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0154035600 0x7f01540337d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51148/0 (socket says 172.21.15.134:51148) 2024-02-17T14:28:29.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7f01611ea640 1 -- 172.21.15.134:0/1797284275 learned_addr learned my addr 172.21.15.134:0/1797284275 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:29.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.171+0000 7f01609e9640 1 --2- 172.21.15.134:0/1797284275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01540365a0 0x7f01540359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7f0153fff640 1 -- 172.21.15.134:0/1797284275 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222552594 0 0) 0x7f0154036a20 con 0x7f0154035600 2024-02-17T14:28:29.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7ff85d16c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff858099d00 0x7ff85809a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:41760/0 (socket says 172.21.15.134:41760) 2024-02-17T14:28:29.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7f0153fff640 1 -- 172.21.15.134:0/1797284275 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0148003520 con 0x7f0154035600 2024-02-17T14:28:29.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7ff85d16c640 1 -- 172.21.15.134:0/4003672967 learned_addr learned my addr 172.21.15.134:0/4003672967 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:29.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7ff85c96b640 1 --2- 172.21.15.134:0/4003672967 >> v2:172.21.15.142:3300/0 conn(0x7ff858143330 0x7ff8581437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7f6f9af17640 1 Processor -- start 2024-02-17T14:28:29.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7f86f221d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f86e40369f0 0x7f86e4035950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51164/0 (socket says 172.21.15.134:51164) 2024-02-17T14:28:29.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7ff84ffff640 1 -- 172.21.15.134:0/4003672967 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100916147 0 0) 0x7ff85809a0e0 con 0x7ff858099d00 2024-02-17T14:28:29.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7ff84ffff640 1 -- 172.21.15.134:0/4003672967 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff844003440 con 0x7ff858099d00 2024-02-17T14:28:29.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.173+0000 7f66cfda1640 1 Processor -- start 2024-02-17T14:28:29.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.173+0000 7f6f9af17640 1 -- start start 2024-02-17T14:28:29.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7f86f221d640 1 -- 172.21.15.134:0/3954550495 learned_addr learned my addr 172.21.15.134:0/3954550495 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:29.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.173+0000 7f86f4481640 1 --2- 172.21.15.134:0/3954550495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e40ca6c0 0x7f86e40cab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.173+0000 7f86f4481640 1 -- 172.21.15.134:0/3954550495 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e40d0ce0 con 0x7f86e40369f0 2024-02-17T14:28:29.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.173+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962914990 0 0) 0x7f86e40d0ce0 con 0x7f86e40369f0 2024-02-17T14:28:29.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.173+0000 7f86f4481640 1 -- 172.21.15.134:0/3954550495 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e4038800 con 0x7f86e4036dd0 2024-02-17T14:28:29.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.173+0000 7f86f4481640 1 -- 172.21.15.134:0/3954550495 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40d0990 con 0x7f86e40ca6c0 2024-02-17T14:28:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f6f9af17640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f940729d0 0x7f6f940b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7f01609e9640 1 -- 172.21.15.134:0/1797284275 >> v2:172.21.15.142:3300/0 conn(0x7f01540c85c0 msgr2=0x7f01540c8a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-17T14:28:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7f01609e9640 1 --2- 172.21.15.134:0/1797284275 >> v2:172.21.15.142:3300/0 conn(0x7f01540c85c0 0x7f01540c8a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7f01609e9640 1 -- 172.21.15.134:0/1797284275 >> v1:172.21.15.134:6789/0 conn(0x7f0154035600 legacy=0x7f01540337d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.172+0000 7f01609e9640 1 -- 172.21.15.134:0/1797284275 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0154029ff0 con 0x7f01540365a0 2024-02-17T14:28:29.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.173+0000 7f66cfda1640 1 -- start start 2024-02-17T14:28:29.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.173+0000 7ff85c96b640 1 -- 172.21.15.134:0/4003672967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff85814b620 msgr2=0x7ff85814da10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-17T14:28:29.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.173+0000 7ff85c96b640 1 --2- 172.21.15.134:0/4003672967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff85814b620 0x7ff85814da10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.173+0000 7ff85c96b640 1 -- 172.21.15.134:0/4003672967 >> v1:172.21.15.142:6789/0 conn(0x7ff858099d00 legacy=0x7ff85809a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.173+0000 7ff85c96b640 1 -- 172.21.15.134:0/4003672967 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580ae860 con 0x7ff858143330 2024-02-17T14:28:29.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f6f9af17640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6f940b3210 0x7f6f94147400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d8003520 con 0x7f86e40369f0 2024-02-17T14:28:29.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f01609e9640 1 --2- 172.21.15.134:0/1797284275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01540365a0 0x7f01540359e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f015c000b60 tx=0x7f015c0a62f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3d4d2a76354672a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f66cfda1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66c809b3c0 0x7f66c80b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f66cfda1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f66c814afa0 0x7f66c81516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f6f9af17640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f940b26c0 con 0x7f6f94147940 2024-02-17T14:28:29.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f6f9af17640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f940b3670 con 0x7f6f940b3210 2024-02-17T14:28:29.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f6f9af17640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94072db0 con 0x7f6f940729d0 2024-02-17T14:28:29.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f66cfda1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c80b7460 con 0x7f66c809a8f0 2024-02-17T14:28:29.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f66cdb3d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f66c809a8f0 0x7f66c8146370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51182/0 (socket says 172.21.15.134:51182) 2024-02-17T14:28:29.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f95fd54b640 1 Processor -- start 2024-02-17T14:28:29.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f0153fff640 1 -- 172.21.15.134:0/1797284275 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158001670 con 0x7f01540365a0 2024-02-17T14:28:29.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f6f99f15640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f940729d0 0x7f6f940b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f6f9a716640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6f94147940 0x7f6f9414a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51180/0 (socket says 172.21.15.134:51180) 2024-02-17T14:28:29.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f66cdb3d640 1 -- 172.21.15.134:0/745945022 learned_addr learned my addr 172.21.15.134:0/745945022 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:29.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f0153fff640 1 -- 172.21.15.134:0/1797284275 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015c0ae440 con 0x7f01540365a0 2024-02-17T14:28:29.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f66cfda1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c809acd0 con 0x7f66c814afa0 2024-02-17T14:28:29.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f66cfda1640 1 -- 172.21.15.134:0/745945022 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c809c4e0 con 0x7f66c809b3c0 2024-02-17T14:28:29.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f86f2a1e640 1 --2- 172.21.15.134:0/3954550495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e40ca6c0 0x7f86e40cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f6f9a716640 1 -- 172.21.15.134:0/2292629142 learned_addr learned my addr 172.21.15.134:0/2292629142 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f6f99714640 1 --2- 172.21.15.134:0/2292629142 >> v2:172.21.15.134:3300/0 conn(0x7f6f940b3210 0x7f6f94147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f66ce33e640 1 --2- 172.21.15.134:0/745945022 >> v2:172.21.15.134:3300/0 conn(0x7f66c814afa0 0x7f66c81516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.185 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7ff85c96b640 1 --2- 172.21.15.134:0/4003672967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff858143330 0x7ff8581437c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff85000f370 tx=0x7ff850030260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76f0a5660634c3bb server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f66ccb3b640 1 -- 172.21.15.134:0/745945022 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606884948 0 0) 0x7f66c80b7460 con 0x7f66c809a8f0 2024-02-17T14:28:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f66cd33c640 1 --2- 172.21.15.134:0/745945022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66c809b3c0 0x7f66c80b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f66ccb3b640 1 -- 172.21.15.134:0/745945022 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66b4003520 con 0x7f66c809a8f0 2024-02-17T14:28:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f6f99f15640 1 -- 172.21.15.134:0/2292629142 >> v2:172.21.15.134:3300/0 conn(0x7f6f940b3210 msgr2=0x7f6f94147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f6f99f15640 1 --2- 172.21.15.134:0/2292629142 >> v2:172.21.15.134:3300/0 conn(0x7f6f940b3210 0x7f6f94147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f6f99f15640 1 -- 172.21.15.134:0/2292629142 >> v1:172.21.15.134:6789/0 conn(0x7f6f94147940 legacy=0x7f6f9414a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f6f99f15640 1 -- 172.21.15.134:0/2292629142 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f940af920 con 0x7f6f940729d0 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3404018293 0 0) 0x7f86d8003520 con 0x7f86e40369f0 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e40ca6c0 msgr2=0x7f86e40cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f121b640 1 --2- 172.21.15.134:0/3954550495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e40ca6c0 0x7f86e40cab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 >> v1:172.21.15.142:6789/0 conn(0x7f86e4036dd0 legacy=0x7f86e40d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40381a0 con 0x7f86e40369f0 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f86e8001670 con 0x7f86e40369f0 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 >> v1:172.21.15.134:6789/0 conn(0x7f86e40369f0 legacy=0x7f86e4035950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f121b640 1 --2- 172.21.15.134:0/3954550495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d80039a0 0x7f86d8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f121b640 1 --2- 172.21.15.134:0/3954550495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e40ca6c0 0x7f86d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f121b640 1 --2- 172.21.15.134:0/3954550495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86d8004d00 0x7f86d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40d0990 con 0x7f86d80039a0 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d800ba60 con 0x7f86d8004d00 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d800bc20 con 0x7f86e40ca6c0 2024-02-17T14:28:29.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f2a1e640 1 --2- 172.21.15.134:0/3954550495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86d8004d00 0x7f86d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f1a1c640 1 --2- 172.21.15.134:0/3954550495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e40ca6c0 0x7f86d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f01621ec640 1 -- 172.21.15.134:0/1797284275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01540365a0 msgr2=0x7f01540359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f01621ec640 1 --2- 172.21.15.134:0/1797284275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01540365a0 0x7f01540359e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f015c000b60 tx=0x7f015c0a62f0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f66ccb3b640 1 -- 172.21.15.134:0/745945022 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1558405867 0 0) 0x7f66b4003520 con 0x7f66c809a8f0 2024-02-17T14:28:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f66cd33c640 1 -- 172.21.15.134:0/745945022 >> v2:172.21.15.134:3300/0 conn(0x7f66c814afa0 msgr2=0x7f66c81516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:29.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f66cd33c640 1 --2- 172.21.15.134:0/745945022 >> v2:172.21.15.134:3300/0 conn(0x7f66c814afa0 0x7f66c81516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f66cd33c640 1 -- 172.21.15.134:0/745945022 >> v1:172.21.15.134:6789/0 conn(0x7f66c809a8f0 legacy=0x7f66c8146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f66cd33c640 1 -- 172.21.15.134:0/745945022 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c809c7c0 con 0x7f66c809b3c0 2024-02-17T14:28:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.174+0000 7f95fd54b640 1 -- start start 2024-02-17T14:28:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f95fd54b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95f806c180 0x7f95f8146400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.176+0000 7f95fd54b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f95f8143c00 0x7f95f814d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.176+0000 7f95fd54b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f80b4570 con 0x7f95f80b40f0 2024-02-17T14:28:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.176+0000 7f95fd54b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f80ad820 con 0x7f95f8143c00 2024-02-17T14:28:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.176+0000 7f95fd54b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f80b3930 con 0x7f95f806c180 2024-02-17T14:28:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.176+0000 7ff84ffff640 1 -- 172.21.15.134:0/4003672967 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85000d2d0 con 0x7ff858143330 2024-02-17T14:28:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.176+0000 7f95f6ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95f806c180 0x7f95f8146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.176+0000 7ff84ffff640 1 -- 172.21.15.134:0/4003672967 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85000d430 con 0x7ff858143330 2024-02-17T14:28:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f2a1e640 1 -- 172.21.15.134:0/3954550495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e40ca6c0 msgr2=0x7f86d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f2a1e640 1 --2- 172.21.15.134:0/3954550495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e40ca6c0 0x7f86d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f2a1e640 1 -- 172.21.15.134:0/3954550495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d80039a0 msgr2=0x7f86d8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f2a1e640 1 --2- 172.21.15.134:0/3954550495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d80039a0 0x7f86d8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.175+0000 7f86f2a1e640 1 -- 172.21.15.134:0/3954550495 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d8003520 con 0x7f86d8004d00 2024-02-17T14:28:29.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.176+0000 7f95f6ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95f806c180 0x7f95f8146400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:41774/0 (socket says 172.21.15.134:41774) 2024-02-17T14:28:29.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.176+0000 7f95f6ffd640 1 -- 172.21.15.134:0/3813450456 learned_addr learned my addr 172.21.15.134:0/3813450456 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:29.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.176+0000 7f95f77fe640 1 --2- 172.21.15.134:0/3813450456 >> v2:172.21.15.134:3300/0 conn(0x7f95f8143c00 0x7f95f814d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.176+0000 7f86f2a1e640 1 --2- 172.21.15.134:0/3954550495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86d8004d00 0x7f86d8005180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f86ec064670 tx=0x7f86d80057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd35284ae4fed5f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f01621ec640 1 -- 172.21.15.134:0/1797284275 shutdown_connections 2024-02-17T14:28:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f66cd33c640 1 --2- 172.21.15.134:0/745945022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66c809b3c0 0x7f66c80b6f20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f66b80097a0 tx=0x7f66b802b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de39cd1cd0ae95d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0ac070 con 0x7f86d8004d00 2024-02-17T14:28:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec062110 con 0x7f86d8004d00 2024-02-17T14:28:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f86f121b640 1 -- 172.21.15.134:0/3954550495 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec062480 con 0x7f86d8004d00 2024-02-17T14:28:29.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f01621ec640 1 --2- 172.21.15.134:0/1797284275 >> v2:172.21.15.142:3300/0 conn(0x7f01540c85c0 0x7f01540c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f01621ec640 1 --2- 172.21.15.134:0/1797284275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01540365a0 0x7f01540359e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f01621ec640 1 -- 172.21.15.134:0/1797284275 >> 172.21.15.134:0/1797284275 conn(0x7f015403a8a0 msgr2=0x7f015403acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f6f99f15640 1 --2- 172.21.15.134:0/2292629142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f940729d0 0x7f6f940b2cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6f840097a0 tx=0x7f6f8402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c08b86ad8e430ca5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.176+0000 7ff84ffff640 1 -- 172.21.15.134:0/4003672967 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85000b960 con 0x7ff858143330 2024-02-17T14:28:29.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f66ccb3b640 1 -- 172.21.15.134:0/745945022 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00019f0 con 0x7f66c809b3c0 2024-02-17T14:28:29.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f66ccb3b640 1 -- 172.21.15.134:0/745945022 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b802e050 con 0x7f66c809b3c0 2024-02-17T14:28:29.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f66ccb3b640 1 -- 172.21.15.134:0/745945022 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8030730 con 0x7f66c809b3c0 2024-02-17T14:28:29.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f95f6ffd640 1 -- 172.21.15.134:0/3813450456 >> v2:172.21.15.134:3300/0 conn(0x7f95f8143c00 msgr2=0x7f95f814d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:29.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f95f6ffd640 1 --2- 172.21.15.134:0/3813450456 >> v2:172.21.15.134:3300/0 conn(0x7f95f8143c00 0x7f95f814d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f95f6ffd640 1 -- 172.21.15.134:0/3813450456 >> v1:172.21.15.142:6789/0 conn(0x7f95f80b40f0 legacy=0x7f95f81434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f95f67fc640 1 -- 172.21.15.134:0/3813450456 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092625092 0 0) 0x7f95e0001110 con 0x7f95f80b40f0 2024-02-17T14:28:29.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f95f6ffd640 1 -- 172.21.15.134:0/3813450456 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f806c560 con 0x7f95f806c180 2024-02-17T14:28:29.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7ff85e16e640 1 -- 172.21.15.134:0/4003672967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff858143330 msgr2=0x7ff8581437c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7ff85e16e640 1 --2- 172.21.15.134:0/4003672967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff858143330 0x7ff8581437c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff85000f370 tx=0x7ff850030260 comp rx=0 tx=0).stop 2024-02-17T14:28:29.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7ff85e16e640 1 -- 172.21.15.134:0/4003672967 shutdown_connections 2024-02-17T14:28:29.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7ff85e16e640 1 --2- 172.21.15.134:0/4003672967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff85814b620 0x7ff85814da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7ff85e16e640 1 --2- 172.21.15.134:0/4003672967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff858143330 0x7ff8581437c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7ff85e16e640 1 -- 172.21.15.134:0/4003672967 >> 172.21.15.134:0/4003672967 conn(0x7ff8580b4b60 msgr2=0x7ff8580b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f86f4481640 1 -- 172.21.15.134:0/3954550495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86d8004d00 msgr2=0x7f86d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f86f4481640 1 --2- 172.21.15.134:0/3954550495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86d8004d00 0x7f86d8005180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f86ec064670 tx=0x7f86d80057f0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f6f98f13640 1 -- 172.21.15.134:0/2292629142 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8402e070 con 0x7f6f940729d0 2024-02-17T14:28:29.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f6f98f13640 1 -- 172.21.15.134:0/2292629142 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f840315a0 con 0x7f6f940729d0 2024-02-17T14:28:29.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.177+0000 7f6f98f13640 1 -- 172.21.15.134:0/2292629142 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84031930 con 0x7f6f940729d0 2024-02-17T14:28:29.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f86f2a1e640 1 -- 172.21.15.134:0/3954550495 reap_dead start 2024-02-17T14:28:29.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f01621ec640 1 -- 172.21.15.134:0/1797284275 shutdown_connections 2024-02-17T14:28:29.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f86f4481640 1 -- 172.21.15.134:0/3954550495 shutdown_connections 2024-02-17T14:28:29.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f86f4481640 1 -- 172.21.15.134:0/3954550495 >> 172.21.15.134:0/3954550495 conn(0x7f86e403ad20 msgr2=0x7f86e403b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f1756b8a640 1 Processor -- start 2024-02-17T14:28:29.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f01621ec640 1 -- 172.21.15.134:0/1797284275 wait complete. 2024-02-17T14:28:29.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f1756b8a640 1 -- start start 2024-02-17T14:28:29.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f86f4481640 1 -- 172.21.15.134:0/3954550495 shutdown_connections 2024-02-17T14:28:29.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f66cfda1640 1 -- 172.21.15.134:0/745945022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66c809b3c0 msgr2=0x7f66c80b6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f66cfda1640 1 --2- 172.21.15.134:0/745945022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66c809b3c0 0x7f66c80b6f20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f66b80097a0 tx=0x7f66b802b710 comp rx=0 tx=0).stop 2024-02-17T14:28:29.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7ff85e16e640 1 -- 172.21.15.134:0/4003672967 shutdown_connections 2024-02-17T14:28:29.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f95f6ffd640 1 --2- 172.21.15.134:0/3813450456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95f806c180 0x7f95f8146400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f95f80b8040 tx=0x7f95e802fd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d7f90d88e00b2b4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f66cfda1640 1 -- 172.21.15.134:0/745945022 shutdown_connections 2024-02-17T14:28:29.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f66cfda1640 1 --2- 172.21.15.134:0/745945022 >> v2:172.21.15.134:3300/0 conn(0x7f66c814afa0 0x7f66c81516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f66cfda1640 1 --2- 172.21.15.134:0/745945022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66c809b3c0 0x7f66c80b6f20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f66cfda1640 1 -- 172.21.15.134:0/745945022 >> 172.21.15.134:0/745945022 conn(0x7f66c80b9020 msgr2=0x7f66c80b9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f66cfda1640 1 -- 172.21.15.134:0/745945022 shutdown_connections 2024-02-17T14:28:29.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f66cfda1640 1 -- 172.21.15.134:0/745945022 wait complete. 2024-02-17T14:28:29.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f6f9af17640 1 -- 172.21.15.134:0/2292629142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f940729d0 msgr2=0x7f6f940b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f6f9af17640 1 --2- 172.21.15.134:0/2292629142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f940729d0 0x7f6f940b2cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6f840097a0 tx=0x7f6f8402b840 comp rx=0 tx=0).stop 2024-02-17T14:28:29.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7f86f4481640 1 -- 172.21.15.134:0/3954550495 wait complete. 2024-02-17T14:28:29.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f6f9af17640 1 -- 172.21.15.134:0/2292629142 shutdown_connections 2024-02-17T14:28:29.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f6f9af17640 1 --2- 172.21.15.134:0/2292629142 >> v2:172.21.15.134:3300/0 conn(0x7f6f940b3210 0x7f6f94147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f6f9af17640 1 --2- 172.21.15.134:0/2292629142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f940729d0 0x7f6f940b2cd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f95f67fc640 1 -- 172.21.15.134:0/3813450456 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8030af0 con 0x7f95f806c180 2024-02-17T14:28:29.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f1756b8a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f17501443f0 0x7f1750144830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f6f9af17640 1 -- 172.21.15.134:0/2292629142 >> 172.21.15.134:0/2292629142 conn(0x7f6f9406b200 msgr2=0x7f6f940b4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f95f67fc640 1 -- 172.21.15.134:0/3813450456 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e8030c50 con 0x7f95f806c180 2024-02-17T14:28:29.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f95f67fc640 1 -- 172.21.15.134:0/3813450456 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8038440 con 0x7f95f806c180 2024-02-17T14:28:29.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f1754926640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f175014a780 0x7f175009aeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:41780/0 (socket says 172.21.15.134:41780) 2024-02-17T14:28:29.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f1754926640 1 -- 172.21.15.134:0/431834642 learned_addr learned my addr 172.21.15.134:0/431834642 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:29.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f01621ec640 1 Processor -- start 2024-02-17T14:28:29.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.179+0000 7f174ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f17501443f0 0x7f1750144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.178+0000 7ff85e16e640 1 -- 172.21.15.134:0/4003672967 wait complete. 2024-02-17T14:28:29.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f1756b8a640 1 -- 172.21.15.134:0/431834642 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175009aa20 con 0x7f175014f830 2024-02-17T14:28:29.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7ff85e16e640 1 Processor -- start 2024-02-17T14:28:29.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f1756b8a640 1 -- 172.21.15.134:0/431834642 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175009c7d0 con 0x7f175014a780 2024-02-17T14:28:29.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f86f4481640 1 Processor -- start 2024-02-17T14:28:29.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f1756b8a640 1 -- 172.21.15.134:0/431834642 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175014b420 con 0x7f17501443f0 2024-02-17T14:28:29.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f6f9af17640 1 -- 172.21.15.134:0/2292629142 shutdown_connections 2024-02-17T14:28:29.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f86f4481640 1 -- start start 2024-02-17T14:28:29.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119952106 0 0) 0x7f175009c7d0 con 0x7f175014a780 2024-02-17T14:28:29.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f173c003520 con 0x7f175014a780 2024-02-17T14:28:29.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793889561 0 0) 0x7f175009aa20 con 0x7f175014f830 2024-02-17T14:28:29.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f173c003840 con 0x7f175014f830 2024-02-17T14:28:29.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f95fd54b640 1 -- 172.21.15.134:0/3813450456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95f806c180 msgr2=0x7f95f8146400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f95fd54b640 1 --2- 172.21.15.134:0/3813450456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95f806c180 0x7f95f8146400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f95f80b8040 tx=0x7f95e802fd40 comp rx=0 tx=0).stop 2024-02-17T14:28:29.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f01621ec640 1 -- start start 2024-02-17T14:28:29.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7ff85e16e640 1 -- start start 2024-02-17T14:28:29.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f6f9af17640 1 -- 172.21.15.134:0/2292629142 wait complete. 2024-02-17T14:28:29.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f95fd54b640 1 -- 172.21.15.134:0/3813450456 shutdown_connections 2024-02-17T14:28:29.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f95fd54b640 1 --2- 172.21.15.134:0/3813450456 >> v2:172.21.15.134:3300/0 conn(0x7f95f8143c00 0x7f95f814d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f95fd54b640 1 --2- 172.21.15.134:0/3813450456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95f806c180 0x7f95f8146400 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f95fd54b640 1 -- 172.21.15.134:0/3813450456 >> 172.21.15.134:0/3813450456 conn(0x7f95f806b500 msgr2=0x7f95f80b8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1087282782 0 0) 0x7f173c003520 con 0x7f175014a780 2024-02-17T14:28:29.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 >> v2:172.21.15.142:3300/0 conn(0x7f17501443f0 msgr2=0x7f1750144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:29.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f174f7fe640 1 --2- 172.21.15.134:0/431834642 >> v2:172.21.15.142:3300/0 conn(0x7f17501443f0 0x7f1750144830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 >> v1:172.21.15.134:6789/0 conn(0x7f175014f830 legacy=0x7f1750151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175014ab60 con 0x7f175014a780 2024-02-17T14:28:29.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f17400019d0 con 0x7f175014a780 2024-02-17T14:28:29.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.180+0000 7f01621ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0154035600 0x7f0154031fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f66cfda1640 1 Processor -- start 2024-02-17T14:28:29.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f01621ec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01540365a0 0x7f015416e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 >> v1:172.21.15.142:6789/0 conn(0x7f175014a780 legacy=0x7f175009aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f174f7fe640 1 --2- 172.21.15.134:0/431834642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f173c003cd0 0x7f173c004110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f174f7fe640 1 --2- 172.21.15.134:0/431834642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f173c0047c0 0x7f173c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f174f7fe640 1 --2- 172.21.15.134:0/431834642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c005350 0x7f173c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175014b420 con 0x7f173c005350 2024-02-17T14:28:29.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c00c260 con 0x7f173c0047c0 2024-02-17T14:28:29.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c00c420 con 0x7f173c003cd0 2024-02-17T14:28:29.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f66cfda1640 1 -- start start 2024-02-17T14:28:29.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f86f4481640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d8004d00 0x7f86e4158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f95fd54b640 1 -- 172.21.15.134:0/3813450456 shutdown_connections 2024-02-17T14:28:29.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f1755127640 1 --2- 172.21.15.134:0/431834642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c005350 0x7f173c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f1754926640 1 --2- 172.21.15.134:0/431834642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f173c003cd0 0x7f173c004110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f86f4481640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e4159ce0 0x7f86e4169790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f86f221d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d8004d00 0x7f86e4158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f86f221d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d8004d00 0x7f86e4158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46438/0 (socket says 172.21.15.134:46438) 2024-02-17T14:28:29.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f86f221d640 1 -- 172.21.15.134:0/4055698633 learned_addr learned my addr 172.21.15.134:0/4055698633 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:29.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f86f4481640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86e4169cd0 0x7f86e4157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f1755127640 1 -- 172.21.15.134:0/431834642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f173c003cd0 msgr2=0x7f173c004110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:29.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f1755127640 1 --2- 172.21.15.134:0/431834642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f173c003cd0 0x7f173c004110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f1755127640 1 -- 172.21.15.134:0/431834642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f173c0047c0 msgr2=0x7f173c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:29.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f1755127640 1 --2- 172.21.15.134:0/431834642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f173c0047c0 0x7f173c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f1755127640 1 -- 172.21.15.134:0/431834642 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175014ab60 con 0x7f173c005350 2024-02-17T14:28:29.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66cfda1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66c809a8f0 0x7f66c81e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66cfda1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66c809b3c0 0x7f66c81e1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66cfda1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66c814afa0 0x7f66c81e3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66cfda1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80b2ad0 con 0x7f66c809b3c0 2024-02-17T14:28:29.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66cfda1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80b2fc0 con 0x7f66c809a8f0 2024-02-17T14:28:29.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66cfda1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80b1610 con 0x7f66c814afa0 2024-02-17T14:28:29.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f86f1a1c640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e4159ce0 0x7f86e4169790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f86f4481640 1 -- 172.21.15.134:0/4055698633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4159020 con 0x7f86d8004d00 2024-02-17T14:28:29.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f86f4481640 1 -- 172.21.15.134:0/4055698633 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4169020 con 0x7f86e4169cd0 2024-02-17T14:28:29.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f95fd54b640 1 -- 172.21.15.134:0/3813450456 wait complete. 2024-02-17T14:28:29.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f86f4481640 1 -- 172.21.15.134:0/4055698633 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4169300 con 0x7f86e4159ce0 2024-02-17T14:28:29.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66ce33e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66c814afa0 0x7f66c81e3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66ce33e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66c814afa0 0x7f66c81e3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:41558/0 (socket says 172.21.15.134:41558) 2024-02-17T14:28:29.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f6f9af17640 1 Processor -- start 2024-02-17T14:28:29.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66ce33e640 1 -- 172.21.15.134:0/283549290 learned_addr learned my addr 172.21.15.134:0/283549290 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:29.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66cdb3d640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66c809a8f0 0x7f66c81e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f6f9af17640 1 -- start start 2024-02-17T14:28:29.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66cd33c640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66c809b3c0 0x7f66c81e1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66ce33e640 1 -- 172.21.15.134:0/283549290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66c809a8f0 msgr2=0x7f66c81e0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66ce33e640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66c809a8f0 0x7f66c81e0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66ce33e640 1 -- 172.21.15.134:0/283549290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66c809b3c0 msgr2=0x7f66c81e1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66ce33e640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66c809b3c0 0x7f66c81e1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f86f2a1e640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86e4169cd0 0x7f86e4157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66ce33e640 1 -- 172.21.15.134:0/283549290 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b8009400 con 0x7f66c814afa0 2024-02-17T14:28:29.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f66cd33c640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66c809b3c0 0x7f66c81e1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:29.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f86f221d640 1 -- 172.21.15.134:0/4055698633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e4159ce0 msgr2=0x7f86e4169790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f1755127640 1 -- 172.21.15.134:0/431834642 reap_dead start 2024-02-17T14:28:29.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f66ce33e640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66c814afa0 0x7f66c81e3e40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f66c400e820 tx=0x7f66c400ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f1755127640 1 --2- 172.21.15.134:0/431834642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c005350 0x7f173c00b980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1748001840 tx=0x7f173c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fff0260fdf01e93 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f01621ec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01540c85c0 0x7f015416eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f01609e9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01540365a0 0x7f015416e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f01621ec640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015416f1f0 con 0x7f01540365a0 2024-02-17T14:28:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f01621ec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015416f4d0 con 0x7f01540c85c0 2024-02-17T14:28:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f01621ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015402d650 con 0x7f0154035600 2024-02-17T14:28:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f01609e9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01540365a0 0x7f015416e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46412/0 (socket says 172.21.15.134:46412) 2024-02-17T14:28:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f01609e9640 1 -- 172.21.15.134:0/330303966 learned_addr learned my addr 172.21.15.134:0/330303966 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f01619eb640 1 --2- 172.21.15.134:0/330303966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01540c85c0 0x7f015416eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.181+0000 7f01611ea640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0154035600 0x7f0154031fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f86f221d640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e4159ce0 0x7f86e4169790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f86f221d640 1 -- 172.21.15.134:0/4055698633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86e4169cd0 msgr2=0x7f86e4157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f86f221d640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86e4169cd0 0x7f86e4157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f86f221d640 1 -- 172.21.15.134:0/4055698633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40cc720 con 0x7f86d8004d00 2024-02-17T14:28:29.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f86f1a1c640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e4159ce0 0x7f86e4169790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:29.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f01609e9640 1 -- 172.21.15.134:0/330303966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0154035600 msgr2=0x7f0154031fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f01609e9640 1 --2- 172.21.15.134:0/330303966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0154035600 0x7f0154031fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f01609e9640 1 -- 172.21.15.134:0/330303966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01540c85c0 msgr2=0x7f015416eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f01609e9640 1 --2- 172.21.15.134:0/330303966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01540c85c0 0x7f015416eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f01609e9640 1 -- 172.21.15.134:0/330303966 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c068f10 con 0x7f01540365a0 2024-02-17T14:28:29.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748033630 con 0x7f173c005350 2024-02-17T14:28:29.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1748033790 con 0x7f173c005350 2024-02-17T14:28:29.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7ff85e16e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff858099d00 0x7ff85809c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f01609e9640 1 --2- 172.21.15.134:0/330303966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01540365a0 0x7f015416e640 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f015c068220 tx=0x7f015c0689a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7ff85e16e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff858143330 0x7ff85806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7ff85e16e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff85814b620 0x7ff8580719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7ff85d16c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff858099d00 0x7ff85809c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7ff85d16c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff858099d00 0x7ff85809c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:41852/0 (socket says 172.21.15.134:41852) 2024-02-17T14:28:29.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7ff85d16c640 1 -- 172.21.15.134:0/3993245420 learned_addr learned my addr 172.21.15.134:0/3993245420 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:29.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7ff85e16e640 1 -- 172.21.15.134:0/3993245420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff858071f20 con 0x7ff85814b620 2024-02-17T14:28:29.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7ff85e16e640 1 -- 172.21.15.134:0/3993245420 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff858071550 con 0x7ff858099d00 2024-02-17T14:28:29.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7ff85e16e640 1 -- 172.21.15.134:0/3993245420 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580b05f0 con 0x7ff858143330 2024-02-17T14:28:29.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.182+0000 7f95fd54b640 1 Processor -- start 2024-02-17T14:28:29.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f95fd54b640 1 -- start start 2024-02-17T14:28:29.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f95fd54b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95f806c180 0x7f95f8071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f95fd54b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f80b40f0 0x7f95f80b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f95fd54b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95f80b0440 0x7f95f81db780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f95f6ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95f806c180 0x7f95f8071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f95fd54b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80b1760 con 0x7f95f80b40f0 2024-02-17T14:28:29.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f95fd54b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8120680 con 0x7f95f80b0440 2024-02-17T14:28:29.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f95fd54b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80b0ac0 con 0x7f95f806c180 2024-02-17T14:28:29.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7ff85d96d640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff85814b620 0x7ff8580719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f66be7fc640 1 -- 172.21.15.134:0/283549290 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4009460 con 0x7f66c814afa0 2024-02-17T14:28:29.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f66be7fc640 1 -- 172.21.15.134:0/283549290 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c400c730 con 0x7f66c814afa0 2024-02-17T14:28:29.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f66be7fc640 1 -- 172.21.15.134:0/283549290 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400cac0 con 0x7f66c814afa0 2024-02-17T14:28:29.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f66cfda1640 1 -- 172.21.15.134:0/283549290 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c80a0520 con 0x7f66c814afa0 2024-02-17T14:28:29.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f66cfda1640 1 -- 172.21.15.134:0/283549290 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c809f3e0 con 0x7f66c814afa0 2024-02-17T14:28:29.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f6f9af17640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f940729d0 0x7f6f941e4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f6f9af17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f940b3210 0x7f6f940b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f6f99f15640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f940729d0 0x7f6f941e4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f6f9af17640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f94147940 0x7f6f940b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f6f99f15640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f940729d0 0x7f6f941e4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:41840/0 (socket says 172.21.15.134:41840) 2024-02-17T14:28:29.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f6f99f15640 1 -- 172.21.15.134:0/2154832222 learned_addr learned my addr 172.21.15.134:0/2154832222 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:29.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f6f9af17640 1 -- 172.21.15.134:0/2154832222 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94141430 con 0x7f6f940b3210 2024-02-17T14:28:29.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f6f9af17640 1 -- 172.21.15.134:0/2154832222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9413e9f0 con 0x7f6f940729d0 2024-02-17T14:28:29.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.183+0000 7f6f9af17640 1 -- 172.21.15.134:0/2154832222 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940b6180 con 0x7f6f94147940 2024-02-17T14:28:29.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f6f9a716640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f94147940 0x7f6f940b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f6f99f15640 1 -- 172.21.15.134:0/2154832222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f94147940 msgr2=0x7f6f940b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f6f99f15640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f94147940 0x7f6f940b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f6f99f15640 1 -- 172.21.15.134:0/2154832222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f940b3210 msgr2=0x7f6f940b8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f6f99f15640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f940b3210 0x7f6f940b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f6f99f15640 1 -- 172.21.15.134:0/2154832222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f84009400 con 0x7f6f940729d0 2024-02-17T14:28:29.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f6f9a716640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f94147940 0x7f6f940b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:29.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f0151ffb640 1 -- 172.21.15.134:0/330303966 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c0ade60 con 0x7f01540365a0 2024-02-17T14:28:29.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f0151ffb640 1 -- 172.21.15.134:0/330303966 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015c0ba450 con 0x7f01540365a0 2024-02-17T14:28:29.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f0151ffb640 1 -- 172.21.15.134:0/330303966 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c0ba840 con 0x7f01540365a0 2024-02-17T14:28:29.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7ff85c96b640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff858143330 0x7ff85806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f66cfda1640 1 -- 172.21.15.134:0/283549290 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b0005290 con 0x7f66c814afa0 2024-02-17T14:28:29.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7ff85d96d640 1 -- 172.21.15.134:0/3993245420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff858143330 msgr2=0x7ff85806efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7ff85d96d640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff858143330 0x7ff85806efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7ff85d96d640 1 -- 172.21.15.134:0/3993245420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff858099d00 msgr2=0x7ff85809c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7ff85d96d640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff858099d00 0x7ff85809c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7ff85d96d640 1 -- 172.21.15.134:0/3993245420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85000f050 con 0x7ff85814b620 2024-02-17T14:28:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f6f99f15640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f940729d0 0x7f6f941e4a20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6f84034040 tx=0x7f6f840046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f01621ec640 1 -- 172.21.15.134:0/330303966 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0154030440 con 0x7f01540365a0 2024-02-17T14:28:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f01621ec640 1 -- 172.21.15.134:0/330303966 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0154032500 con 0x7f01540365a0 2024-02-17T14:28:29.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f95f77fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95f80b0440 0x7f95f81db780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f95f6ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95f806c180 0x7f95f8071a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:41576/0 (socket says 172.21.15.134:41576) 2024-02-17T14:28:29.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f95f6ffd640 1 -- 172.21.15.134:0/3131578970 learned_addr learned my addr 172.21.15.134:0/3131578970 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:29.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f86f221d640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d8004d00 0x7f86e4158ae0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c6b0 tx=0x7f86e800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f95f6ffd640 1 -- 172.21.15.134:0/3131578970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95f80b0440 msgr2=0x7f95f81db780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f95f6ffd640 1 --2- 172.21.15.134:0/3131578970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95f80b0440 0x7f95f81db780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f95f6ffd640 1 -- 172.21.15.134:0/3131578970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f80b40f0 msgr2=0x7f95f80b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f95f6ffd640 1 --2- 172.21.15.134:0/3131578970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f80b40f0 0x7f95f80b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f95f6ffd640 1 -- 172.21.15.134:0/3131578970 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e80094d0 con 0x7f95f806c180 2024-02-17T14:28:29.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.184+0000 7f174f7fe640 1 -- 172.21.15.134:0/431834642 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748033630 con 0x7f173c005350 2024-02-17T14:28:29.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f95f6ffd640 1 --2- 172.21.15.134:0/3131578970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95f806c180 0x7f95f8071a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f95e8030350 tx=0x7f95e80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f1756b8a640 1 -- 172.21.15.134:0/431834642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c005350 msgr2=0x7f173c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f1756b8a640 1 --2- 172.21.15.134:0/431834642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c005350 0x7f173c00b980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1748001840 tx=0x7f173c0057f0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f1756b8a640 1 -- 172.21.15.134:0/431834642 shutdown_connections 2024-02-17T14:28:29.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f1756b8a640 1 --2- 172.21.15.134:0/431834642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c005350 0x7f173c00b980 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f1756b8a640 1 -- 172.21.15.134:0/431834642 >> 172.21.15.134:0/431834642 conn(0x7f17500b90c0 msgr2=0x7f17500b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f1756b8a640 1 -- 172.21.15.134:0/431834642 shutdown_connections 2024-02-17T14:28:29.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f1756b8a640 1 -- 172.21.15.134:0/431834642 wait complete. 2024-02-17T14:28:29.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f95effff640 1 -- 172.21.15.134:0/3131578970 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e80133e0 con 0x7f95f806c180 2024-02-17T14:28:29.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.186+0000 7f01621ec640 1 -- 172.21.15.134:0/330303966 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0154038050 con 0x7f01540365a0 2024-02-17T14:28:29.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f6f8a7fc640 1 -- 172.21.15.134:0/2154832222 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84032840 con 0x7f6f940729d0 2024-02-17T14:28:29.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f6f8a7fc640 1 -- 172.21.15.134:0/2154832222 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f84031f00 con 0x7f6f940729d0 2024-02-17T14:28:29.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f6f8a7fc640 1 -- 172.21.15.134:0/2154832222 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84032be0 con 0x7f6f940729d0 2024-02-17T14:28:29.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.186+0000 7f6f9af17640 1 -- 172.21.15.134:0/2154832222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f94141620 con 0x7f6f940729d0 2024-02-17T14:28:29.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.186+0000 7f6f9af17640 1 -- 172.21.15.134:0/2154832222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f941e4500 con 0x7f6f940729d0 2024-02-17T14:28:29.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.186+0000 7ff85d96d640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff85814b620 0x7ff8580719e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff85400b410 tx=0x7ff85400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.186+0000 7f66be7fc640 1 -- 172.21.15.134:0/283549290 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f66c400cc20 con 0x7f66c814afa0 2024-02-17T14:28:29.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.186+0000 7f66be7fc640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f66ac06b840 0x7f66ac06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.187+0000 7f66be7fc640 1 -- 172.21.15.134:0/283549290 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f66c408a310 con 0x7f66c814afa0 2024-02-17T14:28:29.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f95fd54b640 1 -- 172.21.15.134:0/3131578970 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f80b0da0 con 0x7f95f806c180 2024-02-17T14:28:29.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.185+0000 7f95fd54b640 1 -- 172.21.15.134:0/3131578970 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f81dbcc0 con 0x7f95f806c180 2024-02-17T14:28:29.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.186+0000 7f95effff640 1 -- 172.21.15.134:0/3131578970 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e8013070 con 0x7f95f806c180 2024-02-17T14:28:29.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.187+0000 7f95effff640 1 -- 172.21.15.134:0/3131578970 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800f470 con 0x7f95f806c180 2024-02-17T14:28:29.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.187+0000 7f66cdb3d640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f66ac06b840 0x7f66ac06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.187+0000 7f95fd54b640 1 -- 172.21.15.134:0/3131578970 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95dc005290 con 0x7f95f806c180 2024-02-17T14:28:29.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.187+0000 7f86e2ffd640 1 -- 172.21.15.134:0/4055698633 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80072d0 con 0x7f86d8004d00 2024-02-17T14:28:29.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.187+0000 7f86e2ffd640 1 -- 172.21.15.134:0/4055698633 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e8007450 con 0x7f86d8004d00 2024-02-17T14:28:29.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.187+0000 7f86e2ffd640 1 -- 172.21.15.134:0/4055698633 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80047e0 con 0x7f86d8004d00 2024-02-17T14:28:29.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.188+0000 7ff84dffb640 1 -- 172.21.15.134:0/3993245420 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854011830 con 0x7ff85814b620 2024-02-17T14:28:29.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.188+0000 7f66cdb3d640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f66ac06b840 0x7f66ac06dd00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f66c0002230 tx=0x7f66c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.188+0000 7f6f8a7fc640 1 -- 172.21.15.134:0/2154832222 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6f84032d40 con 0x7f6f940729d0 2024-02-17T14:28:29.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.188+0000 7f6f9af17640 1 -- 172.21.15.134:0/2154832222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f940ac840 con 0x7f6f940729d0 2024-02-17T14:28:29.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.188+0000 7f6f8a7fc640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6f7806b8e0 0x7f6f7806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.189+0000 7f1756b8a640 1 Processor -- start 2024-02-17T14:28:29.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.189+0000 7f6f8a7fc640 1 -- 172.21.15.134:0/2154832222 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6f840bd3c0 con 0x7f6f940729d0 2024-02-17T14:28:29.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.188+0000 7ff85e16e640 1 -- 172.21.15.134:0/3993245420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff858071220 con 0x7ff85814b620 2024-02-17T14:28:29.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.188+0000 7ff85e16e640 1 -- 172.21.15.134:0/3993245420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85806f650 con 0x7ff85814b620 2024-02-17T14:28:29.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.188+0000 7ff84dffb640 1 -- 172.21.15.134:0/3993245420 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8540119b0 con 0x7ff85814b620 2024-02-17T14:28:29.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.189+0000 7ff84dffb640 1 -- 172.21.15.134:0/3993245420 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854011d60 con 0x7ff85814b620 2024-02-17T14:28:29.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.189+0000 7f1756b8a640 1 -- start start 2024-02-17T14:28:29.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.188+0000 7f95effff640 1 -- 172.21.15.134:0/3131578970 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f95e803f070 con 0x7f95f806c180 2024-02-17T14:28:29.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.189+0000 7ff85e16e640 1 -- 172.21.15.134:0/3993245420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff838005290 con 0x7ff85814b620 2024-02-17T14:28:29.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.190+0000 7f86f4481640 1 -- 172.21.15.134:0/4055698633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e415a1c0 con 0x7f86d8004d00 2024-02-17T14:28:29.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.189+0000 7f95effff640 1 --2- 172.21.15.134:0/3131578970 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f95d806b910 0x7f95d806ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.189+0000 7f95ee7fc640 1 --2- 172.21.15.134:0/3131578970 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f95d806b910 0x7f95d806ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.190+0000 7f95effff640 1 -- 172.21.15.134:0/3131578970 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f95e80abab0 con 0x7f95f806c180 2024-02-17T14:28:29.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.190+0000 7f95ee7fc640 1 --2- 172.21.15.134:0/3131578970 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f95d806b910 0x7f95d806ddd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f95e0000f60 tx=0x7f95e00077c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.190+0000 7f0151ffb640 1 -- 172.21.15.134:0/330303966 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f015c0ae670 con 0x7f01540365a0 2024-02-17T14:28:29.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.190+0000 7f86f4481640 1 -- 172.21.15.134:0/4055698633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e4156a70 con 0x7f86d8004d00 2024-02-17T14:28:29.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.190+0000 7f1756b8a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c005350 0x7f175013eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.190+0000 7f0151ffb640 1 --2- 172.21.15.134:0/330303966 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f014006b8e0 0x7f014006dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.190+0000 7f1756b8a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17500b57f0 0x7f1750145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.190+0000 7f1756b8a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17500b5eb0 0x7f175013b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.190+0000 7f0151ffb640 1 -- 172.21.15.134:0/330303966 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f015c1271e0 con 0x7f01540365a0 2024-02-17T14:28:29.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.190+0000 7f1756b8a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17501450b0 con 0x7f173c005350 2024-02-17T14:28:29.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.189+0000 7f6f99714640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6f7806b8e0 0x7f6f7806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.190+0000 7f6f99714640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6f7806b8e0 0x7f6f7806dda0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6f90006a90 tx=0x7f6f90006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f1756b8a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175013c5a0 con 0x7f17500b57f0 2024-02-17T14:28:29.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f1756b8a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17500b4d10 con 0x7f17500b5eb0 2024-02-17T14:28:29.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f01611ea640 1 --2- 172.21.15.134:0/330303966 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f014006b8e0 0x7f014006dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f174ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17500b57f0 0x7f1750145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f174ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17500b57f0 0x7f1750145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:41858/0 (socket says 172.21.15.134:41858) 2024-02-17T14:28:29.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f1755127640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17500b5eb0 0x7f175013b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f174ffff640 1 -- 172.21.15.134:0/102610007 learned_addr learned my addr 172.21.15.134:0/102610007 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:29.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f1754926640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c005350 0x7f175013eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f66be7fc640 1 -- 172.21.15.134:0/283549290 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f66c4054a00 con 0x7f66c814afa0 2024-02-17T14:28:29.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f86f4481640 1 -- 172.21.15.134:0/4055698633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e40379b0 con 0x7f86d8004d00 2024-02-17T14:28:29.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f01611ea640 1 --2- 172.21.15.134:0/330303966 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f014006b8e0 0x7f014006dda0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f01580010e0 tx=0x7f0158009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f174ffff640 1 -- 172.21.15.134:0/102610007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17500b5eb0 msgr2=0x7f175013b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f174ffff640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17500b5eb0 0x7f175013b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.191+0000 7f174ffff640 1 -- 172.21.15.134:0/102610007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c005350 msgr2=0x7f175013eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.192+0000 7f174ffff640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c005350 0x7f175013eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.192+0000 7f174ffff640 1 -- 172.21.15.134:0/102610007 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17500b4ff0 con 0x7f17500b57f0 2024-02-17T14:28:29.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.192+0000 7f1754926640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c005350 0x7f175013eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:29.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.192+0000 7f174ffff640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17500b57f0 0x7f1750145540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f173800e7a0 tx=0x7f173800ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.193+0000 7f174d7fa640 1 -- 172.21.15.134:0/102610007 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173800eeb0 con 0x7f17500b57f0 2024-02-17T14:28:29.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.193+0000 7f174d7fa640 1 -- 172.21.15.134:0/102610007 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173800c940 con 0x7f17500b57f0 2024-02-17T14:28:29.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.193+0000 7f174d7fa640 1 -- 172.21.15.134:0/102610007 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173800cd10 con 0x7f17500b57f0 2024-02-17T14:28:29.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.193+0000 7f1756b8a640 1 -- 172.21.15.134:0/102610007 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17500b52d0 con 0x7f17500b57f0 2024-02-17T14:28:29.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.194+0000 7f1756b8a640 1 -- 172.21.15.134:0/102610007 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17500b6340 con 0x7f17500b57f0 2024-02-17T14:28:29.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.194+0000 7f6f8a7fc640 1 -- 172.21.15.134:0/2154832222 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6f84087b10 con 0x7f6f940729d0 2024-02-17T14:28:29.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.195+0000 7f0151ffb640 1 -- 172.21.15.134:0/330303966 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f015c0f1930 con 0x7f01540365a0 2024-02-17T14:28:29.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.197+0000 7f1756b8a640 1 -- 172.21.15.134:0/102610007 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1750068280 con 0x7f17500b57f0 2024-02-17T14:28:29.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.197+0000 7f174d7fa640 1 -- 172.21.15.134:0/102610007 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1738013470 con 0x7f17500b57f0 2024-02-17T14:28:29.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.197+0000 7f174d7fa640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f173006b810 0x7f173006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.198+0000 7f174d7fa640 1 -- 172.21.15.134:0/102610007 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f173808a570 con 0x7f17500b57f0 2024-02-17T14:28:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.196+0000 7f95effff640 1 -- 172.21.15.134:0/3131578970 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f95e80763d0 con 0x7f95f806c180 2024-02-17T14:28:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.197+0000 7ff84dffb640 1 -- 172.21.15.134:0/3993245420 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff85401a400 con 0x7ff85814b620 2024-02-17T14:28:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.197+0000 7ff84dffb640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff83c06b910 0x7ff83c06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.198+0000 7ff84dffb640 1 -- 172.21.15.134:0/3993245420 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff85408aa60 con 0x7ff85814b620 2024-02-17T14:28:29.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.198+0000 7ff85d16c640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff83c06b910 0x7ff83c06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.198+0000 7f86e2ffd640 1 -- 172.21.15.134:0/4055698633 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f86e800a5e0 con 0x7f86d8004d00 2024-02-17T14:28:29.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.198+0000 7f86e2ffd640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f86d006b910 0x7f86d006ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.198+0000 7f86e2ffd640 1 -- 172.21.15.134:0/4055698633 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f86e808a0d0 con 0x7f86d8004d00 2024-02-17T14:28:29.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.199+0000 7f1754926640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f173006b810 0x7f173006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.199+0000 7ff85d16c640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff83c06b910 0x7ff83c06ddd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff848000f60 tx=0x7ff848005f20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.199+0000 7f86f1a1c640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f86d006b910 0x7f86d006ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.199+0000 7f1754926640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f173006b810 0x7f173006dcd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f17400013d0 tx=0x7f1740009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.200+0000 7f86f1a1c640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f86d006b910 0x7f86d006ddd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f86e41575a0 tx=0x7f86dc007b70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.202+0000 7f174d7fa640 1 -- 172.21.15.134:0/102610007 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1738054cf0 con 0x7f17500b57f0 2024-02-17T14:28:29.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.202+0000 7ff84dffb640 1 -- 172.21.15.134:0/3993245420 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff8540551b0 con 0x7ff85814b620 2024-02-17T14:28:29.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.211+0000 7f86e2ffd640 1 -- 172.21.15.134:0/4055698633 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f86e8054820 con 0x7f86d8004d00 2024-02-17T14:28:29.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.527+0000 7f0f88861640 1 -- 172.21.15.134:0/1017363487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0f70005810 con 0x7f0f84143330 2024-02-17T14:28:29.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.527+0000 7f0f6b7fe640 1 -- 172.21.15.134:0/1017363487 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f7c047020 con 0x7f0f84143330 2024-02-17T14:28:29.527 INFO:teuthology.orchestra.run.smithi134.stdout:55834574856 2024-02-17T14:28:29.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.530+0000 7f0f697fa640 1 -- 172.21.15.134:0/1017363487 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0f6c06ba30 msgr2=0x7f0f6c06def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.530+0000 7f0f697fa640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0f6c06ba30 0x7f0f6c06def0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0f74000f60 tx=0x7f0f74009040 comp rx=0 tx=0).stop 2024-02-17T14:28:29.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.530+0000 7f0f697fa640 1 -- 172.21.15.134:0/1017363487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f84143330 msgr2=0x7f0f841e9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.530+0000 7f0f697fa640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f84143330 0x7f0f841e9080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c036000 tx=0x7f0f7c004a40 comp rx=0 tx=0).stop 2024-02-17T14:28:29.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.531+0000 7f0f697fa640 1 -- 172.21.15.134:0/1017363487 shutdown_connections 2024-02-17T14:28:29.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.531+0000 7f0f697fa640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8414b620 0x7f0f84071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.531+0000 7f0f697fa640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f84143330 0x7f0f841e9080 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.531+0000 7f0f697fa640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0f6c06ba30 0x7f0f6c06def0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.531+0000 7f0f697fa640 1 --2- 172.21.15.134:0/1017363487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f84099d00 0x7f0f8406fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.531+0000 7f0f697fa640 1 -- 172.21.15.134:0/1017363487 >> 172.21.15.134:0/1017363487 conn(0x7f0f840b4b60 msgr2=0x7f0f840b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.531+0000 7f0f697fa640 1 -- 172.21.15.134:0/1017363487 shutdown_connections 2024-02-17T14:28:29.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.531+0000 7f0f697fa640 1 -- 172.21.15.134:0/1017363487 wait complete. 2024-02-17T14:28:29.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.6 2024-02-17T14:28:29.547 DEBUG:teuthology.parallel:result is None 2024-02-17T14:28:29.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.570+0000 7f95fd54b640 1 -- 172.21.15.134:0/3131578970 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f95dc005540 con 0x7f95f806c180 2024-02-17T14:28:29.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.570+0000 7f95effff640 1 -- 172.21.15.134:0/3131578970 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95e8079a90 con 0x7f95f806c180 2024-02-17T14:28:29.570 INFO:teuthology.orchestra.run.smithi134.stdout:55834574857 2024-02-17T14:28:29.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.573+0000 7f95fd54b640 1 -- 172.21.15.134:0/3131578970 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f95d806b910 msgr2=0x7f95d806ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.573+0000 7f95fd54b640 1 --2- 172.21.15.134:0/3131578970 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f95d806b910 0x7f95d806ddd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f95e0000f60 tx=0x7f95e00077c0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.573+0000 7f95fd54b640 1 -- 172.21.15.134:0/3131578970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95f806c180 msgr2=0x7f95f8071a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.573+0000 7f95fd54b640 1 --2- 172.21.15.134:0/3131578970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95f806c180 0x7f95f8071a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f95e8030350 tx=0x7f95e80046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.573+0000 7f95fd54b640 1 -- 172.21.15.134:0/3131578970 shutdown_connections 2024-02-17T14:28:29.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.573+0000 7f95fd54b640 1 --2- 172.21.15.134:0/3131578970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95f80b0440 0x7f95f81db780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.573+0000 7f95fd54b640 1 --2- 172.21.15.134:0/3131578970 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f95d806b910 0x7f95d806ddd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.573+0000 7f95fd54b640 1 --2- 172.21.15.134:0/3131578970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f80b40f0 0x7f95f80b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.573+0000 7f95fd54b640 1 --2- 172.21.15.134:0/3131578970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95f806c180 0x7f95f8071a50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.573+0000 7f95fd54b640 1 -- 172.21.15.134:0/3131578970 >> 172.21.15.134:0/3131578970 conn(0x7f95f806b500 msgr2=0x7f95f80b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.573+0000 7f95fd54b640 1 -- 172.21.15.134:0/3131578970 shutdown_connections 2024-02-17T14:28:29.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.573+0000 7f95fd54b640 1 -- 172.21.15.134:0/3131578970 wait complete. 2024-02-17T14:28:29.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.1 2024-02-17T14:28:29.584 DEBUG:teuthology.parallel:result is None 2024-02-17T14:28:29.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.598+0000 7f01621ec640 1 -- 172.21.15.134:0/330303966 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0154005390 con 0x7f01540365a0 2024-02-17T14:28:29.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.598+0000 7f0151ffb640 1 -- 172.21.15.134:0/330303966 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f015c0f4ff0 con 0x7f01540365a0 2024-02-17T14:28:29.598 INFO:teuthology.orchestra.run.smithi134.stdout:55834574858 2024-02-17T14:28:29.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.598+0000 7f66cfda1640 1 -- 172.21.15.134:0/283549290 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f66b0005540 con 0x7f66c814afa0 2024-02-17T14:28:29.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.599+0000 7f66be7fc640 1 -- 172.21.15.134:0/283549290 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f66c40580c0 con 0x7f66c814afa0 2024-02-17T14:28:29.600 INFO:teuthology.orchestra.run.smithi134.stdout:55834574857 2024-02-17T14:28:29.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.600+0000 7f01621ec640 1 -- 172.21.15.134:0/330303966 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f014006b8e0 msgr2=0x7f014006dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.600+0000 7f01621ec640 1 --2- 172.21.15.134:0/330303966 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f014006b8e0 0x7f014006dda0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f01580010e0 tx=0x7f0158009040 comp rx=0 tx=0).stop 2024-02-17T14:28:29.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.600+0000 7f01621ec640 1 -- 172.21.15.134:0/330303966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01540365a0 msgr2=0x7f015416e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.600+0000 7f01621ec640 1 --2- 172.21.15.134:0/330303966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01540365a0 0x7f015416e640 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f015c068220 tx=0x7f015c0689a0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f01621ec640 1 -- 172.21.15.134:0/330303966 shutdown_connections 2024-02-17T14:28:29.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f01621ec640 1 --2- 172.21.15.134:0/330303966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01540c85c0 0x7f015416eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f01621ec640 1 --2- 172.21.15.134:0/330303966 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f014006b8e0 0x7f014006dda0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f01621ec640 1 --2- 172.21.15.134:0/330303966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01540365a0 0x7f015416e640 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f01621ec640 1 --2- 172.21.15.134:0/330303966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0154035600 0x7f0154031fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f01621ec640 1 -- 172.21.15.134:0/330303966 >> 172.21.15.134:0/330303966 conn(0x7f015403a8a0 msgr2=0x7f0154006640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f01621ec640 1 -- 172.21.15.134:0/330303966 shutdown_connections 2024-02-17T14:28:29.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f01621ec640 1 -- 172.21.15.134:0/330303966 wait complete. 2024-02-17T14:28:29.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f66cfda1640 1 -- 172.21.15.134:0/283549290 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f66ac06b840 msgr2=0x7f66ac06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f66cfda1640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f66ac06b840 0x7f66ac06dd00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f66c0002230 tx=0x7f66c0009040 comp rx=0 tx=0).stop 2024-02-17T14:28:29.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f66cfda1640 1 -- 172.21.15.134:0/283549290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66c814afa0 msgr2=0x7f66c81e3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f66cfda1640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66c814afa0 0x7f66c81e3e40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f66c400e820 tx=0x7f66c400ece0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f66cfda1640 1 -- 172.21.15.134:0/283549290 shutdown_connections 2024-02-17T14:28:29.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f66cfda1640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66c814afa0 0x7f66c81e3e40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.601+0000 7f66cfda1640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f66ac06b840 0x7f66ac06dd00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.602+0000 7f66cfda1640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66c809b3c0 0x7f66c81e1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.602+0000 7f66cfda1640 1 --2- 172.21.15.134:0/283549290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66c809a8f0 0x7f66c81e0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.602+0000 7f66cfda1640 1 -- 172.21.15.134:0/283549290 >> 172.21.15.134:0/283549290 conn(0x7f66c80b9020 msgr2=0x7f66c8147360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.602+0000 7f66cfda1640 1 -- 172.21.15.134:0/283549290 shutdown_connections 2024-02-17T14:28:29.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.602+0000 7f66cfda1640 1 -- 172.21.15.134:0/283549290 wait complete. 2024-02-17T14:28:29.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.609+0000 7f6f9af17640 1 -- 172.21.15.134:0/2154832222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f941e46f0 con 0x7f6f940729d0 2024-02-17T14:28:29.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.609+0000 7f6f8a7fc640 1 -- 172.21.15.134:0/2154832222 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f8408b1d0 con 0x7f6f940729d0 2024-02-17T14:28:29.609 INFO:teuthology.orchestra.run.smithi134.stdout:55834574857 2024-02-17T14:28:29.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.612+0000 7f6f9af17640 1 -- 172.21.15.134:0/2154832222 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6f7806b8e0 msgr2=0x7f6f7806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.612+0000 7f6f9af17640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6f7806b8e0 0x7f6f7806dda0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6f90006a90 tx=0x7f6f90006a20 comp rx=0 tx=0).stop 2024-02-17T14:28:29.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.612+0000 7f6f9af17640 1 -- 172.21.15.134:0/2154832222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f940729d0 msgr2=0x7f6f941e4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.612+0000 7f6f9af17640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f940729d0 0x7f6f941e4a20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6f84034040 tx=0x7f6f840046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.612+0000 7f6f9af17640 1 -- 172.21.15.134:0/2154832222 shutdown_connections 2024-02-17T14:28:29.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.612+0000 7f6f9af17640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f94147940 0x7f6f940b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.612+0000 7f6f9af17640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6f7806b8e0 0x7f6f7806dda0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6f90006a90 tx=0x7f6f90006a20 comp rx=0 tx=0).stop 2024-02-17T14:28:29.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.612+0000 7f6f9af17640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f940b3210 0x7f6f940b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.612+0000 7f6f9af17640 1 --2- 172.21.15.134:0/2154832222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f940729d0 0x7f6f941e4a20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.612+0000 7f6f9af17640 1 -- 172.21.15.134:0/2154832222 >> 172.21.15.134:0/2154832222 conn(0x7f6f9406b200 msgr2=0x7f6f94073a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.613+0000 7f6f9af17640 1 -- 172.21.15.134:0/2154832222 shutdown_connections 2024-02-17T14:28:29.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.613+0000 7f6f9af17640 1 -- 172.21.15.134:0/2154832222 wait complete. 2024-02-17T14:28:29.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.613+0000 7f1756b8a640 1 -- 172.21.15.134:0/102610007 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1750144ad0 con 0x7f17500b57f0 2024-02-17T14:28:29.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.613+0000 7ff85e16e640 1 -- 172.21.15.134:0/3993245420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff838005810 con 0x7ff85814b620 2024-02-17T14:28:29.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.614+0000 7f174d7fa640 1 -- 172.21.15.134:0/102610007 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17380583b0 con 0x7f17500b57f0 2024-02-17T14:28:29.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.614+0000 7ff84dffb640 1 -- 172.21.15.134:0/3993245420 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff854058870 con 0x7ff85814b620 2024-02-17T14:28:29.615 INFO:teuthology.orchestra.run.smithi134.stdout:55834574856 2024-02-17T14:28:29.615 INFO:teuthology.orchestra.run.smithi134.stdout:55834574858 2024-02-17T14:28:29.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.0 2024-02-17T14:28:29.618 DEBUG:teuthology.parallel:result is None 2024-02-17T14:28:29.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.617+0000 7f1756b8a640 1 -- 172.21.15.134:0/102610007 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f173006b810 msgr2=0x7f173006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.617+0000 7f1756b8a640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f173006b810 0x7f173006dcd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f17400013d0 tx=0x7f1740009040 comp rx=0 tx=0).stop 2024-02-17T14:28:29.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7f1756b8a640 1 -- 172.21.15.134:0/102610007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17500b57f0 msgr2=0x7f1750145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7ff85e16e640 1 -- 172.21.15.134:0/3993245420 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff83c06b910 msgr2=0x7ff83c06ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7f1756b8a640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17500b57f0 0x7f1750145540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f173800e7a0 tx=0x7f173800ec60 comp rx=0 tx=0).stop 2024-02-17T14:28:29.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7ff85e16e640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff83c06b910 0x7ff83c06ddd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff848000f60 tx=0x7ff848005f20 comp rx=0 tx=0).stop 2024-02-17T14:28:29.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7ff85e16e640 1 -- 172.21.15.134:0/3993245420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff85814b620 msgr2=0x7ff8580719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7ff85e16e640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff85814b620 0x7ff8580719e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff85400b410 tx=0x7ff85400b8d0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7f1756b8a640 1 -- 172.21.15.134:0/102610007 shutdown_connections 2024-02-17T14:28:29.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7f1756b8a640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17500b5eb0 0x7f175013b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7f1756b8a640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17500b57f0 0x7f1750145540 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7f1756b8a640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f173006b810 0x7f173006dcd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7f1756b8a640 1 --2- 172.21.15.134:0/102610007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c005350 0x7f175013eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7f1756b8a640 1 -- 172.21.15.134:0/102610007 >> 172.21.15.134:0/102610007 conn(0x7f17500b90c0 msgr2=0x7f175009aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7ff85e16e640 1 -- 172.21.15.134:0/3993245420 shutdown_connections 2024-02-17T14:28:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7ff85e16e640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff83c06b910 0x7ff83c06ddd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7ff85e16e640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff85814b620 0x7ff8580719e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7ff85e16e640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff858143330 0x7ff85806efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7ff85e16e640 1 --2- 172.21.15.134:0/3993245420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff858099d00 0x7ff85809c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7ff85e16e640 1 -- 172.21.15.134:0/3993245420 >> 172.21.15.134:0/3993245420 conn(0x7ff8580b4b60 msgr2=0x7ff85813c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7f1756b8a640 1 -- 172.21.15.134:0/102610007 shutdown_connections 2024-02-17T14:28:29.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7f1756b8a640 1 -- 172.21.15.134:0/102610007 wait complete. 2024-02-17T14:28:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7ff85e16e640 1 -- 172.21.15.134:0/3993245420 shutdown_connections 2024-02-17T14:28:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.618+0000 7ff85e16e640 1 -- 172.21.15.134:0/3993245420 wait complete. 2024-02-17T14:28:29.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.5 2024-02-17T14:28:29.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.622+0000 7f86f4481640 1 -- 172.21.15.134:0/4055698633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f86e4009170 con 0x7f86d8004d00 2024-02-17T14:28:29.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.623+0000 7f86e2ffd640 1 -- 172.21.15.134:0/4055698633 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86e8018070 con 0x7f86d8004d00 2024-02-17T14:28:29.624 DEBUG:teuthology.parallel:result is None 2024-02-17T14:28:29.624 INFO:teuthology.orchestra.run.smithi134.stdout:55834574857 2024-02-17T14:28:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.625+0000 7f86f4481640 1 -- 172.21.15.134:0/4055698633 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f86d006b910 msgr2=0x7f86d006ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.625+0000 7f86f4481640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f86d006b910 0x7f86d006ddd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f86e41575a0 tx=0x7f86dc007b70 comp rx=0 tx=0).stop 2024-02-17T14:28:29.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.625+0000 7f86f4481640 1 -- 172.21.15.134:0/4055698633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d8004d00 msgr2=0x7f86e4158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.625+0000 7f86f4481640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d8004d00 0x7f86e4158ae0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c6b0 tx=0x7f86e800cb70 comp rx=0 tx=0).stop 2024-02-17T14:28:29.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.625+0000 7f86f4481640 1 -- 172.21.15.134:0/4055698633 shutdown_connections 2024-02-17T14:28:29.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.625+0000 7f86f4481640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86e4169cd0 0x7f86e4157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.625+0000 7f86f4481640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86e4159ce0 0x7f86e4169790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.625+0000 7f86f4481640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f86d006b910 0x7f86d006ddd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.625+0000 7f86f4481640 1 --2- 172.21.15.134:0/4055698633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86d8004d00 0x7f86e4158ae0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.625+0000 7f86f4481640 1 -- 172.21.15.134:0/4055698633 >> 172.21.15.134:0/4055698633 conn(0x7f86e403ad20 msgr2=0x7f86e4038a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.625+0000 7f86f4481640 1 -- 172.21.15.134:0/4055698633 shutdown_connections 2024-02-17T14:28:29.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.625+0000 7f86f4481640 1 -- 172.21.15.134:0/4055698633 wait complete. 2024-02-17T14:28:29.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.3 2024-02-17T14:28:29.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.2 2024-02-17T14:28:29.633 DEBUG:teuthology.parallel:result is None 2024-02-17T14:28:29.633 DEBUG:teuthology.parallel:result is None 2024-02-17T14:28:29.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.7 2024-02-17T14:28:29.635 DEBUG:teuthology.parallel:result is None 2024-02-17T14:28:29.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.4 2024-02-17T14:28:29.637 DEBUG:teuthology.parallel:result is None 2024-02-17T14:28:29.637 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-17T14:28:29.637 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T14:28:29.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.783+0000 7f821b015640 1 Processor -- start 2024-02-17T14:28:29.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.783+0000 7f821b015640 1 -- start start 2024-02-17T14:28:29.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f821b015640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f82140b2e60 0x7f82140b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f821b015640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f82140b2460 0x7f82140afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f821b015640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8214073040 con 0x7f82140b1640 2024-02-17T14:28:29.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f821b015640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82140b3240 con 0x7f82140b2e60 2024-02-17T14:28:29.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f821b015640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82140b1ad0 con 0x7f82140b2460 2024-02-17T14:28:29.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f8218db1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f82140b2e60 0x7f82140b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f8218db1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f82140b2e60 0x7f82140b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46506/0 (socket says 172.21.15.134:46506) 2024-02-17T14:28:29.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f8218db1640 1 -- 172.21.15.134:0/1674761321 learned_addr learned my addr 172.21.15.134:0/1674761321 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:29.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f82195b2640 1 --2- 172.21.15.134:0/1674761321 >> v2:172.21.15.142:3300/0 conn(0x7f82140b2460 0x7f82140afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f8218db1640 1 -- 172.21.15.134:0/1674761321 >> v2:172.21.15.142:3300/0 conn(0x7f82140b2460 msgr2=0x7f82140afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:29.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f8218db1640 1 --2- 172.21.15.134:0/1674761321 >> v2:172.21.15.142:3300/0 conn(0x7f82140b2460 0x7f82140afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f8218db1640 1 -- 172.21.15.134:0/1674761321 >> v1:172.21.15.142:6789/0 conn(0x7f82140b1640 legacy=0x7f82140af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:29.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f8218db1640 1 -- 172.21.15.134:0/1674761321 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214072b20 con 0x7f82140b2e60 2024-02-17T14:28:29.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.784+0000 7f82195b2640 1 --2- 172.21.15.134:0/1674761321 >> v2:172.21.15.142:3300/0 conn(0x7f82140b2460 0x7f82140afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:29.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.785+0000 7f8218db1640 1 --2- 172.21.15.134:0/1674761321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82140b2e60 0x7f82140b1f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8204009870 tx=0x7f820402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8211f02a47173b1a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.785+0000 7f82137fe640 1 -- 172.21.15.134:0/1674761321 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204031750 con 0x7f82140b2e60 2024-02-17T14:28:29.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.785+0000 7f82137fe640 1 -- 172.21.15.134:0/1674761321 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82040318b0 con 0x7f82140b2e60 2024-02-17T14:28:29.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.785+0000 7f82137fe640 1 -- 172.21.15.134:0/1674761321 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204031c40 con 0x7f82140b2e60 2024-02-17T14:28:29.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.785+0000 7f821b015640 1 -- 172.21.15.134:0/1674761321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82140b2e60 msgr2=0x7f82140b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.785+0000 7f821b015640 1 --2- 172.21.15.134:0/1674761321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82140b2e60 0x7f82140b1f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8204009870 tx=0x7f820402b7f0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.786+0000 7f821b015640 1 -- 172.21.15.134:0/1674761321 shutdown_connections 2024-02-17T14:28:29.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.786+0000 7f821b015640 1 --2- 172.21.15.134:0/1674761321 >> v2:172.21.15.142:3300/0 conn(0x7f82140b2460 0x7f82140afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.786+0000 7f821b015640 1 --2- 172.21.15.134:0/1674761321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82140b2e60 0x7f82140b1f20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.786+0000 7f821b015640 1 -- 172.21.15.134:0/1674761321 >> 172.21.15.134:0/1674761321 conn(0x7f82140b8270 msgr2=0x7f82140b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.786+0000 7f821b015640 1 -- 172.21.15.134:0/1674761321 shutdown_connections 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.786+0000 7f821b015640 1 -- 172.21.15.134:0/1674761321 wait complete. 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.787+0000 7f821b015640 1 Processor -- start 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.787+0000 7f821b015640 1 -- start start 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.787+0000 7f821b015640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82140b2460 0x7f8214130830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.787+0000 7f821b015640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140b2e60 0x7f82141ddfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.787+0000 7f821b015640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82141de510 0x7f821413e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.787+0000 7f821b015640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82141ddbd0 con 0x7f82141de510 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.787+0000 7f821b015640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8214141300 con 0x7f82140b2460 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.787+0000 7f821b015640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821412d160 con 0x7f82140b2e60 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.787+0000 7f82195b2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82141de510 0x7f821413e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.787+0000 7f82195b2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82141de510 0x7f821413e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46508/0 (socket says 172.21.15.134:46508) 2024-02-17T14:28:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.787+0000 7f82195b2640 1 -- 172.21.15.134:0/1536789630 learned_addr learned my addr 172.21.15.134:0/1536789630 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.788+0000 7f8213fff640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140b2e60 0x7f82141ddfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.788+0000 7f8218db1640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82140b2460 0x7f8214130830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.788+0000 7f82195b2640 1 -- 172.21.15.134:0/1536789630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140b2e60 msgr2=0x7f82141ddfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.788+0000 7f82195b2640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140b2e60 0x7f82141ddfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.788+0000 7f82195b2640 1 -- 172.21.15.134:0/1536789630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82140b2460 msgr2=0x7f8214130830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.788+0000 7f82195b2640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82140b2460 0x7f8214130830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.788+0000 7f82195b2640 1 -- 172.21.15.134:0/1536789630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82040094d0 con 0x7f82141de510 2024-02-17T14:28:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.788+0000 7f82195b2640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82141de510 0x7f821413e4f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f820c00cef0 tx=0x7f820c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.788+0000 7f82117fa640 1 -- 172.21.15.134:0/1536789630 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c00d840 con 0x7f82141de510 2024-02-17T14:28:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.788+0000 7f82117fa640 1 -- 172.21.15.134:0/1536789630 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c00d9c0 con 0x7f82141de510 2024-02-17T14:28:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.788+0000 7f82117fa640 1 -- 172.21.15.134:0/1536789630 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c00dd70 con 0x7f82141de510 2024-02-17T14:28:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.788+0000 7f821b015640 1 -- 172.21.15.134:0/1536789630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8214141020 con 0x7f82141de510 2024-02-17T14:28:29.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.788+0000 7f821b015640 1 -- 172.21.15.134:0/1536789630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8214141720 con 0x7f82141de510 2024-02-17T14:28:29.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.789+0000 7f821b015640 1 -- 172.21.15.134:0/1536789630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8214074650 con 0x7f82141de510 2024-02-17T14:28:29.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.789+0000 7f82117fa640 1 -- 172.21.15.134:0/1536789630 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f820c01e3b0 con 0x7f82141de510 2024-02-17T14:28:29.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.790+0000 7f82117fa640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f820006b810 0x7f820006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:29.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.790+0000 7f82117fa640 1 -- 172.21.15.134:0/1536789630 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f820c08af20 con 0x7f82141de510 2024-02-17T14:28:29.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.790+0000 7f8218db1640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f820006b810 0x7f820006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:29.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.790+0000 7f8218db1640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f820006b810 0x7f820006dcd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8204035000 tx=0x7f8204008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:29.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.794+0000 7f82117fa640 1 -- 172.21.15.134:0/1536789630 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f820c055750 con 0x7f82141de510 2024-02-17T14:28:29.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.962+0000 7f821b015640 1 -- 172.21.15.134:0/1536789630 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8214140e80 con 0x7f820006b810 2024-02-17T14:28:29.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.970+0000 7f82117fa640 1 -- 172.21.15.134:0/1536789630 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345325 (secure 0 0 0) 0x7f8214140e80 con 0x7f820006b810 2024-02-17T14:28:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:29.975 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-02-17T14:28:29.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.974+0000 7f821b015640 1 -- 172.21.15.134:0/1536789630 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f820006b810 msgr2=0x7f820006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.974+0000 7f821b015640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f820006b810 0x7f820006dcd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8204035000 tx=0x7f8204008030 comp rx=0 tx=0).stop 2024-02-17T14:28:29.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.974+0000 7f821b015640 1 -- 172.21.15.134:0/1536789630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82141de510 msgr2=0x7f821413e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:29.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.974+0000 7f821b015640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82141de510 0x7f821413e4f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f820c00cef0 tx=0x7f820c00a710 comp rx=0 tx=0).stop 2024-02-17T14:28:29.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.974+0000 7f821b015640 1 -- 172.21.15.134:0/1536789630 shutdown_connections 2024-02-17T14:28:29.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.974+0000 7f821b015640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f820006b810 0x7f820006dcd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.974+0000 7f821b015640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82141de510 0x7f821413e4f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.974+0000 7f821b015640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82140b2e60 0x7f82141ddfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.974+0000 7f821b015640 1 --2- 172.21.15.134:0/1536789630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82140b2460 0x7f8214130830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:29.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.974+0000 7f821b015640 1 -- 172.21.15.134:0/1536789630 >> 172.21.15.134:0/1536789630 conn(0x7f82140b8270 msgr2=0x7f82141311c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:29.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.974+0000 7f821b015640 1 -- 172.21.15.134:0/1536789630 shutdown_connections 2024-02-17T14:28:29.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:29.974+0000 7f821b015640 1 -- 172.21.15.134:0/1536789630 wait complete. 2024-02-17T14:28:29.984 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-02-17T14:28:28.565689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218448,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756272,"statfs":{"total":773094113280,"available":772870422528,"internally_reserved":0,"allocated":2326528,"data_stored":2029432,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003313"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231617+0000","last_change":"2024-02-17T14:28:03.069069+0000","last_active":"2024-02-17T14:28:10.231617+0000","last_peered":"2024-02-17T14:28:10.231617+0000","last_clean":"2024-02-17T14:28:10.231617+0000","last_became_active":"2024-02-17T14:28:03.068714+0000","last_became_peered":"2024-02-17T14:28:03.068714+0000","last_unstale":"2024-02-17T14:28:10.231617+0000","last_undegraded":"2024-02-17T14:28:10.231617+0000","last_fullsized":"2024-02-17T14:28:10.231617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:49:37.606508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659580+0000","last_change":"2024-02-17T14:28:03.633277+0000","last_active":"2024-02-17T14:28:08.659580+0000","last_peered":"2024-02-17T14:28:08.659580+0000","last_clean":"2024-02-17T14:28:08.659580+0000","last_became_active":"2024-02-17T14:28:03.631462+0000","last_became_peered":"2024-02-17T14:28:03.631462+0000","last_unstale":"2024-02-17T14:28:08.659580+0000","last_undegraded":"2024-02-17T14:28:08.659580+0000","last_fullsized":"2024-02-17T14:28:08.659580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659129+0000","last_change":"2024-02-17T14:28:07.850214+0000","last_active":"2024-02-17T14:28:08.659129+0000","last_peered":"2024-02-17T14:28:08.659129+0000","last_clean":"2024-02-17T14:28:08.659129+0000","last_became_active":"2024-02-17T14:28:07.849871+0000","last_became_peered":"2024-02-17T14:28:07.849871+0000","last_unstale":"2024-02-17T14:28:08.659129+0000","last_undegraded":"2024-02-17T14:28:08.659129+0000","last_fullsized":"2024-02-17T14:28:08.659129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:46:12.614434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659755+0000","last_change":"2024-02-17T14:28:03.069234+0000","last_active":"2024-02-17T14:28:08.659755+0000","last_peered":"2024-02-17T14:28:08.659755+0000","last_clean":"2024-02-17T14:28:08.659755+0000","last_became_active":"2024-02-17T14:28:03.068978+0000","last_became_peered":"2024-02-17T14:28:03.068978+0000","last_unstale":"2024-02-17T14:28:08.659755+0000","last_undegraded":"2024-02-17T14:28:08.659755+0000","last_fullsized":"2024-02-17T14:28:08.659755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231420+0000","last_change":"2024-02-17T14:28:03.630763+0000","last_active":"2024-02-17T14:28:10.231420+0000","last_peered":"2024-02-17T14:28:10.231420+0000","last_clean":"2024-02-17T14:28:10.231420+0000","last_became_active":"2024-02-17T14:28:03.630517+0000","last_became_peered":"2024-02-17T14:28:03.630517+0000","last_unstale":"2024-02-17T14:28:10.231420+0000","last_undegraded":"2024-02-17T14:28:10.231420+0000","last_fullsized":"2024-02-17T14:28:10.231420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664338+0000","last_change":"2024-02-17T14:28:07.644982+0000","last_active":"2024-02-17T14:28:08.664338+0000","last_peered":"2024-02-17T14:28:08.664338+0000","last_clean":"2024-02-17T14:28:08.664338+0000","last_became_active":"2024-02-17T14:28:07.644458+0000","last_became_peered":"2024-02-17T14:28:07.644458+0000","last_unstale":"2024-02-17T14:28:08.664338+0000","last_undegraded":"2024-02-17T14:28:08.664338+0000","last_fullsized":"2024-02-17T14:28:08.664338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:42.133618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653761+0000","last_change":"2024-02-17T14:28:03.071236+0000","last_active":"2024-02-17T14:28:10.653761+0000","last_peered":"2024-02-17T14:28:10.653761+0000","last_clean":"2024-02-17T14:28:10.653761+0000","last_became_active":"2024-02-17T14:28:03.070955+0000","last_became_peered":"2024-02-17T14:28:03.070955+0000","last_unstale":"2024-02-17T14:28:10.653761+0000","last_undegraded":"2024-02-17T14:28:10.653761+0000","last_fullsized":"2024-02-17T14:28:10.653761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664873+0000","last_change":"2024-02-17T14:28:03.628182+0000","last_active":"2024-02-17T14:28:08.664873+0000","last_peered":"2024-02-17T14:28:08.664873+0000","last_clean":"2024-02-17T14:28:08.664873+0000","last_became_active":"2024-02-17T14:28:03.627865+0000","last_became_peered":"2024-02-17T14:28:03.627865+0000","last_unstale":"2024-02-17T14:28:08.664873+0000","last_undegraded":"2024-02-17T14:28:08.664873+0000","last_fullsized":"2024-02-17T14:28:08.664873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665230+0000","last_change":"2024-02-17T14:28:07.649384+0000","last_active":"2024-02-17T14:28:08.665230+0000","last_peered":"2024-02-17T14:28:08.665230+0000","last_clean":"2024-02-17T14:28:08.665230+0000","last_became_active":"2024-02-17T14:28:07.648936+0000","last_became_peered":"2024-02-17T14:28:07.648936+0000","last_unstale":"2024-02-17T14:28:08.665230+0000","last_undegraded":"2024-02-17T14:28:08.665230+0000","last_fullsized":"2024-02-17T14:28:08.665230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:13.199365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653449+0000","last_change":"2024-02-17T14:28:03.074776+0000","last_active":"2024-02-17T14:28:10.653449+0000","last_peered":"2024-02-17T14:28:10.653449+0000","last_clean":"2024-02-17T14:28:10.653449+0000","last_became_active":"2024-02-17T14:28:03.074490+0000","last_became_peered":"2024-02-17T14:28:03.074490+0000","last_unstale":"2024-02-17T14:28:10.653449+0000","last_undegraded":"2024-02-17T14:28:10.653449+0000","last_fullsized":"2024-02-17T14:28:10.653449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.666004+0000","last_change":"2024-02-17T14:28:03.627957+0000","last_active":"2024-02-17T14:28:08.666004+0000","last_peered":"2024-02-17T14:28:08.666004+0000","last_clean":"2024-02-17T14:28:08.666004+0000","last_became_active":"2024-02-17T14:28:03.627675+0000","last_became_peered":"2024-02-17T14:28:03.627675+0000","last_unstale":"2024-02-17T14:28:08.666004+0000","last_undegraded":"2024-02-17T14:28:08.666004+0000","last_fullsized":"2024-02-17T14:28:08.666004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664955+0000","last_change":"2024-02-17T14:28:07.652422+0000","last_active":"2024-02-17T14:28:08.664955+0000","last_peered":"2024-02-17T14:28:08.664955+0000","last_clean":"2024-02-17T14:28:08.664955+0000","last_became_active":"2024-02-17T14:28:07.651946+0000","last_became_peered":"2024-02-17T14:28:07.651946+0000","last_unstale":"2024-02-17T14:28:08.664955+0000","last_undegraded":"2024-02-17T14:28:08.664955+0000","last_fullsized":"2024-02-17T14:28:08.664955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:21.967845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199578+0000","last_change":"2024-02-17T14:28:03.635059+0000","last_active":"2024-02-17T14:28:10.199578+0000","last_peered":"2024-02-17T14:28:10.199578+0000","last_clean":"2024-02-17T14:28:10.199578+0000","last_became_active":"2024-02-17T14:28:03.634759+0000","last_became_peered":"2024-02-17T14:28:03.634759+0000","last_unstale":"2024-02-17T14:28:10.199578+0000","last_undegraded":"2024-02-17T14:28:10.199578+0000","last_fullsized":"2024-02-17T14:28:10.199578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653581+0000","last_change":"2024-02-17T14:28:03.075604+0000","last_active":"2024-02-17T14:28:10.653581+0000","last_peered":"2024-02-17T14:28:10.653581+0000","last_clean":"2024-02-17T14:28:10.653581+0000","last_became_active":"2024-02-17T14:28:03.075329+0000","last_became_peered":"2024-02-17T14:28:03.075329+0000","last_unstale":"2024-02-17T14:28:10.653581+0000","last_undegraded":"2024-02-17T14:28:10.653581+0000","last_fullsized":"2024-02-17T14:28:10.653581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665134+0000","last_change":"2024-02-17T14:28:07.645791+0000","last_active":"2024-02-17T14:28:08.665134+0000","last_peered":"2024-02-17T14:28:08.665134+0000","last_clean":"2024-02-17T14:28:08.665134+0000","last_became_active":"2024-02-17T14:28:07.645418+0000","last_became_peered":"2024-02-17T14:28:07.645418+0000","last_unstale":"2024-02-17T14:28:08.665134+0000","last_undegraded":"2024-02-17T14:28:08.665134+0000","last_fullsized":"2024-02-17T14:28:08.665134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:26.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659629+0000","last_change":"2024-02-17T14:28:03.629378+0000","last_active":"2024-02-17T14:28:08.659629+0000","last_peered":"2024-02-17T14:28:08.659629+0000","last_clean":"2024-02-17T14:28:08.659629+0000","last_became_active":"2024-02-17T14:28:03.629097+0000","last_became_peered":"2024-02-17T14:28:03.629097+0000","last_unstale":"2024-02-17T14:28:08.659629+0000","last_undegraded":"2024-02-17T14:28:08.659629+0000","last_fullsized":"2024-02-17T14:28:08.659629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008740+0000","last_change":"2024-02-17T14:28:03.073579+0000","last_active":"2024-02-17T14:28:09.008740+0000","last_peered":"2024-02-17T14:28:09.008740+0000","last_clean":"2024-02-17T14:28:09.008740+0000","last_became_active":"2024-02-17T14:28:03.073167+0000","last_became_peered":"2024-02-17T14:28:03.073167+0000","last_unstale":"2024-02-17T14:28:09.008740+0000","last_undegraded":"2024-02-17T14:28:09.008740+0000","last_fullsized":"2024-02-17T14:28:09.008740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664544+0000","last_change":"2024-02-17T14:28:07.644972+0000","last_active":"2024-02-17T14:28:08.664544+0000","last_peered":"2024-02-17T14:28:08.664544+0000","last_clean":"2024-02-17T14:28:08.664544+0000","last_became_active":"2024-02-17T14:28:07.644523+0000","last_became_peered":"2024-02-17T14:28:07.644523+0000","last_unstale":"2024-02-17T14:28:08.664544+0000","last_undegraded":"2024-02-17T14:28:08.664544+0000","last_fullsized":"2024-02-17T14:28:08.664544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:25.221682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659355+0000","last_change":"2024-02-17T14:28:03.628527+0000","last_active":"2024-02-17T14:28:08.659355+0000","last_peered":"2024-02-17T14:28:08.659355+0000","last_clean":"2024-02-17T14:28:08.659355+0000","last_became_active":"2024-02-17T14:28:03.628274+0000","last_became_peered":"2024-02-17T14:28:03.628274+0000","last_unstale":"2024-02-17T14:28:08.659355+0000","last_undegraded":"2024-02-17T14:28:08.659355+0000","last_fullsized":"2024-02-17T14:28:08.659355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008406+0000","last_change":"2024-02-17T14:28:03.072317+0000","last_active":"2024-02-17T14:28:09.008406+0000","last_peered":"2024-02-17T14:28:09.008406+0000","last_clean":"2024-02-17T14:28:09.008406+0000","last_became_active":"2024-02-17T14:28:03.072016+0000","last_became_peered":"2024-02-17T14:28:03.072016+0000","last_unstale":"2024-02-17T14:28:09.008406+0000","last_undegraded":"2024-02-17T14:28:09.008406+0000","last_fullsized":"2024-02-17T14:28:09.008406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008870+0000","last_change":"2024-02-17T14:28:07.851022+0000","last_active":"2024-02-17T14:28:09.008870+0000","last_peered":"2024-02-17T14:28:09.008870+0000","last_clean":"2024-02-17T14:28:09.008870+0000","last_became_active":"2024-02-17T14:28:07.850379+0000","last_became_peered":"2024-02-17T14:28:07.850379+0000","last_unstale":"2024-02-17T14:28:09.008870+0000","last_undegraded":"2024-02-17T14:28:09.008870+0000","last_fullsized":"2024-02-17T14:28:09.008870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665771+0000","last_change":"2024-02-17T14:28:03.624798+0000","last_active":"2024-02-17T14:28:08.665771+0000","last_peered":"2024-02-17T14:28:08.665771+0000","last_clean":"2024-02-17T14:28:08.665771+0000","last_became_active":"2024-02-17T14:28:03.624517+0000","last_became_peered":"2024-02-17T14:28:03.624517+0000","last_unstale":"2024-02-17T14:28:08.665771+0000","last_undegraded":"2024-02-17T14:28:08.665771+0000","last_fullsized":"2024-02-17T14:28:08.665771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:40.637145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653091+0000","last_change":"2024-02-17T14:28:03.072806+0000","last_active":"2024-02-17T14:28:10.653091+0000","last_peered":"2024-02-17T14:28:10.653091+0000","last_clean":"2024-02-17T14:28:10.653091+0000","last_became_active":"2024-02-17T14:28:03.072490+0000","last_became_peered":"2024-02-17T14:28:03.072490+0000","last_unstale":"2024-02-17T14:28:10.653091+0000","last_undegraded":"2024-02-17T14:28:10.653091+0000","last_fullsized":"2024-02-17T14:28:10.653091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664603+0000","last_change":"2024-02-17T14:28:07.644959+0000","last_active":"2024-02-17T14:28:08.664603+0000","last_peered":"2024-02-17T14:28:08.664603+0000","last_clean":"2024-02-17T14:28:08.664603+0000","last_became_active":"2024-02-17T14:28:07.644524+0000","last_became_peered":"2024-02-17T14:28:07.644524+0000","last_unstale":"2024-02-17T14:28:08.664603+0000","last_undegraded":"2024-02-17T14:28:08.664603+0000","last_fullsized":"2024-02-17T14:28:08.664603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:02.122806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231643+0000","last_change":"2024-02-17T14:28:03.629190+0000","last_active":"2024-02-17T14:28:10.231643+0000","last_peered":"2024-02-17T14:28:10.231643+0000","last_clean":"2024-02-17T14:28:10.231643+0000","last_became_active":"2024-02-17T14:28:03.628777+0000","last_became_peered":"2024-02-17T14:28:03.628777+0000","last_unstale":"2024-02-17T14:28:10.231643+0000","last_undegraded":"2024-02-17T14:28:10.231643+0000","last_fullsized":"2024-02-17T14:28:10.231643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200259+0000","last_change":"2024-02-17T14:28:03.071097+0000","last_active":"2024-02-17T14:28:10.200259+0000","last_peered":"2024-02-17T14:28:10.200259+0000","last_clean":"2024-02-17T14:28:10.200259+0000","last_became_active":"2024-02-17T14:28:03.070790+0000","last_became_peered":"2024-02-17T14:28:03.070790+0000","last_unstale":"2024-02-17T14:28:10.200259+0000","last_undegraded":"2024-02-17T14:28:10.200259+0000","last_fullsized":"2024-02-17T14:28:10.200259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665566+0000","last_change":"2024-02-17T14:28:07.849764+0000","last_active":"2024-02-17T14:28:08.665566+0000","last_peered":"2024-02-17T14:28:08.665566+0000","last_clean":"2024-02-17T14:28:08.665566+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:08.665566+0000","last_undegraded":"2024-02-17T14:28:08.665566+0000","last_fullsized":"2024-02-17T14:28:08.665566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659802+0000","last_change":"2024-02-17T14:28:03.641818+0000","last_active":"2024-02-17T14:28:08.659802+0000","last_peered":"2024-02-17T14:28:08.659802+0000","last_clean":"2024-02-17T14:28:08.659802+0000","last_became_active":"2024-02-17T14:28:03.641577+0000","last_became_peered":"2024-02-17T14:28:03.641577+0000","last_unstale":"2024-02-17T14:28:08.659802+0000","last_undegraded":"2024-02-17T14:28:08.659802+0000","last_fullsized":"2024-02-17T14:28:08.659802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008983+0000","last_change":"2024-02-17T14:28:03.072074+0000","last_active":"2024-02-17T14:28:09.008983+0000","last_peered":"2024-02-17T14:28:09.008983+0000","last_clean":"2024-02-17T14:28:09.008983+0000","last_became_active":"2024-02-17T14:28:03.071850+0000","last_became_peered":"2024-02-17T14:28:03.071850+0000","last_unstale":"2024-02-17T14:28:09.008983+0000","last_undegraded":"2024-02-17T14:28:09.008983+0000","last_fullsized":"2024-02-17T14:28:09.008983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659047+0000","last_change":"2024-02-17T14:28:07.849616+0000","last_active":"2024-02-17T14:28:08.659047+0000","last_peered":"2024-02-17T14:28:08.659047+0000","last_clean":"2024-02-17T14:28:08.659047+0000","last_became_active":"2024-02-17T14:28:07.849022+0000","last_became_peered":"2024-02-17T14:28:07.849022+0000","last_unstale":"2024-02-17T14:28:08.659047+0000","last_undegraded":"2024-02-17T14:28:08.659047+0000","last_fullsized":"2024-02-17T14:28:08.659047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:18:22.630217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008626+0000","last_change":"2024-02-17T14:28:03.632265+0000","last_active":"2024-02-17T14:28:09.008626+0000","last_peered":"2024-02-17T14:28:09.008626+0000","last_clean":"2024-02-17T14:28:09.008626+0000","last_became_active":"2024-02-17T14:28:03.632020+0000","last_became_peered":"2024-02-17T14:28:03.632020+0000","last_unstale":"2024-02-17T14:28:09.008626+0000","last_undegraded":"2024-02-17T14:28:09.008626+0000","last_fullsized":"2024-02-17T14:28:09.008626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653833+0000","last_change":"2024-02-17T14:28:03.072252+0000","last_active":"2024-02-17T14:28:10.653833+0000","last_peered":"2024-02-17T14:28:10.653833+0000","last_clean":"2024-02-17T14:28:10.653833+0000","last_became_active":"2024-02-17T14:28:03.071830+0000","last_became_peered":"2024-02-17T14:28:03.071830+0000","last_unstale":"2024-02-17T14:28:10.653833+0000","last_undegraded":"2024-02-17T14:28:10.653833+0000","last_fullsized":"2024-02-17T14:28:10.653833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:24.870956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231494+0000","last_change":"2024-02-17T14:28:07.849579+0000","last_active":"2024-02-17T14:28:10.231494+0000","last_peered":"2024-02-17T14:28:10.231494+0000","last_clean":"2024-02-17T14:28:10.231494+0000","last_became_active":"2024-02-17T14:28:07.849212+0000","last_became_peered":"2024-02-17T14:28:07.849212+0000","last_unstale":"2024-02-17T14:28:10.231494+0000","last_undegraded":"2024-02-17T14:28:10.231494+0000","last_fullsized":"2024-02-17T14:28:10.231494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.666100+0000","last_change":"2024-02-17T14:28:03.626429+0000","last_active":"2024-02-17T14:28:08.666100+0000","last_peered":"2024-02-17T14:28:08.666100+0000","last_clean":"2024-02-17T14:28:08.666100+0000","last_became_active":"2024-02-17T14:28:03.626174+0000","last_became_peered":"2024-02-17T14:28:03.626174+0000","last_unstale":"2024-02-17T14:28:08.666100+0000","last_undegraded":"2024-02-17T14:28:08.666100+0000","last_fullsized":"2024-02-17T14:28:08.666100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008726+0000","last_change":"2024-02-17T14:28:03.068443+0000","last_active":"2024-02-17T14:28:09.008726+0000","last_peered":"2024-02-17T14:28:09.008726+0000","last_clean":"2024-02-17T14:28:09.008726+0000","last_became_active":"2024-02-17T14:28:03.068179+0000","last_became_peered":"2024-02-17T14:28:03.068179+0000","last_unstale":"2024-02-17T14:28:09.008726+0000","last_undegraded":"2024-02-17T14:28:09.008726+0000","last_fullsized":"2024-02-17T14:28:09.008726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008367+0000","last_change":"2024-02-17T14:28:07.650015+0000","last_active":"2024-02-17T14:28:09.008367+0000","last_peered":"2024-02-17T14:28:09.008367+0000","last_clean":"2024-02-17T14:28:09.008367+0000","last_became_active":"2024-02-17T14:28:07.647918+0000","last_became_peered":"2024-02-17T14:28:07.647918+0000","last_unstale":"2024-02-17T14:28:09.008367+0000","last_undegraded":"2024-02-17T14:28:09.008367+0000","last_fullsized":"2024-02-17T14:28:09.008367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665475+0000","last_change":"2024-02-17T14:28:03.629343+0000","last_active":"2024-02-17T14:28:08.665475+0000","last_peered":"2024-02-17T14:28:08.665475+0000","last_clean":"2024-02-17T14:28:08.665475+0000","last_became_active":"2024-02-17T14:28:03.629077+0000","last_became_peered":"2024-02-17T14:28:03.629077+0000","last_unstale":"2024-02-17T14:28:08.665475+0000","last_undegraded":"2024-02-17T14:28:08.665475+0000","last_fullsized":"2024-02-17T14:28:08.665475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:36.441335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664754+0000","last_change":"2024-02-17T14:28:03.069178+0000","last_active":"2024-02-17T14:28:08.664754+0000","last_peered":"2024-02-17T14:28:08.664754+0000","last_clean":"2024-02-17T14:28:08.664754+0000","last_became_active":"2024-02-17T14:28:03.068923+0000","last_became_peered":"2024-02-17T14:28:03.068923+0000","last_unstale":"2024-02-17T14:28:08.664754+0000","last_undegraded":"2024-02-17T14:28:08.664754+0000","last_fullsized":"2024-02-17T14:28:08.664754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008675+0000","last_change":"2024-02-17T14:28:07.648757+0000","last_active":"2024-02-17T14:28:09.008675+0000","last_peered":"2024-02-17T14:28:09.008675+0000","last_clean":"2024-02-17T14:28:09.008675+0000","last_became_active":"2024-02-17T14:28:07.645156+0000","last_became_peered":"2024-02-17T14:28:07.645156+0000","last_unstale":"2024-02-17T14:28:09.008675+0000","last_undegraded":"2024-02-17T14:28:09.008675+0000","last_fullsized":"2024-02-17T14:28:09.008675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008415+0000","last_change":"2024-02-17T14:28:03.627479+0000","last_active":"2024-02-17T14:28:09.008415+0000","last_peered":"2024-02-17T14:28:09.008415+0000","last_clean":"2024-02-17T14:28:09.008415+0000","last_became_active":"2024-02-17T14:28:03.627165+0000","last_became_peered":"2024-02-17T14:28:03.627165+0000","last_unstale":"2024-02-17T14:28:09.008415+0000","last_undegraded":"2024-02-17T14:28:09.008415+0000","last_fullsized":"2024-02-17T14:28:09.008415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952042+0000","last_change":"2024-02-17T14:28:03.066452+0000","last_active":"2024-02-17T14:28:08.952042+0000","last_peered":"2024-02-17T14:28:08.952042+0000","last_clean":"2024-02-17T14:28:08.952042+0000","last_became_active":"2024-02-17T14:28:03.066156+0000","last_became_peered":"2024-02-17T14:28:03.066156+0000","last_unstale":"2024-02-17T14:28:08.952042+0000","last_undegraded":"2024-02-17T14:28:08.952042+0000","last_fullsized":"2024-02-17T14:28:08.952042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008897+0000","last_change":"2024-02-17T14:28:07.649765+0000","last_active":"2024-02-17T14:28:09.008897+0000","last_peered":"2024-02-17T14:28:09.008897+0000","last_clean":"2024-02-17T14:28:09.008897+0000","last_became_active":"2024-02-17T14:28:07.649403+0000","last_became_peered":"2024-02-17T14:28:07.649403+0000","last_unstale":"2024-02-17T14:28:09.008897+0000","last_undegraded":"2024-02-17T14:28:09.008897+0000","last_fullsized":"2024-02-17T14:28:09.008897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231133+0000","last_change":"2024-02-17T14:28:03.629628+0000","last_active":"2024-02-17T14:28:10.231133+0000","last_peered":"2024-02-17T14:28:10.231133+0000","last_clean":"2024-02-17T14:28:10.231133+0000","last_became_active":"2024-02-17T14:28:03.629247+0000","last_became_peered":"2024-02-17T14:28:03.629247+0000","last_unstale":"2024-02-17T14:28:10.231133+0000","last_undegraded":"2024-02-17T14:28:10.231133+0000","last_fullsized":"2024-02-17T14:28:10.231133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:00:51.336643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653093+0000","last_change":"2024-02-17T14:28:03.072090+0000","last_active":"2024-02-17T14:28:10.653093+0000","last_peered":"2024-02-17T14:28:10.653093+0000","last_clean":"2024-02-17T14:28:10.653093+0000","last_became_active":"2024-02-17T14:28:03.071778+0000","last_became_peered":"2024-02-17T14:28:03.071778+0000","last_unstale":"2024-02-17T14:28:10.653093+0000","last_undegraded":"2024-02-17T14:28:10.653093+0000","last_fullsized":"2024-02-17T14:28:10.653093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231592+0000","last_change":"2024-02-17T14:28:07.850472+0000","last_active":"2024-02-17T14:28:10.231592+0000","last_peered":"2024-02-17T14:28:10.231592+0000","last_clean":"2024-02-17T14:28:10.231592+0000","last_became_active":"2024-02-17T14:28:07.850106+0000","last_became_peered":"2024-02-17T14:28:07.850106+0000","last_unstale":"2024-02-17T14:28:10.231592+0000","last_undegraded":"2024-02-17T14:28:10.231592+0000","last_fullsized":"2024-02-17T14:28:10.231592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659235+0000","last_change":"2024-02-17T14:28:03.635109+0000","last_active":"2024-02-17T14:28:08.659235+0000","last_peered":"2024-02-17T14:28:08.659235+0000","last_clean":"2024-02-17T14:28:08.659235+0000","last_became_active":"2024-02-17T14:28:03.634570+0000","last_became_peered":"2024-02-17T14:28:03.634570+0000","last_unstale":"2024-02-17T14:28:08.659235+0000","last_undegraded":"2024-02-17T14:28:08.659235+0000","last_fullsized":"2024-02-17T14:28:08.659235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665733+0000","last_change":"2024-02-17T14:28:03.061647+0000","last_active":"2024-02-17T14:28:08.665733+0000","last_peered":"2024-02-17T14:28:08.665733+0000","last_clean":"2024-02-17T14:28:08.665733+0000","last_became_active":"2024-02-17T14:28:03.061026+0000","last_became_peered":"2024-02-17T14:28:03.061026+0000","last_unstale":"2024-02-17T14:28:08.665733+0000","last_undegraded":"2024-02-17T14:28:08.665733+0000","last_fullsized":"2024-02-17T14:28:08.665733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653276+0000","last_change":"2024-02-17T14:28:00.253131+0000","last_active":"2024-02-17T14:28:10.653276+0000","last_peered":"2024-02-17T14:28:10.653276+0000","last_clean":"2024-02-17T14:28:10.653276+0000","last_became_active":"2024-02-17T14:28:00.252180+0000","last_became_peered":"2024-02-17T14:28:00.252180+0000","last_unstale":"2024-02-17T14:28:10.653276+0000","last_undegraded":"2024-02-17T14:28:10.653276+0000","last_fullsized":"2024-02-17T14:28:10.653276+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_clean_scrub_stamp":"2024-02-17T14:27:59.037303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:48.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199982+0000","last_change":"2024-02-17T14:28:07.849676+0000","last_active":"2024-02-17T14:28:10.199982+0000","last_peered":"2024-02-17T14:28:10.199982+0000","last_clean":"2024-02-17T14:28:10.199982+0000","last_became_active":"2024-02-17T14:28:07.849264+0000","last_became_peered":"2024-02-17T14:28:07.849264+0000","last_unstale":"2024-02-17T14:28:10.199982+0000","last_undegraded":"2024-02-17T14:28:10.199982+0000","last_fullsized":"2024-02-17T14:28:10.199982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653536+0000","last_change":"2024-02-17T14:28:03.642433+0000","last_active":"2024-02-17T14:28:10.653536+0000","last_peered":"2024-02-17T14:28:10.653536+0000","last_clean":"2024-02-17T14:28:10.653536+0000","last_became_active":"2024-02-17T14:28:03.641815+0000","last_became_peered":"2024-02-17T14:28:03.641815+0000","last_unstale":"2024-02-17T14:28:10.653536+0000","last_undegraded":"2024-02-17T14:28:10.653536+0000","last_fullsized":"2024-02-17T14:28:10.653536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:38.398272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952264+0000","last_change":"2024-02-17T14:28:03.066483+0000","last_active":"2024-02-17T14:28:08.952264+0000","last_peered":"2024-02-17T14:28:08.952264+0000","last_clean":"2024-02-17T14:28:08.952264+0000","last_became_active":"2024-02-17T14:28:03.066169+0000","last_became_peered":"2024-02-17T14:28:03.066169+0000","last_unstale":"2024-02-17T14:28:08.952264+0000","last_undegraded":"2024-02-17T14:28:08.952264+0000","last_fullsized":"2024-02-17T14:28:08.952264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199590+0000","last_change":"2024-02-17T14:28:07.846685+0000","last_active":"2024-02-17T14:28:10.199590+0000","last_peered":"2024-02-17T14:28:10.199590+0000","last_clean":"2024-02-17T14:28:10.199590+0000","last_became_active":"2024-02-17T14:28:07.846265+0000","last_became_peered":"2024-02-17T14:28:07.846265+0000","last_unstale":"2024-02-17T14:28:10.199590+0000","last_undegraded":"2024-02-17T14:28:10.199590+0000","last_fullsized":"2024-02-17T14:28:10.199590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664990+0000","last_change":"2024-02-17T14:28:03.634574+0000","last_active":"2024-02-17T14:28:08.664990+0000","last_peered":"2024-02-17T14:28:08.664990+0000","last_clean":"2024-02-17T14:28:08.664990+0000","last_became_active":"2024-02-17T14:28:03.634290+0000","last_became_peered":"2024-02-17T14:28:03.634290+0000","last_unstale":"2024-02-17T14:28:08.664990+0000","last_undegraded":"2024-02-17T14:28:08.664990+0000","last_fullsized":"2024-02-17T14:28:08.664990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008900+0000","last_change":"2024-02-17T14:28:03.072793+0000","last_active":"2024-02-17T14:28:09.008900+0000","last_peered":"2024-02-17T14:28:09.008900+0000","last_clean":"2024-02-17T14:28:09.008900+0000","last_became_active":"2024-02-17T14:28:03.072497+0000","last_became_peered":"2024-02-17T14:28:03.072497+0000","last_unstale":"2024-02-17T14:28:09.008900+0000","last_undegraded":"2024-02-17T14:28:09.008900+0000","last_fullsized":"2024-02-17T14:28:09.008900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231646+0000","last_change":"2024-02-17T14:28:07.651730+0000","last_active":"2024-02-17T14:28:10.231646+0000","last_peered":"2024-02-17T14:28:10.231646+0000","last_clean":"2024-02-17T14:28:10.231646+0000","last_became_active":"2024-02-17T14:28:07.651144+0000","last_became_peered":"2024-02-17T14:28:07.651144+0000","last_unstale":"2024-02-17T14:28:10.231646+0000","last_undegraded":"2024-02-17T14:28:10.231646+0000","last_fullsized":"2024-02-17T14:28:10.231646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653784+0000","last_change":"2024-02-17T14:28:03.643461+0000","last_active":"2024-02-17T14:28:10.653784+0000","last_peered":"2024-02-17T14:28:10.653784+0000","last_clean":"2024-02-17T14:28:10.653784+0000","last_became_active":"2024-02-17T14:28:03.643033+0000","last_became_peered":"2024-02-17T14:28:03.643033+0000","last_unstale":"2024-02-17T14:28:10.653784+0000","last_undegraded":"2024-02-17T14:28:10.653784+0000","last_fullsized":"2024-02-17T14:28:10.653784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:01.946139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952270+0000","last_change":"2024-02-17T14:28:03.067046+0000","last_active":"2024-02-17T14:28:08.952270+0000","last_peered":"2024-02-17T14:28:08.952270+0000","last_clean":"2024-02-17T14:28:08.952270+0000","last_became_active":"2024-02-17T14:28:03.066797+0000","last_became_peered":"2024-02-17T14:28:03.066797+0000","last_unstale":"2024-02-17T14:28:08.952270+0000","last_undegraded":"2024-02-17T14:28:08.952270+0000","last_fullsized":"2024-02-17T14:28:08.952270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.663876+0000","last_change":"2024-02-17T14:28:07.850145+0000","last_active":"2024-02-17T14:28:08.663876+0000","last_peered":"2024-02-17T14:28:08.663876+0000","last_clean":"2024-02-17T14:28:08.663876+0000","last_became_active":"2024-02-17T14:28:07.849280+0000","last_became_peered":"2024-02-17T14:28:07.849280+0000","last_unstale":"2024-02-17T14:28:08.663876+0000","last_undegraded":"2024-02-17T14:28:08.663876+0000","last_fullsized":"2024-02-17T14:28:08.663876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653718+0000","last_change":"2024-02-17T14:28:03.641357+0000","last_active":"2024-02-17T14:28:10.653718+0000","last_peered":"2024-02-17T14:28:10.653718+0000","last_clean":"2024-02-17T14:28:10.653718+0000","last_became_active":"2024-02-17T14:28:03.640945+0000","last_became_peered":"2024-02-17T14:28:03.640945+0000","last_unstale":"2024-02-17T14:28:10.653718+0000","last_undegraded":"2024-02-17T14:28:10.653718+0000","last_fullsized":"2024-02-17T14:28:10.653718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664250+0000","last_change":"2024-02-17T14:28:03.066640+0000","last_active":"2024-02-17T14:28:08.664250+0000","last_peered":"2024-02-17T14:28:08.664250+0000","last_clean":"2024-02-17T14:28:08.664250+0000","last_became_active":"2024-02-17T14:28:03.066350+0000","last_became_peered":"2024-02-17T14:28:03.066350+0000","last_unstale":"2024-02-17T14:28:08.664250+0000","last_undegraded":"2024-02-17T14:28:08.664250+0000","last_fullsized":"2024-02-17T14:28:08.664250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:43.162911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665250+0000","last_change":"2024-02-17T14:28:07.652490+0000","last_active":"2024-02-17T14:28:08.665250+0000","last_peered":"2024-02-17T14:28:08.665250+0000","last_clean":"2024-02-17T14:28:08.665250+0000","last_became_active":"2024-02-17T14:28:07.652088+0000","last_became_peered":"2024-02-17T14:28:07.652088+0000","last_unstale":"2024-02-17T14:28:08.665250+0000","last_undegraded":"2024-02-17T14:28:08.665250+0000","last_fullsized":"2024-02-17T14:28:08.665250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:41.975941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653573+0000","last_change":"2024-02-17T14:28:03.641468+0000","last_active":"2024-02-17T14:28:10.653573+0000","last_peered":"2024-02-17T14:28:10.653573+0000","last_clean":"2024-02-17T14:28:10.653573+0000","last_became_active":"2024-02-17T14:28:03.640860+0000","last_became_peered":"2024-02-17T14:28:03.640860+0000","last_unstale":"2024-02-17T14:28:10.653573+0000","last_undegraded":"2024-02-17T14:28:10.653573+0000","last_fullsized":"2024-02-17T14:28:10.653573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.951937+0000","last_change":"2024-02-17T14:28:03.070146+0000","last_active":"2024-02-17T14:28:08.951937+0000","last_peered":"2024-02-17T14:28:08.951937+0000","last_clean":"2024-02-17T14:28:08.951937+0000","last_became_active":"2024-02-17T14:28:03.069867+0000","last_became_peered":"2024-02-17T14:28:03.069867+0000","last_unstale":"2024-02-17T14:28:08.951937+0000","last_undegraded":"2024-02-17T14:28:08.951937+0000","last_fullsized":"2024-02-17T14:28:08.951937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231421+0000","last_change":"2024-02-17T14:28:07.644792+0000","last_active":"2024-02-17T14:28:10.231421+0000","last_peered":"2024-02-17T14:28:10.231421+0000","last_clean":"2024-02-17T14:28:10.231421+0000","last_became_active":"2024-02-17T14:28:07.644452+0000","last_became_peered":"2024-02-17T14:28:07.644452+0000","last_unstale":"2024-02-17T14:28:10.231421+0000","last_undegraded":"2024-02-17T14:28:10.231421+0000","last_fullsized":"2024-02-17T14:28:10.231421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199598+0000","last_change":"2024-02-17T14:28:03.630962+0000","last_active":"2024-02-17T14:28:10.199598+0000","last_peered":"2024-02-17T14:28:10.199598+0000","last_clean":"2024-02-17T14:28:10.199598+0000","last_became_active":"2024-02-17T14:28:03.630239+0000","last_became_peered":"2024-02-17T14:28:03.630239+0000","last_unstale":"2024-02-17T14:28:10.199598+0000","last_undegraded":"2024-02-17T14:28:10.199598+0000","last_fullsized":"2024-02-17T14:28:10.199598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199658+0000","last_change":"2024-02-17T14:28:03.073091+0000","last_active":"2024-02-17T14:28:10.199658+0000","last_peered":"2024-02-17T14:28:10.199658+0000","last_clean":"2024-02-17T14:28:10.199658+0000","last_became_active":"2024-02-17T14:28:03.072801+0000","last_became_peered":"2024-02-17T14:28:03.072801+0000","last_unstale":"2024-02-17T14:28:10.199658+0000","last_undegraded":"2024-02-17T14:28:10.199658+0000","last_fullsized":"2024-02-17T14:28:10.199658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659664+0000","last_change":"2024-02-17T14:28:07.849362+0000","last_active":"2024-02-17T14:28:08.659664+0000","last_peered":"2024-02-17T14:28:08.659664+0000","last_clean":"2024-02-17T14:28:08.659664+0000","last_became_active":"2024-02-17T14:28:07.848991+0000","last_became_peered":"2024-02-17T14:28:07.848991+0000","last_unstale":"2024-02-17T14:28:08.659664+0000","last_undegraded":"2024-02-17T14:28:08.659664+0000","last_fullsized":"2024-02-17T14:28:08.659664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:52.959315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653518+0000","last_change":"2024-02-17T14:28:03.641810+0000","last_active":"2024-02-17T14:28:10.653518+0000","last_peered":"2024-02-17T14:28:10.653518+0000","last_clean":"2024-02-17T14:28:10.653518+0000","last_became_active":"2024-02-17T14:28:03.641501+0000","last_became_peered":"2024-02-17T14:28:03.641501+0000","last_unstale":"2024-02-17T14:28:10.653518+0000","last_undegraded":"2024-02-17T14:28:10.653518+0000","last_fullsized":"2024-02-17T14:28:10.653518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664665+0000","last_change":"2024-02-17T14:28:03.066989+0000","last_active":"2024-02-17T14:28:08.664665+0000","last_peered":"2024-02-17T14:28:08.664665+0000","last_clean":"2024-02-17T14:28:08.664665+0000","last_became_active":"2024-02-17T14:28:03.066538+0000","last_became_peered":"2024-02-17T14:28:03.066538+0000","last_unstale":"2024-02-17T14:28:08.664665+0000","last_undegraded":"2024-02-17T14:28:08.664665+0000","last_fullsized":"2024-02-17T14:28:08.664665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659889+0000","last_change":"2024-02-17T14:28:07.846885+0000","last_active":"2024-02-17T14:28:08.659889+0000","last_peered":"2024-02-17T14:28:08.659889+0000","last_clean":"2024-02-17T14:28:08.659889+0000","last_became_active":"2024-02-17T14:28:07.846413+0000","last_became_peered":"2024-02-17T14:28:07.846413+0000","last_unstale":"2024-02-17T14:28:08.659889+0000","last_undegraded":"2024-02-17T14:28:08.659889+0000","last_fullsized":"2024-02-17T14:28:08.659889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:00.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231324+0000","last_change":"2024-02-17T14:28:03.638054+0000","last_active":"2024-02-17T14:28:10.231324+0000","last_peered":"2024-02-17T14:28:10.231324+0000","last_clean":"2024-02-17T14:28:10.231324+0000","last_became_active":"2024-02-17T14:28:03.637831+0000","last_became_peered":"2024-02-17T14:28:03.637831+0000","last_unstale":"2024-02-17T14:28:10.231324+0000","last_undegraded":"2024-02-17T14:28:10.231324+0000","last_fullsized":"2024-02-17T14:28:10.231324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:11:23.521059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231733+0000","last_change":"2024-02-17T14:28:03.064510+0000","last_active":"2024-02-17T14:28:10.231733+0000","last_peered":"2024-02-17T14:28:10.231733+0000","last_clean":"2024-02-17T14:28:10.231733+0000","last_became_active":"2024-02-17T14:28:03.064226+0000","last_became_peered":"2024-02-17T14:28:03.064226+0000","last_unstale":"2024-02-17T14:28:10.231733+0000","last_undegraded":"2024-02-17T14:28:10.231733+0000","last_fullsized":"2024-02-17T14:28:10.231733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:26:19.467344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.666011+0000","last_change":"2024-02-17T14:28:07.849775+0000","last_active":"2024-02-17T14:28:08.666011+0000","last_peered":"2024-02-17T14:28:08.666011+0000","last_clean":"2024-02-17T14:28:08.666011+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:08.666011+0000","last_undegraded":"2024-02-17T14:28:08.666011+0000","last_fullsized":"2024-02-17T14:28:08.666011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653418+0000","last_change":"2024-02-17T14:28:03.642582+0000","last_active":"2024-02-17T14:28:10.653418+0000","last_peered":"2024-02-17T14:28:10.653418+0000","last_clean":"2024-02-17T14:28:10.653418+0000","last_became_active":"2024-02-17T14:28:03.642077+0000","last_became_peered":"2024-02-17T14:28:03.642077+0000","last_unstale":"2024-02-17T14:28:10.653418+0000","last_undegraded":"2024-02-17T14:28:10.653418+0000","last_fullsized":"2024-02-17T14:28:10.653418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:12.644402+0000","last_change":"2024-02-17T14:28:03.071791+0000","last_active":"2024-02-17T14:28:12.644402+0000","last_peered":"2024-02-17T14:28:12.644402+0000","last_clean":"2024-02-17T14:28:12.644402+0000","last_became_active":"2024-02-17T14:28:03.071303+0000","last_became_peered":"2024-02-17T14:28:03.071303+0000","last_unstale":"2024-02-17T14:28:12.644402+0000","last_undegraded":"2024-02-17T14:28:12.644402+0000","last_fullsized":"2024-02-17T14:28:12.644402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008512+0000","last_change":"2024-02-17T14:28:07.649531+0000","last_active":"2024-02-17T14:28:09.008512+0000","last_peered":"2024-02-17T14:28:09.008512+0000","last_clean":"2024-02-17T14:28:09.008512+0000","last_became_active":"2024-02-17T14:28:07.645313+0000","last_became_peered":"2024-02-17T14:28:07.645313+0000","last_unstale":"2024-02-17T14:28:09.008512+0000","last_undegraded":"2024-02-17T14:28:09.008512+0000","last_fullsized":"2024-02-17T14:28:09.008512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664873+0000","last_change":"2024-02-17T14:28:03.638812+0000","last_active":"2024-02-17T14:28:08.664873+0000","last_peered":"2024-02-17T14:28:08.664873+0000","last_clean":"2024-02-17T14:28:08.664873+0000","last_became_active":"2024-02-17T14:28:03.637937+0000","last_became_peered":"2024-02-17T14:28:03.637937+0000","last_unstale":"2024-02-17T14:28:08.664873+0000","last_undegraded":"2024-02-17T14:28:08.664873+0000","last_fullsized":"2024-02-17T14:28:08.664873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008758+0000","last_change":"2024-02-17T14:28:03.069972+0000","last_active":"2024-02-17T14:28:09.008758+0000","last_peered":"2024-02-17T14:28:09.008758+0000","last_clean":"2024-02-17T14:28:09.008758+0000","last_became_active":"2024-02-17T14:28:03.069690+0000","last_became_peered":"2024-02-17T14:28:03.069690+0000","last_unstale":"2024-02-17T14:28:09.008758+0000","last_undegraded":"2024-02-17T14:28:09.008758+0000","last_fullsized":"2024-02-17T14:28:09.008758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665294+0000","last_change":"2024-02-17T14:28:07.647825+0000","last_active":"2024-02-17T14:28:08.665294+0000","last_peered":"2024-02-17T14:28:08.665294+0000","last_clean":"2024-02-17T14:28:08.665294+0000","last_became_active":"2024-02-17T14:28:07.647420+0000","last_became_peered":"2024-02-17T14:28:07.647420+0000","last_unstale":"2024-02-17T14:28:08.665294+0000","last_undegraded":"2024-02-17T14:28:08.665294+0000","last_fullsized":"2024-02-17T14:28:08.665294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231519+0000","last_change":"2024-02-17T14:28:03.631000+0000","last_active":"2024-02-17T14:28:10.231519+0000","last_peered":"2024-02-17T14:28:10.231519+0000","last_clean":"2024-02-17T14:28:10.231519+0000","last_became_active":"2024-02-17T14:28:03.630169+0000","last_became_peered":"2024-02-17T14:28:03.630169+0000","last_unstale":"2024-02-17T14:28:10.231519+0000","last_undegraded":"2024-02-17T14:28:10.231519+0000","last_fullsized":"2024-02-17T14:28:10.231519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665258+0000","last_change":"2024-02-17T14:28:03.069911+0000","last_active":"2024-02-17T14:28:08.665258+0000","last_peered":"2024-02-17T14:28:08.665258+0000","last_clean":"2024-02-17T14:28:08.665258+0000","last_became_active":"2024-02-17T14:28:03.069617+0000","last_became_peered":"2024-02-17T14:28:03.069617+0000","last_unstale":"2024-02-17T14:28:08.665258+0000","last_undegraded":"2024-02-17T14:28:08.665258+0000","last_fullsized":"2024-02-17T14:28:08.665258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659211+0000","last_change":"2024-02-17T14:28:07.646742+0000","last_active":"2024-02-17T14:28:08.659211+0000","last_peered":"2024-02-17T14:28:08.659211+0000","last_clean":"2024-02-17T14:28:08.659211+0000","last_became_active":"2024-02-17T14:28:07.646403+0000","last_became_peered":"2024-02-17T14:28:07.646403+0000","last_unstale":"2024-02-17T14:28:08.659211+0000","last_undegraded":"2024-02-17T14:28:08.659211+0000","last_fullsized":"2024-02-17T14:28:08.659211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665170+0000","last_change":"2024-02-17T14:28:03.638522+0000","last_active":"2024-02-17T14:28:08.665170+0000","last_peered":"2024-02-17T14:28:08.665170+0000","last_clean":"2024-02-17T14:28:08.665170+0000","last_became_active":"2024-02-17T14:28:03.638281+0000","last_became_peered":"2024-02-17T14:28:03.638281+0000","last_unstale":"2024-02-17T14:28:08.665170+0000","last_undegraded":"2024-02-17T14:28:08.665170+0000","last_fullsized":"2024-02-17T14:28:08.665170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200162+0000","last_change":"2024-02-17T14:28:03.072855+0000","last_active":"2024-02-17T14:28:10.200162+0000","last_peered":"2024-02-17T14:28:10.200162+0000","last_clean":"2024-02-17T14:28:10.200162+0000","last_became_active":"2024-02-17T14:28:03.072571+0000","last_became_peered":"2024-02-17T14:28:03.072571+0000","last_unstale":"2024-02-17T14:28:10.200162+0000","last_undegraded":"2024-02-17T14:28:10.200162+0000","last_fullsized":"2024-02-17T14:28:10.200162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659178+0000","last_change":"2024-02-17T14:28:07.849448+0000","last_active":"2024-02-17T14:28:08.659178+0000","last_peered":"2024-02-17T14:28:08.659178+0000","last_clean":"2024-02-17T14:28:08.659178+0000","last_became_active":"2024-02-17T14:28:07.849096+0000","last_became_peered":"2024-02-17T14:28:07.849096+0000","last_unstale":"2024-02-17T14:28:08.659178+0000","last_undegraded":"2024-02-17T14:28:08.659178+0000","last_fullsized":"2024-02-17T14:28:08.659178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231420+0000","last_change":"2024-02-17T14:28:07.849485+0000","last_active":"2024-02-17T14:28:10.231420+0000","last_peered":"2024-02-17T14:28:10.231420+0000","last_clean":"2024-02-17T14:28:10.231420+0000","last_became_active":"2024-02-17T14:28:07.849053+0000","last_became_peered":"2024-02-17T14:28:07.849053+0000","last_unstale":"2024-02-17T14:28:10.231420+0000","last_undegraded":"2024-02-17T14:28:10.231420+0000","last_fullsized":"2024-02-17T14:28:10.231420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008242+0000","last_change":"2024-02-17T14:28:03.632467+0000","last_active":"2024-02-17T14:28:09.008242+0000","last_peered":"2024-02-17T14:28:09.008242+0000","last_clean":"2024-02-17T14:28:09.008242+0000","last_became_active":"2024-02-17T14:28:03.632204+0000","last_became_peered":"2024-02-17T14:28:03.632204+0000","last_unstale":"2024-02-17T14:28:09.008242+0000","last_undegraded":"2024-02-17T14:28:09.008242+0000","last_fullsized":"2024-02-17T14:28:09.008242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664021+0000","last_change":"2024-02-17T14:28:03.062682+0000","last_active":"2024-02-17T14:28:08.664021+0000","last_peered":"2024-02-17T14:28:08.664021+0000","last_clean":"2024-02-17T14:28:08.664021+0000","last_became_active":"2024-02-17T14:28:03.062390+0000","last_became_peered":"2024-02-17T14:28:03.062390+0000","last_unstale":"2024-02-17T14:28:08.664021+0000","last_undegraded":"2024-02-17T14:28:08.664021+0000","last_fullsized":"2024-02-17T14:28:08.664021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200129+0000","last_change":"2024-02-17T14:28:07.651004+0000","last_active":"2024-02-17T14:28:10.200129+0000","last_peered":"2024-02-17T14:28:10.200129+0000","last_clean":"2024-02-17T14:28:10.200129+0000","last_became_active":"2024-02-17T14:28:07.650627+0000","last_became_peered":"2024-02-17T14:28:07.650627+0000","last_unstale":"2024-02-17T14:28:10.200129+0000","last_undegraded":"2024-02-17T14:28:10.200129+0000","last_fullsized":"2024-02-17T14:28:10.200129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659217+0000","last_change":"2024-02-17T14:28:03.627978+0000","last_active":"2024-02-17T14:28:08.659217+0000","last_peered":"2024-02-17T14:28:08.659217+0000","last_clean":"2024-02-17T14:28:08.659217+0000","last_became_active":"2024-02-17T14:28:03.627708+0000","last_became_peered":"2024-02-17T14:28:03.627708+0000","last_unstale":"2024-02-17T14:28:08.659217+0000","last_undegraded":"2024-02-17T14:28:08.659217+0000","last_fullsized":"2024-02-17T14:28:08.659217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659359+0000","last_change":"2024-02-17T14:28:03.071479+0000","last_active":"2024-02-17T14:28:08.659359+0000","last_peered":"2024-02-17T14:28:08.659359+0000","last_clean":"2024-02-17T14:28:08.659359+0000","last_became_active":"2024-02-17T14:28:03.071170+0000","last_became_peered":"2024-02-17T14:28:03.071170+0000","last_unstale":"2024-02-17T14:28:08.659359+0000","last_undegraded":"2024-02-17T14:28:08.659359+0000","last_fullsized":"2024-02-17T14:28:08.659359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:03:44.733125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199746+0000","last_change":"2024-02-17T14:28:03.073225+0000","last_active":"2024-02-17T14:28:10.199746+0000","last_peered":"2024-02-17T14:28:10.199746+0000","last_clean":"2024-02-17T14:28:10.199746+0000","last_became_active":"2024-02-17T14:28:03.072928+0000","last_became_peered":"2024-02-17T14:28:03.072928+0000","last_unstale":"2024-02-17T14:28:10.199746+0000","last_undegraded":"2024-02-17T14:28:10.199746+0000","last_fullsized":"2024-02-17T14:28:10.199746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231675+0000","last_change":"2024-02-17T14:28:03.635534+0000","last_active":"2024-02-17T14:28:10.231675+0000","last_peered":"2024-02-17T14:28:10.231675+0000","last_clean":"2024-02-17T14:28:10.231675+0000","last_became_active":"2024-02-17T14:28:03.635362+0000","last_became_peered":"2024-02-17T14:28:03.635362+0000","last_unstale":"2024-02-17T14:28:10.231675+0000","last_undegraded":"2024-02-17T14:28:10.231675+0000","last_fullsized":"2024-02-17T14:28:10.231675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952161+0000","last_change":"2024-02-17T14:28:07.645087+0000","last_active":"2024-02-17T14:28:08.952161+0000","last_peered":"2024-02-17T14:28:08.952161+0000","last_clean":"2024-02-17T14:28:08.952161+0000","last_became_active":"2024-02-17T14:28:07.644637+0000","last_became_peered":"2024-02-17T14:28:07.644637+0000","last_unstale":"2024-02-17T14:28:08.952161+0000","last_undegraded":"2024-02-17T14:28:08.952161+0000","last_fullsized":"2024-02-17T14:28:08.952161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:39.175950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659718+0000","last_change":"2024-02-17T14:28:03.072162+0000","last_active":"2024-02-17T14:28:08.659718+0000","last_peered":"2024-02-17T14:28:08.659718+0000","last_clean":"2024-02-17T14:28:08.659718+0000","last_became_active":"2024-02-17T14:28:03.071112+0000","last_became_peered":"2024-02-17T14:28:03.071112+0000","last_unstale":"2024-02-17T14:28:08.659718+0000","last_undegraded":"2024-02-17T14:28:08.659718+0000","last_fullsized":"2024-02-17T14:28:08.659718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665058+0000","last_change":"2024-02-17T14:28:03.628403+0000","last_active":"2024-02-17T14:28:08.665058+0000","last_peered":"2024-02-17T14:28:08.665058+0000","last_clean":"2024-02-17T14:28:08.665058+0000","last_became_active":"2024-02-17T14:28:03.628144+0000","last_became_peered":"2024-02-17T14:28:03.628144+0000","last_unstale":"2024-02-17T14:28:08.665058+0000","last_undegraded":"2024-02-17T14:28:08.665058+0000","last_fullsized":"2024-02-17T14:28:08.665058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:01.247136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659662+0000","last_change":"2024-02-17T14:28:07.648376+0000","last_active":"2024-02-17T14:28:08.659662+0000","last_peered":"2024-02-17T14:28:08.659662+0000","last_clean":"2024-02-17T14:28:08.659662+0000","last_became_active":"2024-02-17T14:28:07.647491+0000","last_became_peered":"2024-02-17T14:28:07.647491+0000","last_unstale":"2024-02-17T14:28:08.659662+0000","last_undegraded":"2024-02-17T14:28:08.659662+0000","last_fullsized":"2024-02-17T14:28:08.659662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:12.810441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199485+0000","last_change":"2024-02-17T14:28:03.631191+0000","last_active":"2024-02-17T14:28:10.199485+0000","last_peered":"2024-02-17T14:28:10.199485+0000","last_clean":"2024-02-17T14:28:10.199485+0000","last_became_active":"2024-02-17T14:28:03.630662+0000","last_became_peered":"2024-02-17T14:28:03.630662+0000","last_unstale":"2024-02-17T14:28:10.199485+0000","last_undegraded":"2024-02-17T14:28:10.199485+0000","last_fullsized":"2024-02-17T14:28:10.199485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952028+0000","last_change":"2024-02-17T14:28:03.629028+0000","last_active":"2024-02-17T14:28:08.952028+0000","last_peered":"2024-02-17T14:28:08.952028+0000","last_clean":"2024-02-17T14:28:08.952028+0000","last_became_active":"2024-02-17T14:28:03.628781+0000","last_became_peered":"2024-02-17T14:28:03.628781+0000","last_unstale":"2024-02-17T14:28:08.952028+0000","last_undegraded":"2024-02-17T14:28:08.952028+0000","last_fullsized":"2024-02-17T14:28:08.952028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664578+0000","last_change":"2024-02-17T14:28:03.633531+0000","last_active":"2024-02-17T14:28:08.664578+0000","last_peered":"2024-02-17T14:28:08.664578+0000","last_clean":"2024-02-17T14:28:08.664578+0000","last_became_active":"2024-02-17T14:28:03.633248+0000","last_became_peered":"2024-02-17T14:28:03.633248+0000","last_unstale":"2024-02-17T14:28:08.664578+0000","last_undegraded":"2024-02-17T14:28:08.664578+0000","last_fullsized":"2024-02-17T14:28:08.664578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231592+0000","last_change":"2024-02-17T14:28:03.627122+0000","last_active":"2024-02-17T14:28:10.231592+0000","last_peered":"2024-02-17T14:28:10.231592+0000","last_clean":"2024-02-17T14:28:10.231592+0000","last_became_active":"2024-02-17T14:28:03.626738+0000","last_became_peered":"2024-02-17T14:28:03.626738+0000","last_unstale":"2024-02-17T14:28:10.231592+0000","last_undegraded":"2024-02-17T14:28:10.231592+0000","last_fullsized":"2024-02-17T14:28:10.231592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659986+0000","last_change":"2024-02-17T14:28:03.631182+0000","last_active":"2024-02-17T14:28:08.659986+0000","last_peered":"2024-02-17T14:28:08.659986+0000","last_clean":"2024-02-17T14:28:08.659986+0000","last_became_active":"2024-02-17T14:28:03.630705+0000","last_became_peered":"2024-02-17T14:28:03.630705+0000","last_unstale":"2024-02-17T14:28:08.659986+0000","last_undegraded":"2024-02-17T14:28:08.659986+0000","last_fullsized":"2024-02-17T14:28:08.659986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008574+0000","last_change":"2024-02-17T14:28:03.631731+0000","last_active":"2024-02-17T14:28:09.008574+0000","last_peered":"2024-02-17T14:28:09.008574+0000","last_clean":"2024-02-17T14:28:09.008574+0000","last_became_active":"2024-02-17T14:28:03.631476+0000","last_became_peered":"2024-02-17T14:28:03.631476+0000","last_unstale":"2024-02-17T14:28:09.008574+0000","last_undegraded":"2024-02-17T14:28:09.008574+0000","last_fullsized":"2024-02-17T14:28:09.008574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200191+0000","last_change":"2024-02-17T14:28:03.638716+0000","last_active":"2024-02-17T14:28:10.200191+0000","last_peered":"2024-02-17T14:28:10.200191+0000","last_clean":"2024-02-17T14:28:10.200191+0000","last_became_active":"2024-02-17T14:28:03.638442+0000","last_became_peered":"2024-02-17T14:28:03.638442+0000","last_unstale":"2024-02-17T14:28:10.200191+0000","last_undegraded":"2024-02-17T14:28:10.200191+0000","last_fullsized":"2024-02-17T14:28:10.200191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659705+0000","last_change":"2024-02-17T14:28:03.630945+0000","last_active":"2024-02-17T14:28:08.659705+0000","last_peered":"2024-02-17T14:28:08.659705+0000","last_clean":"2024-02-17T14:28:08.659705+0000","last_became_active":"2024-02-17T14:28:03.630676+0000","last_became_peered":"2024-02-17T14:28:03.630676+0000","last_unstale":"2024-02-17T14:28:08.659705+0000","last_undegraded":"2024-02-17T14:28:08.659705+0000","last_fullsized":"2024-02-17T14:28:08.659705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664109+0000","last_change":"2024-02-17T14:28:03.627202+0000","last_active":"2024-02-17T14:28:08.664109+0000","last_peered":"2024-02-17T14:28:08.664109+0000","last_clean":"2024-02-17T14:28:08.664109+0000","last_became_active":"2024-02-17T14:28:03.626848+0000","last_became_peered":"2024-02-17T14:28:03.626848+0000","last_unstale":"2024-02-17T14:28:08.664109+0000","last_undegraded":"2024-02-17T14:28:08.664109+0000","last_fullsized":"2024-02-17T14:28:08.664109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659335+0000","last_change":"2024-02-17T14:28:03.627493+0000","last_active":"2024-02-17T14:28:08.659335+0000","last_peered":"2024-02-17T14:28:08.659335+0000","last_clean":"2024-02-17T14:28:08.659335+0000","last_became_active":"2024-02-17T14:28:03.626450+0000","last_became_peered":"2024-02-17T14:28:03.626450+0000","last_unstale":"2024-02-17T14:28:08.659335+0000","last_undegraded":"2024-02-17T14:28:08.659335+0000","last_fullsized":"2024-02-17T14:28:08.659335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664490+0000","last_change":"2024-02-17T14:28:03.639610+0000","last_active":"2024-02-17T14:28:08.664490+0000","last_peered":"2024-02-17T14:28:08.664490+0000","last_clean":"2024-02-17T14:28:08.664490+0000","last_became_active":"2024-02-17T14:28:03.639330+0000","last_became_peered":"2024-02-17T14:28:03.639330+0000","last_unstale":"2024-02-17T14:28:08.664490+0000","last_undegraded":"2024-02-17T14:28:08.664490+0000","last_fullsized":"2024-02-17T14:28:08.664490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231482+0000","last_change":"2024-02-17T14:28:03.641774+0000","last_active":"2024-02-17T14:28:10.231482+0000","last_peered":"2024-02-17T14:28:10.231482+0000","last_clean":"2024-02-17T14:28:10.231482+0000","last_became_active":"2024-02-17T14:28:03.641485+0000","last_became_peered":"2024-02-17T14:28:03.641485+0000","last_unstale":"2024-02-17T14:28:10.231482+0000","last_undegraded":"2024-02-17T14:28:10.231482+0000","last_fullsized":"2024-02-17T14:28:10.231482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199910+0000","last_change":"2024-02-17T14:28:03.630129+0000","last_active":"2024-02-17T14:28:10.199910+0000","last_peered":"2024-02-17T14:28:10.199910+0000","last_clean":"2024-02-17T14:28:10.199910+0000","last_became_active":"2024-02-17T14:28:03.629841+0000","last_became_peered":"2024-02-17T14:28:03.629841+0000","last_unstale":"2024-02-17T14:28:10.199910+0000","last_undegraded":"2024-02-17T14:28:10.199910+0000","last_fullsized":"2024-02-17T14:28:10.199910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653773+0000","last_change":"2024-02-17T14:28:03.642676+0000","last_active":"2024-02-17T14:28:10.653773+0000","last_peered":"2024-02-17T14:28:10.653773+0000","last_clean":"2024-02-17T14:28:10.653773+0000","last_became_active":"2024-02-17T14:28:03.642150+0000","last_became_peered":"2024-02-17T14:28:03.642150+0000","last_unstale":"2024-02-17T14:28:10.653773+0000","last_undegraded":"2024-02-17T14:28:10.653773+0000","last_fullsized":"2024-02-17T14:28:10.653773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952216+0000","last_change":"2024-02-17T14:28:03.632127+0000","last_active":"2024-02-17T14:28:08.952216+0000","last_peered":"2024-02-17T14:28:08.952216+0000","last_clean":"2024-02-17T14:28:08.952216+0000","last_became_active":"2024-02-17T14:28:03.631844+0000","last_became_peered":"2024-02-17T14:28:03.631844+0000","last_unstale":"2024-02-17T14:28:08.952216+0000","last_undegraded":"2024-02-17T14:28:08.952216+0000","last_fullsized":"2024-02-17T14:28:08.952216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:07.756422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665733+0000","last_change":"2024-02-17T14:28:03.638703+0000","last_active":"2024-02-17T14:28:08.665733+0000","last_peered":"2024-02-17T14:28:08.665733+0000","last_clean":"2024-02-17T14:28:08.665733+0000","last_became_active":"2024-02-17T14:28:03.638427+0000","last_became_peered":"2024-02-17T14:28:03.638427+0000","last_unstale":"2024-02-17T14:28:08.665733+0000","last_undegraded":"2024-02-17T14:28:08.665733+0000","last_fullsized":"2024-02-17T14:28:08.665733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.663890+0000","last_change":"2024-02-17T14:28:03.628626+0000","last_active":"2024-02-17T14:28:08.663890+0000","last_peered":"2024-02-17T14:28:08.663890+0000","last_clean":"2024-02-17T14:28:08.663890+0000","last_became_active":"2024-02-17T14:28:03.628343+0000","last_became_peered":"2024-02-17T14:28:03.628343+0000","last_unstale":"2024-02-17T14:28:08.663890+0000","last_undegraded":"2024-02-17T14:28:08.663890+0000","last_fullsized":"2024-02-17T14:28:08.663890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008316+0000","last_change":"2024-02-17T14:28:03.635610+0000","last_active":"2024-02-17T14:28:09.008316+0000","last_peered":"2024-02-17T14:28:09.008316+0000","last_clean":"2024-02-17T14:28:09.008316+0000","last_became_active":"2024-02-17T14:28:03.635340+0000","last_became_peered":"2024-02-17T14:28:03.635340+0000","last_unstale":"2024-02-17T14:28:09.008316+0000","last_undegraded":"2024-02-17T14:28:09.008316+0000","last_fullsized":"2024-02-17T14:28:09.008316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231274+0000","last_change":"2024-02-17T14:28:03.632540+0000","last_active":"2024-02-17T14:28:10.231274+0000","last_peered":"2024-02-17T14:28:10.231274+0000","last_clean":"2024-02-17T14:28:10.231274+0000","last_became_active":"2024-02-17T14:28:03.632273+0000","last_became_peered":"2024-02-17T14:28:03.632273+0000","last_unstale":"2024-02-17T14:28:10.231274+0000","last_undegraded":"2024-02-17T14:28:10.231274+0000","last_fullsized":"2024-02-17T14:28:10.231274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:35.598281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659538+0000","last_change":"2024-02-17T14:28:03.631678+0000","last_active":"2024-02-17T14:28:08.659538+0000","last_peered":"2024-02-17T14:28:08.659538+0000","last_clean":"2024-02-17T14:28:08.659538+0000","last_became_active":"2024-02-17T14:28:03.631431+0000","last_became_peered":"2024-02-17T14:28:03.631431+0000","last_unstale":"2024-02-17T14:28:08.659538+0000","last_undegraded":"2024-02-17T14:28:08.659538+0000","last_fullsized":"2024-02-17T14:28:08.659538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664773+0000","last_change":"2024-02-17T14:28:03.631661+0000","last_active":"2024-02-17T14:28:08.664773+0000","last_peered":"2024-02-17T14:28:08.664773+0000","last_clean":"2024-02-17T14:28:08.664773+0000","last_became_active":"2024-02-17T14:28:03.631379+0000","last_became_peered":"2024-02-17T14:28:03.631379+0000","last_unstale":"2024-02-17T14:28:08.664773+0000","last_undegraded":"2024-02-17T14:28:08.664773+0000","last_fullsized":"2024-02-17T14:28:08.664773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:03.242976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199968+0000","last_change":"2024-02-17T14:28:03.635522+0000","last_active":"2024-02-17T14:28:10.199968+0000","last_peered":"2024-02-17T14:28:10.199968+0000","last_clean":"2024-02-17T14:28:10.199968+0000","last_became_active":"2024-02-17T14:28:03.635254+0000","last_became_peered":"2024-02-17T14:28:03.635254+0000","last_unstale":"2024-02-17T14:28:10.199968+0000","last_undegraded":"2024-02-17T14:28:10.199968+0000","last_fullsized":"2024-02-17T14:28:10.199968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200179+0000","last_change":"2024-02-17T14:28:03.635588+0000","last_active":"2024-02-17T14:28:10.200179+0000","last_peered":"2024-02-17T14:28:10.200179+0000","last_clean":"2024-02-17T14:28:10.200179+0000","last_became_active":"2024-02-17T14:28:03.635312+0000","last_became_peered":"2024-02-17T14:28:03.635312+0000","last_unstale":"2024-02-17T14:28:10.200179+0000","last_undegraded":"2024-02-17T14:28:10.200179+0000","last_fullsized":"2024-02-17T14:28:10.200179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653775+0000","last_change":"2024-02-17T14:28:03.646624+0000","last_active":"2024-02-17T14:28:10.653775+0000","last_peered":"2024-02-17T14:28:10.653775+0000","last_clean":"2024-02-17T14:28:10.653775+0000","last_became_active":"2024-02-17T14:28:03.646337+0000","last_became_peered":"2024-02-17T14:28:03.646337+0000","last_unstale":"2024-02-17T14:28:10.653775+0000","last_undegraded":"2024-02-17T14:28:10.653775+0000","last_fullsized":"2024-02-17T14:28:10.653775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:10.836577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659106+0000","last_change":"2024-02-17T14:28:03.635018+0000","last_active":"2024-02-17T14:28:08.659106+0000","last_peered":"2024-02-17T14:28:08.659106+0000","last_clean":"2024-02-17T14:28:08.659106+0000","last_became_active":"2024-02-17T14:28:03.634751+0000","last_became_peered":"2024-02-17T14:28:03.634751+0000","last_unstale":"2024-02-17T14:28:08.659106+0000","last_undegraded":"2024-02-17T14:28:08.659106+0000","last_fullsized":"2024-02-17T14:28:08.659106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653292+0000","last_change":"2024-02-17T14:28:03.641708+0000","last_active":"2024-02-17T14:28:10.653292+0000","last_peered":"2024-02-17T14:28:10.653292+0000","last_clean":"2024-02-17T14:28:10.653292+0000","last_became_active":"2024-02-17T14:28:03.641260+0000","last_became_peered":"2024-02-17T14:28:03.641260+0000","last_unstale":"2024-02-17T14:28:10.653292+0000","last_undegraded":"2024-02-17T14:28:10.653292+0000","last_fullsized":"2024-02-17T14:28:10.653292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664400+0000","last_change":"2024-02-17T14:28:03.628239+0000","last_active":"2024-02-17T14:28:08.664400+0000","last_peered":"2024-02-17T14:28:08.664400+0000","last_clean":"2024-02-17T14:28:08.664400+0000","last_became_active":"2024-02-17T14:28:03.627918+0000","last_became_peered":"2024-02-17T14:28:03.627918+0000","last_unstale":"2024-02-17T14:28:08.664400+0000","last_undegraded":"2024-02-17T14:28:08.664400+0000","last_fullsized":"2024-02-17T14:28:08.664400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653391+0000","last_change":"2024-02-17T14:28:03.641192+0000","last_active":"2024-02-17T14:28:10.653391+0000","last_peered":"2024-02-17T14:28:10.653391+0000","last_clean":"2024-02-17T14:28:10.653391+0000","last_became_active":"2024-02-17T14:28:03.640873+0000","last_became_peered":"2024-02-17T14:28:03.640873+0000","last_unstale":"2024-02-17T14:28:10.653391+0000","last_undegraded":"2024-02-17T14:28:10.653391+0000","last_fullsized":"2024-02-17T14:28:10.653391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664766+0000","last_change":"2024-02-17T14:28:03.634770+0000","last_active":"2024-02-17T14:28:08.664766+0000","last_peered":"2024-02-17T14:28:08.664766+0000","last_clean":"2024-02-17T14:28:08.664766+0000","last_became_active":"2024-02-17T14:28:03.634397+0000","last_became_peered":"2024-02-17T14:28:03.634397+0000","last_unstale":"2024-02-17T14:28:08.664766+0000","last_undegraded":"2024-02-17T14:28:08.664766+0000","last_fullsized":"2024-02-17T14:28:08.664766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:38.398272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231407+0000","last_change":"2024-02-17T14:28:03.628223+0000","last_active":"2024-02-17T14:28:10.231407+0000","last_peered":"2024-02-17T14:28:10.231407+0000","last_clean":"2024-02-17T14:28:10.231407+0000","last_became_active":"2024-02-17T14:28:03.627978+0000","last_became_peered":"2024-02-17T14:28:03.627978+0000","last_unstale":"2024-02-17T14:28:10.231407+0000","last_undegraded":"2024-02-17T14:28:10.231407+0000","last_fullsized":"2024-02-17T14:28:10.231407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008914+0000","last_change":"2024-02-17T14:28:03.631742+0000","last_active":"2024-02-17T14:28:09.008914+0000","last_peered":"2024-02-17T14:28:09.008914+0000","last_clean":"2024-02-17T14:28:09.008914+0000","last_became_active":"2024-02-17T14:28:03.631493+0000","last_became_peered":"2024-02-17T14:28:03.631493+0000","last_unstale":"2024-02-17T14:28:09.008914+0000","last_undegraded":"2024-02-17T14:28:09.008914+0000","last_fullsized":"2024-02-17T14:28:09.008914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653565+0000","last_change":"2024-02-17T14:28:03.641525+0000","last_active":"2024-02-17T14:28:10.653565+0000","last_peered":"2024-02-17T14:28:10.653565+0000","last_clean":"2024-02-17T14:28:10.653565+0000","last_became_active":"2024-02-17T14:28:03.641154+0000","last_became_peered":"2024-02-17T14:28:03.641154+0000","last_unstale":"2024-02-17T14:28:10.653565+0000","last_undegraded":"2024-02-17T14:28:10.653565+0000","last_fullsized":"2024-02-17T14:28:10.653565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":695877,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":695933,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T14:28:29.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T14:28:30.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.125+0000 7fce6af65640 1 Processor -- start 2024-02-17T14:28:30.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.125+0000 7fce6af65640 1 -- start start 2024-02-17T14:28:30.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.125+0000 7fce6af65640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fce640b5020 0x7fce64144c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.125+0000 7fce6af65640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fce64145170 0x7fce64071940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.125+0000 7fce6af65640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce640714b0 con 0x7fce64071e80 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.125+0000 7fce6af65640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce640b5eb0 con 0x7fce64145170 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.125+0000 7fce6af65640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce640722f0 con 0x7fce640b5020 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.125+0000 7fce63fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fce64145170 0x7fce64071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.125+0000 7fce63fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fce64145170 0x7fce64071940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46510/0 (socket says 172.21.15.134:46510) 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.125+0000 7fce63fff640 1 -- 172.21.15.134:0/2970090868 learned_addr learned my addr 172.21.15.134:0/2970090868 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.125+0000 7fce68d01640 1 --2- 172.21.15.134:0/2970090868 >> v2:172.21.15.142:3300/0 conn(0x7fce640b5020 0x7fce64144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.126+0000 7fce63fff640 1 -- 172.21.15.134:0/2970090868 >> v2:172.21.15.142:3300/0 conn(0x7fce640b5020 msgr2=0x7fce64144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.126+0000 7fce63fff640 1 --2- 172.21.15.134:0/2970090868 >> v2:172.21.15.142:3300/0 conn(0x7fce640b5020 0x7fce64144c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.126+0000 7fce63fff640 1 -- 172.21.15.134:0/2970090868 >> v1:172.21.15.142:6789/0 conn(0x7fce64071e80 legacy=0x7fce640b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.126+0000 7fce63fff640 1 -- 172.21.15.134:0/2970090868 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce640b5400 con 0x7fce64145170 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.126+0000 7fce63fff640 1 --2- 172.21.15.134:0/2970090868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce64145170 0x7fce64071940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fce640b6d10 tx=0x7fce4c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6a98f8a31b888 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.126+0000 7fce637fe640 1 -- 172.21.15.134:0/2970090868 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c0317e0 con 0x7fce64145170 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.126+0000 7fce637fe640 1 -- 172.21.15.134:0/2970090868 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c031940 con 0x7fce64145170 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.127+0000 7fce637fe640 1 -- 172.21.15.134:0/2970090868 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c031cd0 con 0x7fce64145170 2024-02-17T14:28:30.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.127+0000 7fce6af65640 1 -- 172.21.15.134:0/2970090868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce64145170 msgr2=0x7fce64071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.127+0000 7fce6af65640 1 --2- 172.21.15.134:0/2970090868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce64145170 0x7fce64071940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fce640b6d10 tx=0x7fce4c02b880 comp rx=0 tx=0).stop 2024-02-17T14:28:30.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.127+0000 7fce6af65640 1 -- 172.21.15.134:0/2970090868 shutdown_connections 2024-02-17T14:28:30.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.127+0000 7fce6af65640 1 --2- 172.21.15.134:0/2970090868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce64145170 0x7fce64071940 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.127+0000 7fce6af65640 1 --2- 172.21.15.134:0/2970090868 >> v2:172.21.15.142:3300/0 conn(0x7fce640b5020 0x7fce64144c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.127+0000 7fce6af65640 1 -- 172.21.15.134:0/2970090868 >> 172.21.15.134:0/2970090868 conn(0x7fce640ba430 msgr2=0x7fce640ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:30.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.127+0000 7fce6af65640 1 -- 172.21.15.134:0/2970090868 shutdown_connections 2024-02-17T14:28:30.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.127+0000 7fce6af65640 1 -- 172.21.15.134:0/2970090868 wait complete. 2024-02-17T14:28:30.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.128+0000 7fce6af65640 1 Processor -- start 2024-02-17T14:28:30.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.128+0000 7fce6af65640 1 -- start start 2024-02-17T14:28:30.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce6af65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce64071e80 0x7fce640b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce6af65640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce640b5020 0x7fce641470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce6af65640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce64145170 0x7fce641dd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce6af65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce64146930 con 0x7fce64071e80 2024-02-17T14:28:30.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce6af65640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce64148f10 con 0x7fce640b5020 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce6af65640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce64146b80 con 0x7fce64145170 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce68d01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce64071e80 0x7fce640b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce68d01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce64071e80 0x7fce640b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46514/0 (socket says 172.21.15.134:46514) 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce68d01640 1 -- 172.21.15.134:0/319396176 learned_addr learned my addr 172.21.15.134:0/319396176 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce69502640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce64145170 0x7fce641dd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce63fff640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce640b5020 0x7fce641470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce68d01640 1 -- 172.21.15.134:0/319396176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce64145170 msgr2=0x7fce641dd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce68d01640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce64145170 0x7fce641dd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce68d01640 1 -- 172.21.15.134:0/319396176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce640b5020 msgr2=0x7fce641470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce68d01640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce640b5020 0x7fce641470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce68d01640 1 -- 172.21.15.134:0/319396176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c0094d0 con 0x7fce64071e80 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.129+0000 7fce68d01640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce64071e80 0x7fce640b3f30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00efc0 tx=0x7fce5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.130+0000 7fce617fa640 1 -- 172.21.15.134:0/319396176 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c014480 con 0x7fce64071e80 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.130+0000 7fce617fa640 1 -- 172.21.15.134:0/319396176 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c00f040 con 0x7fce64071e80 2024-02-17T14:28:30.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.130+0000 7fce6af65640 1 -- 172.21.15.134:0/319396176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce64148560 con 0x7fce64071e80 2024-02-17T14:28:30.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.130+0000 7fce617fa640 1 -- 172.21.15.134:0/319396176 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c014800 con 0x7fce64071e80 2024-02-17T14:28:30.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.130+0000 7fce6af65640 1 -- 172.21.15.134:0/319396176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce64145d90 con 0x7fce64071e80 2024-02-17T14:28:30.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.131+0000 7fce6af65640 1 -- 172.21.15.134:0/319396176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce640b59f0 con 0x7fce64071e80 2024-02-17T14:28:30.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.131+0000 7fce617fa640 1 -- 172.21.15.134:0/319396176 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fce5c014960 con 0x7fce64071e80 2024-02-17T14:28:30.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.131+0000 7fce617fa640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fce4406b810 0x7fce4406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.132+0000 7fce63fff640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fce4406b810 0x7fce4406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.132+0000 7fce617fa640 1 -- 172.21.15.134:0/319396176 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fce5c08b140 con 0x7fce64071e80 2024-02-17T14:28:30.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.132+0000 7fce63fff640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fce4406b810 0x7fce4406dcd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fce4c036000 tx=0x7fce4c03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:30.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.136+0000 7fce617fa640 1 -- 172.21.15.134:0/319396176 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fce5c055820 con 0x7fce64071e80 2024-02-17T14:28:30.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.302+0000 7fce6af65640 1 -- 172.21.15.134:0/319396176 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce640727f0 con 0x7fce4406b810 2024-02-17T14:28:30.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.310+0000 7fce617fa640 1 -- 172.21.15.134:0/319396176 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345325 (secure 0 0 0) 0x7fce640727f0 con 0x7fce4406b810 2024-02-17T14:28:30.313 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:30.315 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-02-17T14:28:30.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.313+0000 7fce6af65640 1 -- 172.21.15.134:0/319396176 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fce4406b810 msgr2=0x7fce4406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.313+0000 7fce6af65640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fce4406b810 0x7fce4406dcd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fce4c036000 tx=0x7fce4c03d040 comp rx=0 tx=0).stop 2024-02-17T14:28:30.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.313+0000 7fce6af65640 1 -- 172.21.15.134:0/319396176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce64071e80 msgr2=0x7fce640b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.313+0000 7fce6af65640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce64071e80 0x7fce640b3f30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00efc0 tx=0x7fce5c00c490 comp rx=0 tx=0).stop 2024-02-17T14:28:30.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.313+0000 7fce6af65640 1 -- 172.21.15.134:0/319396176 shutdown_connections 2024-02-17T14:28:30.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.313+0000 7fce6af65640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce64145170 0x7fce641dd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.313+0000 7fce6af65640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce640b5020 0x7fce641470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.313+0000 7fce6af65640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fce4406b810 0x7fce4406dcd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.313+0000 7fce6af65640 1 --2- 172.21.15.134:0/319396176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce64071e80 0x7fce640b3f30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.313+0000 7fce6af65640 1 -- 172.21.15.134:0/319396176 >> 172.21.15.134:0/319396176 conn(0x7fce640ba430 msgr2=0x7fce641434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:30.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.313+0000 7fce6af65640 1 -- 172.21.15.134:0/319396176 shutdown_connections 2024-02-17T14:28:30.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.313+0000 7fce6af65640 1 -- 172.21.15.134:0/319396176 wait complete. 2024-02-17T14:28:30.324 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-02-17T14:28:28.565689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218448,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756272,"statfs":{"total":773094113280,"available":772870422528,"internally_reserved":0,"allocated":2326528,"data_stored":2029432,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003313"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231617+0000","last_change":"2024-02-17T14:28:03.069069+0000","last_active":"2024-02-17T14:28:10.231617+0000","last_peered":"2024-02-17T14:28:10.231617+0000","last_clean":"2024-02-17T14:28:10.231617+0000","last_became_active":"2024-02-17T14:28:03.068714+0000","last_became_peered":"2024-02-17T14:28:03.068714+0000","last_unstale":"2024-02-17T14:28:10.231617+0000","last_undegraded":"2024-02-17T14:28:10.231617+0000","last_fullsized":"2024-02-17T14:28:10.231617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:49:37.606508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659580+0000","last_change":"2024-02-17T14:28:03.633277+0000","last_active":"2024-02-17T14:28:08.659580+0000","last_peered":"2024-02-17T14:28:08.659580+0000","last_clean":"2024-02-17T14:28:08.659580+0000","last_became_active":"2024-02-17T14:28:03.631462+0000","last_became_peered":"2024-02-17T14:28:03.631462+0000","last_unstale":"2024-02-17T14:28:08.659580+0000","last_undegraded":"2024-02-17T14:28:08.659580+0000","last_fullsized":"2024-02-17T14:28:08.659580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659129+0000","last_change":"2024-02-17T14:28:07.850214+0000","last_active":"2024-02-17T14:28:08.659129+0000","last_peered":"2024-02-17T14:28:08.659129+0000","last_clean":"2024-02-17T14:28:08.659129+0000","last_became_active":"2024-02-17T14:28:07.849871+0000","last_became_peered":"2024-02-17T14:28:07.849871+0000","last_unstale":"2024-02-17T14:28:08.659129+0000","last_undegraded":"2024-02-17T14:28:08.659129+0000","last_fullsized":"2024-02-17T14:28:08.659129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:46:12.614434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659755+0000","last_change":"2024-02-17T14:28:03.069234+0000","last_active":"2024-02-17T14:28:08.659755+0000","last_peered":"2024-02-17T14:28:08.659755+0000","last_clean":"2024-02-17T14:28:08.659755+0000","last_became_active":"2024-02-17T14:28:03.068978+0000","last_became_peered":"2024-02-17T14:28:03.068978+0000","last_unstale":"2024-02-17T14:28:08.659755+0000","last_undegraded":"2024-02-17T14:28:08.659755+0000","last_fullsized":"2024-02-17T14:28:08.659755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231420+0000","last_change":"2024-02-17T14:28:03.630763+0000","last_active":"2024-02-17T14:28:10.231420+0000","last_peered":"2024-02-17T14:28:10.231420+0000","last_clean":"2024-02-17T14:28:10.231420+0000","last_became_active":"2024-02-17T14:28:03.630517+0000","last_became_peered":"2024-02-17T14:28:03.630517+0000","last_unstale":"2024-02-17T14:28:10.231420+0000","last_undegraded":"2024-02-17T14:28:10.231420+0000","last_fullsized":"2024-02-17T14:28:10.231420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664338+0000","last_change":"2024-02-17T14:28:07.644982+0000","last_active":"2024-02-17T14:28:08.664338+0000","last_peered":"2024-02-17T14:28:08.664338+0000","last_clean":"2024-02-17T14:28:08.664338+0000","last_became_active":"2024-02-17T14:28:07.644458+0000","last_became_peered":"2024-02-17T14:28:07.644458+0000","last_unstale":"2024-02-17T14:28:08.664338+0000","last_undegraded":"2024-02-17T14:28:08.664338+0000","last_fullsized":"2024-02-17T14:28:08.664338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:42.133618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653761+0000","last_change":"2024-02-17T14:28:03.071236+0000","last_active":"2024-02-17T14:28:10.653761+0000","last_peered":"2024-02-17T14:28:10.653761+0000","last_clean":"2024-02-17T14:28:10.653761+0000","last_became_active":"2024-02-17T14:28:03.070955+0000","last_became_peered":"2024-02-17T14:28:03.070955+0000","last_unstale":"2024-02-17T14:28:10.653761+0000","last_undegraded":"2024-02-17T14:28:10.653761+0000","last_fullsized":"2024-02-17T14:28:10.653761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664873+0000","last_change":"2024-02-17T14:28:03.628182+0000","last_active":"2024-02-17T14:28:08.664873+0000","last_peered":"2024-02-17T14:28:08.664873+0000","last_clean":"2024-02-17T14:28:08.664873+0000","last_became_active":"2024-02-17T14:28:03.627865+0000","last_became_peered":"2024-02-17T14:28:03.627865+0000","last_unstale":"2024-02-17T14:28:08.664873+0000","last_undegraded":"2024-02-17T14:28:08.664873+0000","last_fullsized":"2024-02-17T14:28:08.664873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665230+0000","last_change":"2024-02-17T14:28:07.649384+0000","last_active":"2024-02-17T14:28:08.665230+0000","last_peered":"2024-02-17T14:28:08.665230+0000","last_clean":"2024-02-17T14:28:08.665230+0000","last_became_active":"2024-02-17T14:28:07.648936+0000","last_became_peered":"2024-02-17T14:28:07.648936+0000","last_unstale":"2024-02-17T14:28:08.665230+0000","last_undegraded":"2024-02-17T14:28:08.665230+0000","last_fullsized":"2024-02-17T14:28:08.665230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:13.199365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653449+0000","last_change":"2024-02-17T14:28:03.074776+0000","last_active":"2024-02-17T14:28:10.653449+0000","last_peered":"2024-02-17T14:28:10.653449+0000","last_clean":"2024-02-17T14:28:10.653449+0000","last_became_active":"2024-02-17T14:28:03.074490+0000","last_became_peered":"2024-02-17T14:28:03.074490+0000","last_unstale":"2024-02-17T14:28:10.653449+0000","last_undegraded":"2024-02-17T14:28:10.653449+0000","last_fullsized":"2024-02-17T14:28:10.653449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.666004+0000","last_change":"2024-02-17T14:28:03.627957+0000","last_active":"2024-02-17T14:28:08.666004+0000","last_peered":"2024-02-17T14:28:08.666004+0000","last_clean":"2024-02-17T14:28:08.666004+0000","last_became_active":"2024-02-17T14:28:03.627675+0000","last_became_peered":"2024-02-17T14:28:03.627675+0000","last_unstale":"2024-02-17T14:28:08.666004+0000","last_undegraded":"2024-02-17T14:28:08.666004+0000","last_fullsized":"2024-02-17T14:28:08.666004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664955+0000","last_change":"2024-02-17T14:28:07.652422+0000","last_active":"2024-02-17T14:28:08.664955+0000","last_peered":"2024-02-17T14:28:08.664955+0000","last_clean":"2024-02-17T14:28:08.664955+0000","last_became_active":"2024-02-17T14:28:07.651946+0000","last_became_peered":"2024-02-17T14:28:07.651946+0000","last_unstale":"2024-02-17T14:28:08.664955+0000","last_undegraded":"2024-02-17T14:28:08.664955+0000","last_fullsized":"2024-02-17T14:28:08.664955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:21.967845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199578+0000","last_change":"2024-02-17T14:28:03.635059+0000","last_active":"2024-02-17T14:28:10.199578+0000","last_peered":"2024-02-17T14:28:10.199578+0000","last_clean":"2024-02-17T14:28:10.199578+0000","last_became_active":"2024-02-17T14:28:03.634759+0000","last_became_peered":"2024-02-17T14:28:03.634759+0000","last_unstale":"2024-02-17T14:28:10.199578+0000","last_undegraded":"2024-02-17T14:28:10.199578+0000","last_fullsized":"2024-02-17T14:28:10.199578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653581+0000","last_change":"2024-02-17T14:28:03.075604+0000","last_active":"2024-02-17T14:28:10.653581+0000","last_peered":"2024-02-17T14:28:10.653581+0000","last_clean":"2024-02-17T14:28:10.653581+0000","last_became_active":"2024-02-17T14:28:03.075329+0000","last_became_peered":"2024-02-17T14:28:03.075329+0000","last_unstale":"2024-02-17T14:28:10.653581+0000","last_undegraded":"2024-02-17T14:28:10.653581+0000","last_fullsized":"2024-02-17T14:28:10.653581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665134+0000","last_change":"2024-02-17T14:28:07.645791+0000","last_active":"2024-02-17T14:28:08.665134+0000","last_peered":"2024-02-17T14:28:08.665134+0000","last_clean":"2024-02-17T14:28:08.665134+0000","last_became_active":"2024-02-17T14:28:07.645418+0000","last_became_peered":"2024-02-17T14:28:07.645418+0000","last_unstale":"2024-02-17T14:28:08.665134+0000","last_undegraded":"2024-02-17T14:28:08.665134+0000","last_fullsized":"2024-02-17T14:28:08.665134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:26.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659629+0000","last_change":"2024-02-17T14:28:03.629378+0000","last_active":"2024-02-17T14:28:08.659629+0000","last_peered":"2024-02-17T14:28:08.659629+0000","last_clean":"2024-02-17T14:28:08.659629+0000","last_became_active":"2024-02-17T14:28:03.629097+0000","last_became_peered":"2024-02-17T14:28:03.629097+0000","last_unstale":"2024-02-17T14:28:08.659629+0000","last_undegraded":"2024-02-17T14:28:08.659629+0000","last_fullsized":"2024-02-17T14:28:08.659629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008740+0000","last_change":"2024-02-17T14:28:03.073579+0000","last_active":"2024-02-17T14:28:09.008740+0000","last_peered":"2024-02-17T14:28:09.008740+0000","last_clean":"2024-02-17T14:28:09.008740+0000","last_became_active":"2024-02-17T14:28:03.073167+0000","last_became_peered":"2024-02-17T14:28:03.073167+0000","last_unstale":"2024-02-17T14:28:09.008740+0000","last_undegraded":"2024-02-17T14:28:09.008740+0000","last_fullsized":"2024-02-17T14:28:09.008740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664544+0000","last_change":"2024-02-17T14:28:07.644972+0000","last_active":"2024-02-17T14:28:08.664544+0000","last_peered":"2024-02-17T14:28:08.664544+0000","last_clean":"2024-02-17T14:28:08.664544+0000","last_became_active":"2024-02-17T14:28:07.644523+0000","last_became_peered":"2024-02-17T14:28:07.644523+0000","last_unstale":"2024-02-17T14:28:08.664544+0000","last_undegraded":"2024-02-17T14:28:08.664544+0000","last_fullsized":"2024-02-17T14:28:08.664544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:25.221682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659355+0000","last_change":"2024-02-17T14:28:03.628527+0000","last_active":"2024-02-17T14:28:08.659355+0000","last_peered":"2024-02-17T14:28:08.659355+0000","last_clean":"2024-02-17T14:28:08.659355+0000","last_became_active":"2024-02-17T14:28:03.628274+0000","last_became_peered":"2024-02-17T14:28:03.628274+0000","last_unstale":"2024-02-17T14:28:08.659355+0000","last_undegraded":"2024-02-17T14:28:08.659355+0000","last_fullsized":"2024-02-17T14:28:08.659355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008406+0000","last_change":"2024-02-17T14:28:03.072317+0000","last_active":"2024-02-17T14:28:09.008406+0000","last_peered":"2024-02-17T14:28:09.008406+0000","last_clean":"2024-02-17T14:28:09.008406+0000","last_became_active":"2024-02-17T14:28:03.072016+0000","last_became_peered":"2024-02-17T14:28:03.072016+0000","last_unstale":"2024-02-17T14:28:09.008406+0000","last_undegraded":"2024-02-17T14:28:09.008406+0000","last_fullsized":"2024-02-17T14:28:09.008406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008870+0000","last_change":"2024-02-17T14:28:07.851022+0000","last_active":"2024-02-17T14:28:09.008870+0000","last_peered":"2024-02-17T14:28:09.008870+0000","last_clean":"2024-02-17T14:28:09.008870+0000","last_became_active":"2024-02-17T14:28:07.850379+0000","last_became_peered":"2024-02-17T14:28:07.850379+0000","last_unstale":"2024-02-17T14:28:09.008870+0000","last_undegraded":"2024-02-17T14:28:09.008870+0000","last_fullsized":"2024-02-17T14:28:09.008870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665771+0000","last_change":"2024-02-17T14:28:03.624798+0000","last_active":"2024-02-17T14:28:08.665771+0000","last_peered":"2024-02-17T14:28:08.665771+0000","last_clean":"2024-02-17T14:28:08.665771+0000","last_became_active":"2024-02-17T14:28:03.624517+0000","last_became_peered":"2024-02-17T14:28:03.624517+0000","last_unstale":"2024-02-17T14:28:08.665771+0000","last_undegraded":"2024-02-17T14:28:08.665771+0000","last_fullsized":"2024-02-17T14:28:08.665771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:40.637145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653091+0000","last_change":"2024-02-17T14:28:03.072806+0000","last_active":"2024-02-17T14:28:10.653091+0000","last_peered":"2024-02-17T14:28:10.653091+0000","last_clean":"2024-02-17T14:28:10.653091+0000","last_became_active":"2024-02-17T14:28:03.072490+0000","last_became_peered":"2024-02-17T14:28:03.072490+0000","last_unstale":"2024-02-17T14:28:10.653091+0000","last_undegraded":"2024-02-17T14:28:10.653091+0000","last_fullsized":"2024-02-17T14:28:10.653091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664603+0000","last_change":"2024-02-17T14:28:07.644959+0000","last_active":"2024-02-17T14:28:08.664603+0000","last_peered":"2024-02-17T14:28:08.664603+0000","last_clean":"2024-02-17T14:28:08.664603+0000","last_became_active":"2024-02-17T14:28:07.644524+0000","last_became_peered":"2024-02-17T14:28:07.644524+0000","last_unstale":"2024-02-17T14:28:08.664603+0000","last_undegraded":"2024-02-17T14:28:08.664603+0000","last_fullsized":"2024-02-17T14:28:08.664603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:29:02.122806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231643+0000","last_change":"2024-02-17T14:28:03.629190+0000","last_active":"2024-02-17T14:28:10.231643+0000","last_peered":"2024-02-17T14:28:10.231643+0000","last_clean":"2024-02-17T14:28:10.231643+0000","last_became_active":"2024-02-17T14:28:03.628777+0000","last_became_peered":"2024-02-17T14:28:03.628777+0000","last_unstale":"2024-02-17T14:28:10.231643+0000","last_undegraded":"2024-02-17T14:28:10.231643+0000","last_fullsized":"2024-02-17T14:28:10.231643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200259+0000","last_change":"2024-02-17T14:28:03.071097+0000","last_active":"2024-02-17T14:28:10.200259+0000","last_peered":"2024-02-17T14:28:10.200259+0000","last_clean":"2024-02-17T14:28:10.200259+0000","last_became_active":"2024-02-17T14:28:03.070790+0000","last_became_peered":"2024-02-17T14:28:03.070790+0000","last_unstale":"2024-02-17T14:28:10.200259+0000","last_undegraded":"2024-02-17T14:28:10.200259+0000","last_fullsized":"2024-02-17T14:28:10.200259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665566+0000","last_change":"2024-02-17T14:28:07.849764+0000","last_active":"2024-02-17T14:28:08.665566+0000","last_peered":"2024-02-17T14:28:08.665566+0000","last_clean":"2024-02-17T14:28:08.665566+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:08.665566+0000","last_undegraded":"2024-02-17T14:28:08.665566+0000","last_fullsized":"2024-02-17T14:28:08.665566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659802+0000","last_change":"2024-02-17T14:28:03.641818+0000","last_active":"2024-02-17T14:28:08.659802+0000","last_peered":"2024-02-17T14:28:08.659802+0000","last_clean":"2024-02-17T14:28:08.659802+0000","last_became_active":"2024-02-17T14:28:03.641577+0000","last_became_peered":"2024-02-17T14:28:03.641577+0000","last_unstale":"2024-02-17T14:28:08.659802+0000","last_undegraded":"2024-02-17T14:28:08.659802+0000","last_fullsized":"2024-02-17T14:28:08.659802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008983+0000","last_change":"2024-02-17T14:28:03.072074+0000","last_active":"2024-02-17T14:28:09.008983+0000","last_peered":"2024-02-17T14:28:09.008983+0000","last_clean":"2024-02-17T14:28:09.008983+0000","last_became_active":"2024-02-17T14:28:03.071850+0000","last_became_peered":"2024-02-17T14:28:03.071850+0000","last_unstale":"2024-02-17T14:28:09.008983+0000","last_undegraded":"2024-02-17T14:28:09.008983+0000","last_fullsized":"2024-02-17T14:28:09.008983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659047+0000","last_change":"2024-02-17T14:28:07.849616+0000","last_active":"2024-02-17T14:28:08.659047+0000","last_peered":"2024-02-17T14:28:08.659047+0000","last_clean":"2024-02-17T14:28:08.659047+0000","last_became_active":"2024-02-17T14:28:07.849022+0000","last_became_peered":"2024-02-17T14:28:07.849022+0000","last_unstale":"2024-02-17T14:28:08.659047+0000","last_undegraded":"2024-02-17T14:28:08.659047+0000","last_fullsized":"2024-02-17T14:28:08.659047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:18:22.630217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008626+0000","last_change":"2024-02-17T14:28:03.632265+0000","last_active":"2024-02-17T14:28:09.008626+0000","last_peered":"2024-02-17T14:28:09.008626+0000","last_clean":"2024-02-17T14:28:09.008626+0000","last_became_active":"2024-02-17T14:28:03.632020+0000","last_became_peered":"2024-02-17T14:28:03.632020+0000","last_unstale":"2024-02-17T14:28:09.008626+0000","last_undegraded":"2024-02-17T14:28:09.008626+0000","last_fullsized":"2024-02-17T14:28:09.008626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653833+0000","last_change":"2024-02-17T14:28:03.072252+0000","last_active":"2024-02-17T14:28:10.653833+0000","last_peered":"2024-02-17T14:28:10.653833+0000","last_clean":"2024-02-17T14:28:10.653833+0000","last_became_active":"2024-02-17T14:28:03.071830+0000","last_became_peered":"2024-02-17T14:28:03.071830+0000","last_unstale":"2024-02-17T14:28:10.653833+0000","last_undegraded":"2024-02-17T14:28:10.653833+0000","last_fullsized":"2024-02-17T14:28:10.653833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:24.870956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231494+0000","last_change":"2024-02-17T14:28:07.849579+0000","last_active":"2024-02-17T14:28:10.231494+0000","last_peered":"2024-02-17T14:28:10.231494+0000","last_clean":"2024-02-17T14:28:10.231494+0000","last_became_active":"2024-02-17T14:28:07.849212+0000","last_became_peered":"2024-02-17T14:28:07.849212+0000","last_unstale":"2024-02-17T14:28:10.231494+0000","last_undegraded":"2024-02-17T14:28:10.231494+0000","last_fullsized":"2024-02-17T14:28:10.231494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.666100+0000","last_change":"2024-02-17T14:28:03.626429+0000","last_active":"2024-02-17T14:28:08.666100+0000","last_peered":"2024-02-17T14:28:08.666100+0000","last_clean":"2024-02-17T14:28:08.666100+0000","last_became_active":"2024-02-17T14:28:03.626174+0000","last_became_peered":"2024-02-17T14:28:03.626174+0000","last_unstale":"2024-02-17T14:28:08.666100+0000","last_undegraded":"2024-02-17T14:28:08.666100+0000","last_fullsized":"2024-02-17T14:28:08.666100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008726+0000","last_change":"2024-02-17T14:28:03.068443+0000","last_active":"2024-02-17T14:28:09.008726+0000","last_peered":"2024-02-17T14:28:09.008726+0000","last_clean":"2024-02-17T14:28:09.008726+0000","last_became_active":"2024-02-17T14:28:03.068179+0000","last_became_peered":"2024-02-17T14:28:03.068179+0000","last_unstale":"2024-02-17T14:28:09.008726+0000","last_undegraded":"2024-02-17T14:28:09.008726+0000","last_fullsized":"2024-02-17T14:28:09.008726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008367+0000","last_change":"2024-02-17T14:28:07.650015+0000","last_active":"2024-02-17T14:28:09.008367+0000","last_peered":"2024-02-17T14:28:09.008367+0000","last_clean":"2024-02-17T14:28:09.008367+0000","last_became_active":"2024-02-17T14:28:07.647918+0000","last_became_peered":"2024-02-17T14:28:07.647918+0000","last_unstale":"2024-02-17T14:28:09.008367+0000","last_undegraded":"2024-02-17T14:28:09.008367+0000","last_fullsized":"2024-02-17T14:28:09.008367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665475+0000","last_change":"2024-02-17T14:28:03.629343+0000","last_active":"2024-02-17T14:28:08.665475+0000","last_peered":"2024-02-17T14:28:08.665475+0000","last_clean":"2024-02-17T14:28:08.665475+0000","last_became_active":"2024-02-17T14:28:03.629077+0000","last_became_peered":"2024-02-17T14:28:03.629077+0000","last_unstale":"2024-02-17T14:28:08.665475+0000","last_undegraded":"2024-02-17T14:28:08.665475+0000","last_fullsized":"2024-02-17T14:28:08.665475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:36.441335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664754+0000","last_change":"2024-02-17T14:28:03.069178+0000","last_active":"2024-02-17T14:28:08.664754+0000","last_peered":"2024-02-17T14:28:08.664754+0000","last_clean":"2024-02-17T14:28:08.664754+0000","last_became_active":"2024-02-17T14:28:03.068923+0000","last_became_peered":"2024-02-17T14:28:03.068923+0000","last_unstale":"2024-02-17T14:28:08.664754+0000","last_undegraded":"2024-02-17T14:28:08.664754+0000","last_fullsized":"2024-02-17T14:28:08.664754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008675+0000","last_change":"2024-02-17T14:28:07.648757+0000","last_active":"2024-02-17T14:28:09.008675+0000","last_peered":"2024-02-17T14:28:09.008675+0000","last_clean":"2024-02-17T14:28:09.008675+0000","last_became_active":"2024-02-17T14:28:07.645156+0000","last_became_peered":"2024-02-17T14:28:07.645156+0000","last_unstale":"2024-02-17T14:28:09.008675+0000","last_undegraded":"2024-02-17T14:28:09.008675+0000","last_fullsized":"2024-02-17T14:28:09.008675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008415+0000","last_change":"2024-02-17T14:28:03.627479+0000","last_active":"2024-02-17T14:28:09.008415+0000","last_peered":"2024-02-17T14:28:09.008415+0000","last_clean":"2024-02-17T14:28:09.008415+0000","last_became_active":"2024-02-17T14:28:03.627165+0000","last_became_peered":"2024-02-17T14:28:03.627165+0000","last_unstale":"2024-02-17T14:28:09.008415+0000","last_undegraded":"2024-02-17T14:28:09.008415+0000","last_fullsized":"2024-02-17T14:28:09.008415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952042+0000","last_change":"2024-02-17T14:28:03.066452+0000","last_active":"2024-02-17T14:28:08.952042+0000","last_peered":"2024-02-17T14:28:08.952042+0000","last_clean":"2024-02-17T14:28:08.952042+0000","last_became_active":"2024-02-17T14:28:03.066156+0000","last_became_peered":"2024-02-17T14:28:03.066156+0000","last_unstale":"2024-02-17T14:28:08.952042+0000","last_undegraded":"2024-02-17T14:28:08.952042+0000","last_fullsized":"2024-02-17T14:28:08.952042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008897+0000","last_change":"2024-02-17T14:28:07.649765+0000","last_active":"2024-02-17T14:28:09.008897+0000","last_peered":"2024-02-17T14:28:09.008897+0000","last_clean":"2024-02-17T14:28:09.008897+0000","last_became_active":"2024-02-17T14:28:07.649403+0000","last_became_peered":"2024-02-17T14:28:07.649403+0000","last_unstale":"2024-02-17T14:28:09.008897+0000","last_undegraded":"2024-02-17T14:28:09.008897+0000","last_fullsized":"2024-02-17T14:28:09.008897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231133+0000","last_change":"2024-02-17T14:28:03.629628+0000","last_active":"2024-02-17T14:28:10.231133+0000","last_peered":"2024-02-17T14:28:10.231133+0000","last_clean":"2024-02-17T14:28:10.231133+0000","last_became_active":"2024-02-17T14:28:03.629247+0000","last_became_peered":"2024-02-17T14:28:03.629247+0000","last_unstale":"2024-02-17T14:28:10.231133+0000","last_undegraded":"2024-02-17T14:28:10.231133+0000","last_fullsized":"2024-02-17T14:28:10.231133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:00:51.336643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653093+0000","last_change":"2024-02-17T14:28:03.072090+0000","last_active":"2024-02-17T14:28:10.653093+0000","last_peered":"2024-02-17T14:28:10.653093+0000","last_clean":"2024-02-17T14:28:10.653093+0000","last_became_active":"2024-02-17T14:28:03.071778+0000","last_became_peered":"2024-02-17T14:28:03.071778+0000","last_unstale":"2024-02-17T14:28:10.653093+0000","last_undegraded":"2024-02-17T14:28:10.653093+0000","last_fullsized":"2024-02-17T14:28:10.653093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231592+0000","last_change":"2024-02-17T14:28:07.850472+0000","last_active":"2024-02-17T14:28:10.231592+0000","last_peered":"2024-02-17T14:28:10.231592+0000","last_clean":"2024-02-17T14:28:10.231592+0000","last_became_active":"2024-02-17T14:28:07.850106+0000","last_became_peered":"2024-02-17T14:28:07.850106+0000","last_unstale":"2024-02-17T14:28:10.231592+0000","last_undegraded":"2024-02-17T14:28:10.231592+0000","last_fullsized":"2024-02-17T14:28:10.231592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659235+0000","last_change":"2024-02-17T14:28:03.635109+0000","last_active":"2024-02-17T14:28:08.659235+0000","last_peered":"2024-02-17T14:28:08.659235+0000","last_clean":"2024-02-17T14:28:08.659235+0000","last_became_active":"2024-02-17T14:28:03.634570+0000","last_became_peered":"2024-02-17T14:28:03.634570+0000","last_unstale":"2024-02-17T14:28:08.659235+0000","last_undegraded":"2024-02-17T14:28:08.659235+0000","last_fullsized":"2024-02-17T14:28:08.659235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665733+0000","last_change":"2024-02-17T14:28:03.061647+0000","last_active":"2024-02-17T14:28:08.665733+0000","last_peered":"2024-02-17T14:28:08.665733+0000","last_clean":"2024-02-17T14:28:08.665733+0000","last_became_active":"2024-02-17T14:28:03.061026+0000","last_became_peered":"2024-02-17T14:28:03.061026+0000","last_unstale":"2024-02-17T14:28:08.665733+0000","last_undegraded":"2024-02-17T14:28:08.665733+0000","last_fullsized":"2024-02-17T14:28:08.665733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653276+0000","last_change":"2024-02-17T14:28:00.253131+0000","last_active":"2024-02-17T14:28:10.653276+0000","last_peered":"2024-02-17T14:28:10.653276+0000","last_clean":"2024-02-17T14:28:10.653276+0000","last_became_active":"2024-02-17T14:28:00.252180+0000","last_became_peered":"2024-02-17T14:28:00.252180+0000","last_unstale":"2024-02-17T14:28:10.653276+0000","last_undegraded":"2024-02-17T14:28:10.653276+0000","last_fullsized":"2024-02-17T14:28:10.653276+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_clean_scrub_stamp":"2024-02-17T14:27:59.037303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:48.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199982+0000","last_change":"2024-02-17T14:28:07.849676+0000","last_active":"2024-02-17T14:28:10.199982+0000","last_peered":"2024-02-17T14:28:10.199982+0000","last_clean":"2024-02-17T14:28:10.199982+0000","last_became_active":"2024-02-17T14:28:07.849264+0000","last_became_peered":"2024-02-17T14:28:07.849264+0000","last_unstale":"2024-02-17T14:28:10.199982+0000","last_undegraded":"2024-02-17T14:28:10.199982+0000","last_fullsized":"2024-02-17T14:28:10.199982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653536+0000","last_change":"2024-02-17T14:28:03.642433+0000","last_active":"2024-02-17T14:28:10.653536+0000","last_peered":"2024-02-17T14:28:10.653536+0000","last_clean":"2024-02-17T14:28:10.653536+0000","last_became_active":"2024-02-17T14:28:03.641815+0000","last_became_peered":"2024-02-17T14:28:03.641815+0000","last_unstale":"2024-02-17T14:28:10.653536+0000","last_undegraded":"2024-02-17T14:28:10.653536+0000","last_fullsized":"2024-02-17T14:28:10.653536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:38.398272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952264+0000","last_change":"2024-02-17T14:28:03.066483+0000","last_active":"2024-02-17T14:28:08.952264+0000","last_peered":"2024-02-17T14:28:08.952264+0000","last_clean":"2024-02-17T14:28:08.952264+0000","last_became_active":"2024-02-17T14:28:03.066169+0000","last_became_peered":"2024-02-17T14:28:03.066169+0000","last_unstale":"2024-02-17T14:28:08.952264+0000","last_undegraded":"2024-02-17T14:28:08.952264+0000","last_fullsized":"2024-02-17T14:28:08.952264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199590+0000","last_change":"2024-02-17T14:28:07.846685+0000","last_active":"2024-02-17T14:28:10.199590+0000","last_peered":"2024-02-17T14:28:10.199590+0000","last_clean":"2024-02-17T14:28:10.199590+0000","last_became_active":"2024-02-17T14:28:07.846265+0000","last_became_peered":"2024-02-17T14:28:07.846265+0000","last_unstale":"2024-02-17T14:28:10.199590+0000","last_undegraded":"2024-02-17T14:28:10.199590+0000","last_fullsized":"2024-02-17T14:28:10.199590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664990+0000","last_change":"2024-02-17T14:28:03.634574+0000","last_active":"2024-02-17T14:28:08.664990+0000","last_peered":"2024-02-17T14:28:08.664990+0000","last_clean":"2024-02-17T14:28:08.664990+0000","last_became_active":"2024-02-17T14:28:03.634290+0000","last_became_peered":"2024-02-17T14:28:03.634290+0000","last_unstale":"2024-02-17T14:28:08.664990+0000","last_undegraded":"2024-02-17T14:28:08.664990+0000","last_fullsized":"2024-02-17T14:28:08.664990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008900+0000","last_change":"2024-02-17T14:28:03.072793+0000","last_active":"2024-02-17T14:28:09.008900+0000","last_peered":"2024-02-17T14:28:09.008900+0000","last_clean":"2024-02-17T14:28:09.008900+0000","last_became_active":"2024-02-17T14:28:03.072497+0000","last_became_peered":"2024-02-17T14:28:03.072497+0000","last_unstale":"2024-02-17T14:28:09.008900+0000","last_undegraded":"2024-02-17T14:28:09.008900+0000","last_fullsized":"2024-02-17T14:28:09.008900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231646+0000","last_change":"2024-02-17T14:28:07.651730+0000","last_active":"2024-02-17T14:28:10.231646+0000","last_peered":"2024-02-17T14:28:10.231646+0000","last_clean":"2024-02-17T14:28:10.231646+0000","last_became_active":"2024-02-17T14:28:07.651144+0000","last_became_peered":"2024-02-17T14:28:07.651144+0000","last_unstale":"2024-02-17T14:28:10.231646+0000","last_undegraded":"2024-02-17T14:28:10.231646+0000","last_fullsized":"2024-02-17T14:28:10.231646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653784+0000","last_change":"2024-02-17T14:28:03.643461+0000","last_active":"2024-02-17T14:28:10.653784+0000","last_peered":"2024-02-17T14:28:10.653784+0000","last_clean":"2024-02-17T14:28:10.653784+0000","last_became_active":"2024-02-17T14:28:03.643033+0000","last_became_peered":"2024-02-17T14:28:03.643033+0000","last_unstale":"2024-02-17T14:28:10.653784+0000","last_undegraded":"2024-02-17T14:28:10.653784+0000","last_fullsized":"2024-02-17T14:28:10.653784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:01.946139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952270+0000","last_change":"2024-02-17T14:28:03.067046+0000","last_active":"2024-02-17T14:28:08.952270+0000","last_peered":"2024-02-17T14:28:08.952270+0000","last_clean":"2024-02-17T14:28:08.952270+0000","last_became_active":"2024-02-17T14:28:03.066797+0000","last_became_peered":"2024-02-17T14:28:03.066797+0000","last_unstale":"2024-02-17T14:28:08.952270+0000","last_undegraded":"2024-02-17T14:28:08.952270+0000","last_fullsized":"2024-02-17T14:28:08.952270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.663876+0000","last_change":"2024-02-17T14:28:07.850145+0000","last_active":"2024-02-17T14:28:08.663876+0000","last_peered":"2024-02-17T14:28:08.663876+0000","last_clean":"2024-02-17T14:28:08.663876+0000","last_became_active":"2024-02-17T14:28:07.849280+0000","last_became_peered":"2024-02-17T14:28:07.849280+0000","last_unstale":"2024-02-17T14:28:08.663876+0000","last_undegraded":"2024-02-17T14:28:08.663876+0000","last_fullsized":"2024-02-17T14:28:08.663876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653718+0000","last_change":"2024-02-17T14:28:03.641357+0000","last_active":"2024-02-17T14:28:10.653718+0000","last_peered":"2024-02-17T14:28:10.653718+0000","last_clean":"2024-02-17T14:28:10.653718+0000","last_became_active":"2024-02-17T14:28:03.640945+0000","last_became_peered":"2024-02-17T14:28:03.640945+0000","last_unstale":"2024-02-17T14:28:10.653718+0000","last_undegraded":"2024-02-17T14:28:10.653718+0000","last_fullsized":"2024-02-17T14:28:10.653718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664250+0000","last_change":"2024-02-17T14:28:03.066640+0000","last_active":"2024-02-17T14:28:08.664250+0000","last_peered":"2024-02-17T14:28:08.664250+0000","last_clean":"2024-02-17T14:28:08.664250+0000","last_became_active":"2024-02-17T14:28:03.066350+0000","last_became_peered":"2024-02-17T14:28:03.066350+0000","last_unstale":"2024-02-17T14:28:08.664250+0000","last_undegraded":"2024-02-17T14:28:08.664250+0000","last_fullsized":"2024-02-17T14:28:08.664250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:43.162911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665250+0000","last_change":"2024-02-17T14:28:07.652490+0000","last_active":"2024-02-17T14:28:08.665250+0000","last_peered":"2024-02-17T14:28:08.665250+0000","last_clean":"2024-02-17T14:28:08.665250+0000","last_became_active":"2024-02-17T14:28:07.652088+0000","last_became_peered":"2024-02-17T14:28:07.652088+0000","last_unstale":"2024-02-17T14:28:08.665250+0000","last_undegraded":"2024-02-17T14:28:08.665250+0000","last_fullsized":"2024-02-17T14:28:08.665250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:41.975941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653573+0000","last_change":"2024-02-17T14:28:03.641468+0000","last_active":"2024-02-17T14:28:10.653573+0000","last_peered":"2024-02-17T14:28:10.653573+0000","last_clean":"2024-02-17T14:28:10.653573+0000","last_became_active":"2024-02-17T14:28:03.640860+0000","last_became_peered":"2024-02-17T14:28:03.640860+0000","last_unstale":"2024-02-17T14:28:10.653573+0000","last_undegraded":"2024-02-17T14:28:10.653573+0000","last_fullsized":"2024-02-17T14:28:10.653573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.951937+0000","last_change":"2024-02-17T14:28:03.070146+0000","last_active":"2024-02-17T14:28:08.951937+0000","last_peered":"2024-02-17T14:28:08.951937+0000","last_clean":"2024-02-17T14:28:08.951937+0000","last_became_active":"2024-02-17T14:28:03.069867+0000","last_became_peered":"2024-02-17T14:28:03.069867+0000","last_unstale":"2024-02-17T14:28:08.951937+0000","last_undegraded":"2024-02-17T14:28:08.951937+0000","last_fullsized":"2024-02-17T14:28:08.951937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231421+0000","last_change":"2024-02-17T14:28:07.644792+0000","last_active":"2024-02-17T14:28:10.231421+0000","last_peered":"2024-02-17T14:28:10.231421+0000","last_clean":"2024-02-17T14:28:10.231421+0000","last_became_active":"2024-02-17T14:28:07.644452+0000","last_became_peered":"2024-02-17T14:28:07.644452+0000","last_unstale":"2024-02-17T14:28:10.231421+0000","last_undegraded":"2024-02-17T14:28:10.231421+0000","last_fullsized":"2024-02-17T14:28:10.231421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199598+0000","last_change":"2024-02-17T14:28:03.630962+0000","last_active":"2024-02-17T14:28:10.199598+0000","last_peered":"2024-02-17T14:28:10.199598+0000","last_clean":"2024-02-17T14:28:10.199598+0000","last_became_active":"2024-02-17T14:28:03.630239+0000","last_became_peered":"2024-02-17T14:28:03.630239+0000","last_unstale":"2024-02-17T14:28:10.199598+0000","last_undegraded":"2024-02-17T14:28:10.199598+0000","last_fullsized":"2024-02-17T14:28:10.199598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199658+0000","last_change":"2024-02-17T14:28:03.073091+0000","last_active":"2024-02-17T14:28:10.199658+0000","last_peered":"2024-02-17T14:28:10.199658+0000","last_clean":"2024-02-17T14:28:10.199658+0000","last_became_active":"2024-02-17T14:28:03.072801+0000","last_became_peered":"2024-02-17T14:28:03.072801+0000","last_unstale":"2024-02-17T14:28:10.199658+0000","last_undegraded":"2024-02-17T14:28:10.199658+0000","last_fullsized":"2024-02-17T14:28:10.199658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659664+0000","last_change":"2024-02-17T14:28:07.849362+0000","last_active":"2024-02-17T14:28:08.659664+0000","last_peered":"2024-02-17T14:28:08.659664+0000","last_clean":"2024-02-17T14:28:08.659664+0000","last_became_active":"2024-02-17T14:28:07.848991+0000","last_became_peered":"2024-02-17T14:28:07.848991+0000","last_unstale":"2024-02-17T14:28:08.659664+0000","last_undegraded":"2024-02-17T14:28:08.659664+0000","last_fullsized":"2024-02-17T14:28:08.659664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:52.959315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653518+0000","last_change":"2024-02-17T14:28:03.641810+0000","last_active":"2024-02-17T14:28:10.653518+0000","last_peered":"2024-02-17T14:28:10.653518+0000","last_clean":"2024-02-17T14:28:10.653518+0000","last_became_active":"2024-02-17T14:28:03.641501+0000","last_became_peered":"2024-02-17T14:28:03.641501+0000","last_unstale":"2024-02-17T14:28:10.653518+0000","last_undegraded":"2024-02-17T14:28:10.653518+0000","last_fullsized":"2024-02-17T14:28:10.653518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664665+0000","last_change":"2024-02-17T14:28:03.066989+0000","last_active":"2024-02-17T14:28:08.664665+0000","last_peered":"2024-02-17T14:28:08.664665+0000","last_clean":"2024-02-17T14:28:08.664665+0000","last_became_active":"2024-02-17T14:28:03.066538+0000","last_became_peered":"2024-02-17T14:28:03.066538+0000","last_unstale":"2024-02-17T14:28:08.664665+0000","last_undegraded":"2024-02-17T14:28:08.664665+0000","last_fullsized":"2024-02-17T14:28:08.664665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659889+0000","last_change":"2024-02-17T14:28:07.846885+0000","last_active":"2024-02-17T14:28:08.659889+0000","last_peered":"2024-02-17T14:28:08.659889+0000","last_clean":"2024-02-17T14:28:08.659889+0000","last_became_active":"2024-02-17T14:28:07.846413+0000","last_became_peered":"2024-02-17T14:28:07.846413+0000","last_unstale":"2024-02-17T14:28:08.659889+0000","last_undegraded":"2024-02-17T14:28:08.659889+0000","last_fullsized":"2024-02-17T14:28:08.659889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:00.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231324+0000","last_change":"2024-02-17T14:28:03.638054+0000","last_active":"2024-02-17T14:28:10.231324+0000","last_peered":"2024-02-17T14:28:10.231324+0000","last_clean":"2024-02-17T14:28:10.231324+0000","last_became_active":"2024-02-17T14:28:03.637831+0000","last_became_peered":"2024-02-17T14:28:03.637831+0000","last_unstale":"2024-02-17T14:28:10.231324+0000","last_undegraded":"2024-02-17T14:28:10.231324+0000","last_fullsized":"2024-02-17T14:28:10.231324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:11:23.521059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231733+0000","last_change":"2024-02-17T14:28:03.064510+0000","last_active":"2024-02-17T14:28:10.231733+0000","last_peered":"2024-02-17T14:28:10.231733+0000","last_clean":"2024-02-17T14:28:10.231733+0000","last_became_active":"2024-02-17T14:28:03.064226+0000","last_became_peered":"2024-02-17T14:28:03.064226+0000","last_unstale":"2024-02-17T14:28:10.231733+0000","last_undegraded":"2024-02-17T14:28:10.231733+0000","last_fullsized":"2024-02-17T14:28:10.231733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:26:19.467344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.666011+0000","last_change":"2024-02-17T14:28:07.849775+0000","last_active":"2024-02-17T14:28:08.666011+0000","last_peered":"2024-02-17T14:28:08.666011+0000","last_clean":"2024-02-17T14:28:08.666011+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:08.666011+0000","last_undegraded":"2024-02-17T14:28:08.666011+0000","last_fullsized":"2024-02-17T14:28:08.666011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653418+0000","last_change":"2024-02-17T14:28:03.642582+0000","last_active":"2024-02-17T14:28:10.653418+0000","last_peered":"2024-02-17T14:28:10.653418+0000","last_clean":"2024-02-17T14:28:10.653418+0000","last_became_active":"2024-02-17T14:28:03.642077+0000","last_became_peered":"2024-02-17T14:28:03.642077+0000","last_unstale":"2024-02-17T14:28:10.653418+0000","last_undegraded":"2024-02-17T14:28:10.653418+0000","last_fullsized":"2024-02-17T14:28:10.653418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:12.644402+0000","last_change":"2024-02-17T14:28:03.071791+0000","last_active":"2024-02-17T14:28:12.644402+0000","last_peered":"2024-02-17T14:28:12.644402+0000","last_clean":"2024-02-17T14:28:12.644402+0000","last_became_active":"2024-02-17T14:28:03.071303+0000","last_became_peered":"2024-02-17T14:28:03.071303+0000","last_unstale":"2024-02-17T14:28:12.644402+0000","last_undegraded":"2024-02-17T14:28:12.644402+0000","last_fullsized":"2024-02-17T14:28:12.644402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008512+0000","last_change":"2024-02-17T14:28:07.649531+0000","last_active":"2024-02-17T14:28:09.008512+0000","last_peered":"2024-02-17T14:28:09.008512+0000","last_clean":"2024-02-17T14:28:09.008512+0000","last_became_active":"2024-02-17T14:28:07.645313+0000","last_became_peered":"2024-02-17T14:28:07.645313+0000","last_unstale":"2024-02-17T14:28:09.008512+0000","last_undegraded":"2024-02-17T14:28:09.008512+0000","last_fullsized":"2024-02-17T14:28:09.008512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664873+0000","last_change":"2024-02-17T14:28:03.638812+0000","last_active":"2024-02-17T14:28:08.664873+0000","last_peered":"2024-02-17T14:28:08.664873+0000","last_clean":"2024-02-17T14:28:08.664873+0000","last_became_active":"2024-02-17T14:28:03.637937+0000","last_became_peered":"2024-02-17T14:28:03.637937+0000","last_unstale":"2024-02-17T14:28:08.664873+0000","last_undegraded":"2024-02-17T14:28:08.664873+0000","last_fullsized":"2024-02-17T14:28:08.664873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008758+0000","last_change":"2024-02-17T14:28:03.069972+0000","last_active":"2024-02-17T14:28:09.008758+0000","last_peered":"2024-02-17T14:28:09.008758+0000","last_clean":"2024-02-17T14:28:09.008758+0000","last_became_active":"2024-02-17T14:28:03.069690+0000","last_became_peered":"2024-02-17T14:28:03.069690+0000","last_unstale":"2024-02-17T14:28:09.008758+0000","last_undegraded":"2024-02-17T14:28:09.008758+0000","last_fullsized":"2024-02-17T14:28:09.008758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665294+0000","last_change":"2024-02-17T14:28:07.647825+0000","last_active":"2024-02-17T14:28:08.665294+0000","last_peered":"2024-02-17T14:28:08.665294+0000","last_clean":"2024-02-17T14:28:08.665294+0000","last_became_active":"2024-02-17T14:28:07.647420+0000","last_became_peered":"2024-02-17T14:28:07.647420+0000","last_unstale":"2024-02-17T14:28:08.665294+0000","last_undegraded":"2024-02-17T14:28:08.665294+0000","last_fullsized":"2024-02-17T14:28:08.665294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231519+0000","last_change":"2024-02-17T14:28:03.631000+0000","last_active":"2024-02-17T14:28:10.231519+0000","last_peered":"2024-02-17T14:28:10.231519+0000","last_clean":"2024-02-17T14:28:10.231519+0000","last_became_active":"2024-02-17T14:28:03.630169+0000","last_became_peered":"2024-02-17T14:28:03.630169+0000","last_unstale":"2024-02-17T14:28:10.231519+0000","last_undegraded":"2024-02-17T14:28:10.231519+0000","last_fullsized":"2024-02-17T14:28:10.231519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665258+0000","last_change":"2024-02-17T14:28:03.069911+0000","last_active":"2024-02-17T14:28:08.665258+0000","last_peered":"2024-02-17T14:28:08.665258+0000","last_clean":"2024-02-17T14:28:08.665258+0000","last_became_active":"2024-02-17T14:28:03.069617+0000","last_became_peered":"2024-02-17T14:28:03.069617+0000","last_unstale":"2024-02-17T14:28:08.665258+0000","last_undegraded":"2024-02-17T14:28:08.665258+0000","last_fullsized":"2024-02-17T14:28:08.665258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659211+0000","last_change":"2024-02-17T14:28:07.646742+0000","last_active":"2024-02-17T14:28:08.659211+0000","last_peered":"2024-02-17T14:28:08.659211+0000","last_clean":"2024-02-17T14:28:08.659211+0000","last_became_active":"2024-02-17T14:28:07.646403+0000","last_became_peered":"2024-02-17T14:28:07.646403+0000","last_unstale":"2024-02-17T14:28:08.659211+0000","last_undegraded":"2024-02-17T14:28:08.659211+0000","last_fullsized":"2024-02-17T14:28:08.659211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665170+0000","last_change":"2024-02-17T14:28:03.638522+0000","last_active":"2024-02-17T14:28:08.665170+0000","last_peered":"2024-02-17T14:28:08.665170+0000","last_clean":"2024-02-17T14:28:08.665170+0000","last_became_active":"2024-02-17T14:28:03.638281+0000","last_became_peered":"2024-02-17T14:28:03.638281+0000","last_unstale":"2024-02-17T14:28:08.665170+0000","last_undegraded":"2024-02-17T14:28:08.665170+0000","last_fullsized":"2024-02-17T14:28:08.665170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200162+0000","last_change":"2024-02-17T14:28:03.072855+0000","last_active":"2024-02-17T14:28:10.200162+0000","last_peered":"2024-02-17T14:28:10.200162+0000","last_clean":"2024-02-17T14:28:10.200162+0000","last_became_active":"2024-02-17T14:28:03.072571+0000","last_became_peered":"2024-02-17T14:28:03.072571+0000","last_unstale":"2024-02-17T14:28:10.200162+0000","last_undegraded":"2024-02-17T14:28:10.200162+0000","last_fullsized":"2024-02-17T14:28:10.200162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659178+0000","last_change":"2024-02-17T14:28:07.849448+0000","last_active":"2024-02-17T14:28:08.659178+0000","last_peered":"2024-02-17T14:28:08.659178+0000","last_clean":"2024-02-17T14:28:08.659178+0000","last_became_active":"2024-02-17T14:28:07.849096+0000","last_became_peered":"2024-02-17T14:28:07.849096+0000","last_unstale":"2024-02-17T14:28:08.659178+0000","last_undegraded":"2024-02-17T14:28:08.659178+0000","last_fullsized":"2024-02-17T14:28:08.659178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231420+0000","last_change":"2024-02-17T14:28:07.849485+0000","last_active":"2024-02-17T14:28:10.231420+0000","last_peered":"2024-02-17T14:28:10.231420+0000","last_clean":"2024-02-17T14:28:10.231420+0000","last_became_active":"2024-02-17T14:28:07.849053+0000","last_became_peered":"2024-02-17T14:28:07.849053+0000","last_unstale":"2024-02-17T14:28:10.231420+0000","last_undegraded":"2024-02-17T14:28:10.231420+0000","last_fullsized":"2024-02-17T14:28:10.231420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008242+0000","last_change":"2024-02-17T14:28:03.632467+0000","last_active":"2024-02-17T14:28:09.008242+0000","last_peered":"2024-02-17T14:28:09.008242+0000","last_clean":"2024-02-17T14:28:09.008242+0000","last_became_active":"2024-02-17T14:28:03.632204+0000","last_became_peered":"2024-02-17T14:28:03.632204+0000","last_unstale":"2024-02-17T14:28:09.008242+0000","last_undegraded":"2024-02-17T14:28:09.008242+0000","last_fullsized":"2024-02-17T14:28:09.008242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664021+0000","last_change":"2024-02-17T14:28:03.062682+0000","last_active":"2024-02-17T14:28:08.664021+0000","last_peered":"2024-02-17T14:28:08.664021+0000","last_clean":"2024-02-17T14:28:08.664021+0000","last_became_active":"2024-02-17T14:28:03.062390+0000","last_became_peered":"2024-02-17T14:28:03.062390+0000","last_unstale":"2024-02-17T14:28:08.664021+0000","last_undegraded":"2024-02-17T14:28:08.664021+0000","last_fullsized":"2024-02-17T14:28:08.664021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200129+0000","last_change":"2024-02-17T14:28:07.651004+0000","last_active":"2024-02-17T14:28:10.200129+0000","last_peered":"2024-02-17T14:28:10.200129+0000","last_clean":"2024-02-17T14:28:10.200129+0000","last_became_active":"2024-02-17T14:28:07.650627+0000","last_became_peered":"2024-02-17T14:28:07.650627+0000","last_unstale":"2024-02-17T14:28:10.200129+0000","last_undegraded":"2024-02-17T14:28:10.200129+0000","last_fullsized":"2024-02-17T14:28:10.200129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659217+0000","last_change":"2024-02-17T14:28:03.627978+0000","last_active":"2024-02-17T14:28:08.659217+0000","last_peered":"2024-02-17T14:28:08.659217+0000","last_clean":"2024-02-17T14:28:08.659217+0000","last_became_active":"2024-02-17T14:28:03.627708+0000","last_became_peered":"2024-02-17T14:28:03.627708+0000","last_unstale":"2024-02-17T14:28:08.659217+0000","last_undegraded":"2024-02-17T14:28:08.659217+0000","last_fullsized":"2024-02-17T14:28:08.659217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659359+0000","last_change":"2024-02-17T14:28:03.071479+0000","last_active":"2024-02-17T14:28:08.659359+0000","last_peered":"2024-02-17T14:28:08.659359+0000","last_clean":"2024-02-17T14:28:08.659359+0000","last_became_active":"2024-02-17T14:28:03.071170+0000","last_became_peered":"2024-02-17T14:28:03.071170+0000","last_unstale":"2024-02-17T14:28:08.659359+0000","last_undegraded":"2024-02-17T14:28:08.659359+0000","last_fullsized":"2024-02-17T14:28:08.659359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:03:44.733125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199746+0000","last_change":"2024-02-17T14:28:03.073225+0000","last_active":"2024-02-17T14:28:10.199746+0000","last_peered":"2024-02-17T14:28:10.199746+0000","last_clean":"2024-02-17T14:28:10.199746+0000","last_became_active":"2024-02-17T14:28:03.072928+0000","last_became_peered":"2024-02-17T14:28:03.072928+0000","last_unstale":"2024-02-17T14:28:10.199746+0000","last_undegraded":"2024-02-17T14:28:10.199746+0000","last_fullsized":"2024-02-17T14:28:10.199746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231675+0000","last_change":"2024-02-17T14:28:03.635534+0000","last_active":"2024-02-17T14:28:10.231675+0000","last_peered":"2024-02-17T14:28:10.231675+0000","last_clean":"2024-02-17T14:28:10.231675+0000","last_became_active":"2024-02-17T14:28:03.635362+0000","last_became_peered":"2024-02-17T14:28:03.635362+0000","last_unstale":"2024-02-17T14:28:10.231675+0000","last_undegraded":"2024-02-17T14:28:10.231675+0000","last_fullsized":"2024-02-17T14:28:10.231675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952161+0000","last_change":"2024-02-17T14:28:07.645087+0000","last_active":"2024-02-17T14:28:08.952161+0000","last_peered":"2024-02-17T14:28:08.952161+0000","last_clean":"2024-02-17T14:28:08.952161+0000","last_became_active":"2024-02-17T14:28:07.644637+0000","last_became_peered":"2024-02-17T14:28:07.644637+0000","last_unstale":"2024-02-17T14:28:08.952161+0000","last_undegraded":"2024-02-17T14:28:08.952161+0000","last_fullsized":"2024-02-17T14:28:08.952161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:39.175950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659718+0000","last_change":"2024-02-17T14:28:03.072162+0000","last_active":"2024-02-17T14:28:08.659718+0000","last_peered":"2024-02-17T14:28:08.659718+0000","last_clean":"2024-02-17T14:28:08.659718+0000","last_became_active":"2024-02-17T14:28:03.071112+0000","last_became_peered":"2024-02-17T14:28:03.071112+0000","last_unstale":"2024-02-17T14:28:08.659718+0000","last_undegraded":"2024-02-17T14:28:08.659718+0000","last_fullsized":"2024-02-17T14:28:08.659718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665058+0000","last_change":"2024-02-17T14:28:03.628403+0000","last_active":"2024-02-17T14:28:08.665058+0000","last_peered":"2024-02-17T14:28:08.665058+0000","last_clean":"2024-02-17T14:28:08.665058+0000","last_became_active":"2024-02-17T14:28:03.628144+0000","last_became_peered":"2024-02-17T14:28:03.628144+0000","last_unstale":"2024-02-17T14:28:08.665058+0000","last_undegraded":"2024-02-17T14:28:08.665058+0000","last_fullsized":"2024-02-17T14:28:08.665058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:01.247136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659662+0000","last_change":"2024-02-17T14:28:07.648376+0000","last_active":"2024-02-17T14:28:08.659662+0000","last_peered":"2024-02-17T14:28:08.659662+0000","last_clean":"2024-02-17T14:28:08.659662+0000","last_became_active":"2024-02-17T14:28:07.647491+0000","last_became_peered":"2024-02-17T14:28:07.647491+0000","last_unstale":"2024-02-17T14:28:08.659662+0000","last_undegraded":"2024-02-17T14:28:08.659662+0000","last_fullsized":"2024-02-17T14:28:08.659662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:12.810441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199485+0000","last_change":"2024-02-17T14:28:03.631191+0000","last_active":"2024-02-17T14:28:10.199485+0000","last_peered":"2024-02-17T14:28:10.199485+0000","last_clean":"2024-02-17T14:28:10.199485+0000","last_became_active":"2024-02-17T14:28:03.630662+0000","last_became_peered":"2024-02-17T14:28:03.630662+0000","last_unstale":"2024-02-17T14:28:10.199485+0000","last_undegraded":"2024-02-17T14:28:10.199485+0000","last_fullsized":"2024-02-17T14:28:10.199485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952028+0000","last_change":"2024-02-17T14:28:03.629028+0000","last_active":"2024-02-17T14:28:08.952028+0000","last_peered":"2024-02-17T14:28:08.952028+0000","last_clean":"2024-02-17T14:28:08.952028+0000","last_became_active":"2024-02-17T14:28:03.628781+0000","last_became_peered":"2024-02-17T14:28:03.628781+0000","last_unstale":"2024-02-17T14:28:08.952028+0000","last_undegraded":"2024-02-17T14:28:08.952028+0000","last_fullsized":"2024-02-17T14:28:08.952028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664578+0000","last_change":"2024-02-17T14:28:03.633531+0000","last_active":"2024-02-17T14:28:08.664578+0000","last_peered":"2024-02-17T14:28:08.664578+0000","last_clean":"2024-02-17T14:28:08.664578+0000","last_became_active":"2024-02-17T14:28:03.633248+0000","last_became_peered":"2024-02-17T14:28:03.633248+0000","last_unstale":"2024-02-17T14:28:08.664578+0000","last_undegraded":"2024-02-17T14:28:08.664578+0000","last_fullsized":"2024-02-17T14:28:08.664578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231592+0000","last_change":"2024-02-17T14:28:03.627122+0000","last_active":"2024-02-17T14:28:10.231592+0000","last_peered":"2024-02-17T14:28:10.231592+0000","last_clean":"2024-02-17T14:28:10.231592+0000","last_became_active":"2024-02-17T14:28:03.626738+0000","last_became_peered":"2024-02-17T14:28:03.626738+0000","last_unstale":"2024-02-17T14:28:10.231592+0000","last_undegraded":"2024-02-17T14:28:10.231592+0000","last_fullsized":"2024-02-17T14:28:10.231592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659986+0000","last_change":"2024-02-17T14:28:03.631182+0000","last_active":"2024-02-17T14:28:08.659986+0000","last_peered":"2024-02-17T14:28:08.659986+0000","last_clean":"2024-02-17T14:28:08.659986+0000","last_became_active":"2024-02-17T14:28:03.630705+0000","last_became_peered":"2024-02-17T14:28:03.630705+0000","last_unstale":"2024-02-17T14:28:08.659986+0000","last_undegraded":"2024-02-17T14:28:08.659986+0000","last_fullsized":"2024-02-17T14:28:08.659986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008574+0000","last_change":"2024-02-17T14:28:03.631731+0000","last_active":"2024-02-17T14:28:09.008574+0000","last_peered":"2024-02-17T14:28:09.008574+0000","last_clean":"2024-02-17T14:28:09.008574+0000","last_became_active":"2024-02-17T14:28:03.631476+0000","last_became_peered":"2024-02-17T14:28:03.631476+0000","last_unstale":"2024-02-17T14:28:09.008574+0000","last_undegraded":"2024-02-17T14:28:09.008574+0000","last_fullsized":"2024-02-17T14:28:09.008574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200191+0000","last_change":"2024-02-17T14:28:03.638716+0000","last_active":"2024-02-17T14:28:10.200191+0000","last_peered":"2024-02-17T14:28:10.200191+0000","last_clean":"2024-02-17T14:28:10.200191+0000","last_became_active":"2024-02-17T14:28:03.638442+0000","last_became_peered":"2024-02-17T14:28:03.638442+0000","last_unstale":"2024-02-17T14:28:10.200191+0000","last_undegraded":"2024-02-17T14:28:10.200191+0000","last_fullsized":"2024-02-17T14:28:10.200191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659705+0000","last_change":"2024-02-17T14:28:03.630945+0000","last_active":"2024-02-17T14:28:08.659705+0000","last_peered":"2024-02-17T14:28:08.659705+0000","last_clean":"2024-02-17T14:28:08.659705+0000","last_became_active":"2024-02-17T14:28:03.630676+0000","last_became_peered":"2024-02-17T14:28:03.630676+0000","last_unstale":"2024-02-17T14:28:08.659705+0000","last_undegraded":"2024-02-17T14:28:08.659705+0000","last_fullsized":"2024-02-17T14:28:08.659705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664109+0000","last_change":"2024-02-17T14:28:03.627202+0000","last_active":"2024-02-17T14:28:08.664109+0000","last_peered":"2024-02-17T14:28:08.664109+0000","last_clean":"2024-02-17T14:28:08.664109+0000","last_became_active":"2024-02-17T14:28:03.626848+0000","last_became_peered":"2024-02-17T14:28:03.626848+0000","last_unstale":"2024-02-17T14:28:08.664109+0000","last_undegraded":"2024-02-17T14:28:08.664109+0000","last_fullsized":"2024-02-17T14:28:08.664109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659335+0000","last_change":"2024-02-17T14:28:03.627493+0000","last_active":"2024-02-17T14:28:08.659335+0000","last_peered":"2024-02-17T14:28:08.659335+0000","last_clean":"2024-02-17T14:28:08.659335+0000","last_became_active":"2024-02-17T14:28:03.626450+0000","last_became_peered":"2024-02-17T14:28:03.626450+0000","last_unstale":"2024-02-17T14:28:08.659335+0000","last_undegraded":"2024-02-17T14:28:08.659335+0000","last_fullsized":"2024-02-17T14:28:08.659335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664490+0000","last_change":"2024-02-17T14:28:03.639610+0000","last_active":"2024-02-17T14:28:08.664490+0000","last_peered":"2024-02-17T14:28:08.664490+0000","last_clean":"2024-02-17T14:28:08.664490+0000","last_became_active":"2024-02-17T14:28:03.639330+0000","last_became_peered":"2024-02-17T14:28:03.639330+0000","last_unstale":"2024-02-17T14:28:08.664490+0000","last_undegraded":"2024-02-17T14:28:08.664490+0000","last_fullsized":"2024-02-17T14:28:08.664490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231482+0000","last_change":"2024-02-17T14:28:03.641774+0000","last_active":"2024-02-17T14:28:10.231482+0000","last_peered":"2024-02-17T14:28:10.231482+0000","last_clean":"2024-02-17T14:28:10.231482+0000","last_became_active":"2024-02-17T14:28:03.641485+0000","last_became_peered":"2024-02-17T14:28:03.641485+0000","last_unstale":"2024-02-17T14:28:10.231482+0000","last_undegraded":"2024-02-17T14:28:10.231482+0000","last_fullsized":"2024-02-17T14:28:10.231482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199910+0000","last_change":"2024-02-17T14:28:03.630129+0000","last_active":"2024-02-17T14:28:10.199910+0000","last_peered":"2024-02-17T14:28:10.199910+0000","last_clean":"2024-02-17T14:28:10.199910+0000","last_became_active":"2024-02-17T14:28:03.629841+0000","last_became_peered":"2024-02-17T14:28:03.629841+0000","last_unstale":"2024-02-17T14:28:10.199910+0000","last_undegraded":"2024-02-17T14:28:10.199910+0000","last_fullsized":"2024-02-17T14:28:10.199910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653773+0000","last_change":"2024-02-17T14:28:03.642676+0000","last_active":"2024-02-17T14:28:10.653773+0000","last_peered":"2024-02-17T14:28:10.653773+0000","last_clean":"2024-02-17T14:28:10.653773+0000","last_became_active":"2024-02-17T14:28:03.642150+0000","last_became_peered":"2024-02-17T14:28:03.642150+0000","last_unstale":"2024-02-17T14:28:10.653773+0000","last_undegraded":"2024-02-17T14:28:10.653773+0000","last_fullsized":"2024-02-17T14:28:10.653773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.952216+0000","last_change":"2024-02-17T14:28:03.632127+0000","last_active":"2024-02-17T14:28:08.952216+0000","last_peered":"2024-02-17T14:28:08.952216+0000","last_clean":"2024-02-17T14:28:08.952216+0000","last_became_active":"2024-02-17T14:28:03.631844+0000","last_became_peered":"2024-02-17T14:28:03.631844+0000","last_unstale":"2024-02-17T14:28:08.952216+0000","last_undegraded":"2024-02-17T14:28:08.952216+0000","last_fullsized":"2024-02-17T14:28:08.952216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:07.756422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.665733+0000","last_change":"2024-02-17T14:28:03.638703+0000","last_active":"2024-02-17T14:28:08.665733+0000","last_peered":"2024-02-17T14:28:08.665733+0000","last_clean":"2024-02-17T14:28:08.665733+0000","last_became_active":"2024-02-17T14:28:03.638427+0000","last_became_peered":"2024-02-17T14:28:03.638427+0000","last_unstale":"2024-02-17T14:28:08.665733+0000","last_undegraded":"2024-02-17T14:28:08.665733+0000","last_fullsized":"2024-02-17T14:28:08.665733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.663890+0000","last_change":"2024-02-17T14:28:03.628626+0000","last_active":"2024-02-17T14:28:08.663890+0000","last_peered":"2024-02-17T14:28:08.663890+0000","last_clean":"2024-02-17T14:28:08.663890+0000","last_became_active":"2024-02-17T14:28:03.628343+0000","last_became_peered":"2024-02-17T14:28:03.628343+0000","last_unstale":"2024-02-17T14:28:08.663890+0000","last_undegraded":"2024-02-17T14:28:08.663890+0000","last_fullsized":"2024-02-17T14:28:08.663890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008316+0000","last_change":"2024-02-17T14:28:03.635610+0000","last_active":"2024-02-17T14:28:09.008316+0000","last_peered":"2024-02-17T14:28:09.008316+0000","last_clean":"2024-02-17T14:28:09.008316+0000","last_became_active":"2024-02-17T14:28:03.635340+0000","last_became_peered":"2024-02-17T14:28:03.635340+0000","last_unstale":"2024-02-17T14:28:09.008316+0000","last_undegraded":"2024-02-17T14:28:09.008316+0000","last_fullsized":"2024-02-17T14:28:09.008316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231274+0000","last_change":"2024-02-17T14:28:03.632540+0000","last_active":"2024-02-17T14:28:10.231274+0000","last_peered":"2024-02-17T14:28:10.231274+0000","last_clean":"2024-02-17T14:28:10.231274+0000","last_became_active":"2024-02-17T14:28:03.632273+0000","last_became_peered":"2024-02-17T14:28:03.632273+0000","last_unstale":"2024-02-17T14:28:10.231274+0000","last_undegraded":"2024-02-17T14:28:10.231274+0000","last_fullsized":"2024-02-17T14:28:10.231274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:35.598281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659538+0000","last_change":"2024-02-17T14:28:03.631678+0000","last_active":"2024-02-17T14:28:08.659538+0000","last_peered":"2024-02-17T14:28:08.659538+0000","last_clean":"2024-02-17T14:28:08.659538+0000","last_became_active":"2024-02-17T14:28:03.631431+0000","last_became_peered":"2024-02-17T14:28:03.631431+0000","last_unstale":"2024-02-17T14:28:08.659538+0000","last_undegraded":"2024-02-17T14:28:08.659538+0000","last_fullsized":"2024-02-17T14:28:08.659538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664773+0000","last_change":"2024-02-17T14:28:03.631661+0000","last_active":"2024-02-17T14:28:08.664773+0000","last_peered":"2024-02-17T14:28:08.664773+0000","last_clean":"2024-02-17T14:28:08.664773+0000","last_became_active":"2024-02-17T14:28:03.631379+0000","last_became_peered":"2024-02-17T14:28:03.631379+0000","last_unstale":"2024-02-17T14:28:08.664773+0000","last_undegraded":"2024-02-17T14:28:08.664773+0000","last_fullsized":"2024-02-17T14:28:08.664773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:03.242976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.199968+0000","last_change":"2024-02-17T14:28:03.635522+0000","last_active":"2024-02-17T14:28:10.199968+0000","last_peered":"2024-02-17T14:28:10.199968+0000","last_clean":"2024-02-17T14:28:10.199968+0000","last_became_active":"2024-02-17T14:28:03.635254+0000","last_became_peered":"2024-02-17T14:28:03.635254+0000","last_unstale":"2024-02-17T14:28:10.199968+0000","last_undegraded":"2024-02-17T14:28:10.199968+0000","last_fullsized":"2024-02-17T14:28:10.199968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.200179+0000","last_change":"2024-02-17T14:28:03.635588+0000","last_active":"2024-02-17T14:28:10.200179+0000","last_peered":"2024-02-17T14:28:10.200179+0000","last_clean":"2024-02-17T14:28:10.200179+0000","last_became_active":"2024-02-17T14:28:03.635312+0000","last_became_peered":"2024-02-17T14:28:03.635312+0000","last_unstale":"2024-02-17T14:28:10.200179+0000","last_undegraded":"2024-02-17T14:28:10.200179+0000","last_fullsized":"2024-02-17T14:28:10.200179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653775+0000","last_change":"2024-02-17T14:28:03.646624+0000","last_active":"2024-02-17T14:28:10.653775+0000","last_peered":"2024-02-17T14:28:10.653775+0000","last_clean":"2024-02-17T14:28:10.653775+0000","last_became_active":"2024-02-17T14:28:03.646337+0000","last_became_peered":"2024-02-17T14:28:03.646337+0000","last_unstale":"2024-02-17T14:28:10.653775+0000","last_undegraded":"2024-02-17T14:28:10.653775+0000","last_fullsized":"2024-02-17T14:28:10.653775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:10.836577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.659106+0000","last_change":"2024-02-17T14:28:03.635018+0000","last_active":"2024-02-17T14:28:08.659106+0000","last_peered":"2024-02-17T14:28:08.659106+0000","last_clean":"2024-02-17T14:28:08.659106+0000","last_became_active":"2024-02-17T14:28:03.634751+0000","last_became_peered":"2024-02-17T14:28:03.634751+0000","last_unstale":"2024-02-17T14:28:08.659106+0000","last_undegraded":"2024-02-17T14:28:08.659106+0000","last_fullsized":"2024-02-17T14:28:08.659106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653292+0000","last_change":"2024-02-17T14:28:03.641708+0000","last_active":"2024-02-17T14:28:10.653292+0000","last_peered":"2024-02-17T14:28:10.653292+0000","last_clean":"2024-02-17T14:28:10.653292+0000","last_became_active":"2024-02-17T14:28:03.641260+0000","last_became_peered":"2024-02-17T14:28:03.641260+0000","last_unstale":"2024-02-17T14:28:10.653292+0000","last_undegraded":"2024-02-17T14:28:10.653292+0000","last_fullsized":"2024-02-17T14:28:10.653292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664400+0000","last_change":"2024-02-17T14:28:03.628239+0000","last_active":"2024-02-17T14:28:08.664400+0000","last_peered":"2024-02-17T14:28:08.664400+0000","last_clean":"2024-02-17T14:28:08.664400+0000","last_became_active":"2024-02-17T14:28:03.627918+0000","last_became_peered":"2024-02-17T14:28:03.627918+0000","last_unstale":"2024-02-17T14:28:08.664400+0000","last_undegraded":"2024-02-17T14:28:08.664400+0000","last_fullsized":"2024-02-17T14:28:08.664400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653391+0000","last_change":"2024-02-17T14:28:03.641192+0000","last_active":"2024-02-17T14:28:10.653391+0000","last_peered":"2024-02-17T14:28:10.653391+0000","last_clean":"2024-02-17T14:28:10.653391+0000","last_became_active":"2024-02-17T14:28:03.640873+0000","last_became_peered":"2024-02-17T14:28:03.640873+0000","last_unstale":"2024-02-17T14:28:10.653391+0000","last_undegraded":"2024-02-17T14:28:10.653391+0000","last_fullsized":"2024-02-17T14:28:10.653391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:08.664766+0000","last_change":"2024-02-17T14:28:03.634770+0000","last_active":"2024-02-17T14:28:08.664766+0000","last_peered":"2024-02-17T14:28:08.664766+0000","last_clean":"2024-02-17T14:28:08.664766+0000","last_became_active":"2024-02-17T14:28:03.634397+0000","last_became_peered":"2024-02-17T14:28:03.634397+0000","last_unstale":"2024-02-17T14:28:08.664766+0000","last_undegraded":"2024-02-17T14:28:08.664766+0000","last_fullsized":"2024-02-17T14:28:08.664766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:38.398272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.231407+0000","last_change":"2024-02-17T14:28:03.628223+0000","last_active":"2024-02-17T14:28:10.231407+0000","last_peered":"2024-02-17T14:28:10.231407+0000","last_clean":"2024-02-17T14:28:10.231407+0000","last_became_active":"2024-02-17T14:28:03.627978+0000","last_became_peered":"2024-02-17T14:28:03.627978+0000","last_unstale":"2024-02-17T14:28:10.231407+0000","last_undegraded":"2024-02-17T14:28:10.231407+0000","last_fullsized":"2024-02-17T14:28:10.231407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:09.008914+0000","last_change":"2024-02-17T14:28:03.631742+0000","last_active":"2024-02-17T14:28:09.008914+0000","last_peered":"2024-02-17T14:28:09.008914+0000","last_clean":"2024-02-17T14:28:09.008914+0000","last_became_active":"2024-02-17T14:28:03.631493+0000","last_became_peered":"2024-02-17T14:28:03.631493+0000","last_unstale":"2024-02-17T14:28:09.008914+0000","last_undegraded":"2024-02-17T14:28:09.008914+0000","last_fullsized":"2024-02-17T14:28:09.008914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-02-17T14:28:10.653565+0000","last_change":"2024-02-17T14:28:03.641525+0000","last_active":"2024-02-17T14:28:10.653565+0000","last_peered":"2024-02-17T14:28:10.653565+0000","last_clean":"2024-02-17T14:28:10.653565+0000","last_became_active":"2024-02-17T14:28:03.641154+0000","last_became_peered":"2024-02-17T14:28:03.641154+0000","last_unstale":"2024-02-17T14:28:10.653565+0000","last_undegraded":"2024-02-17T14:28:10.653565+0000","last_fullsized":"2024-02-17T14:28:10.653565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":695877,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":695933,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T14:28:30.330 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-17T14:28:30.330 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-17T14:28:30.330 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-17T14:28:30.330 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-17T14:28:30.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.464+0000 7f0cacac0640 1 Processor -- start 2024-02-17T14:28:30.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.464+0000 7f0cacac0640 1 -- start start 2024-02-17T14:28:30.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.464+0000 7f0cacac0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0ca80b31f0 0x7f0ca80b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.464+0000 7f0cacac0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca813e7a0 0x7f0ca813ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.464+0000 7f0cacac0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80b1ff0 con 0x7f0ca8072870 2024-02-17T14:28:30.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.464+0000 7f0cacac0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca80b37d0 con 0x7f0ca80b31f0 2024-02-17T14:28:30.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.464+0000 7f0cacac0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80b2a20 con 0x7f0ca813e7a0 2024-02-17T14:28:30.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.464+0000 7f0ca5d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0ca80b31f0 0x7f0ca80b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.465+0000 7f0ca5d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0ca80b31f0 0x7f0ca80b57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46520/0 (socket says 172.21.15.134:46520) 2024-02-17T14:28:30.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.465+0000 7f0ca5d9b640 1 -- 172.21.15.134:0/3879105879 learned_addr learned my addr 172.21.15.134:0/3879105879 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:30.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.465+0000 7f0ca6d9d640 1 --2- 172.21.15.134:0/3879105879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca813e7a0 0x7f0ca813ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.465+0000 7f0ca5d9b640 1 -- 172.21.15.134:0/3879105879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca813e7a0 msgr2=0x7f0ca813ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:30.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.465+0000 7f0ca5d9b640 1 --2- 172.21.15.134:0/3879105879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca813e7a0 0x7f0ca813ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.465+0000 7f0ca5d9b640 1 -- 172.21.15.134:0/3879105879 >> v1:172.21.15.142:6789/0 conn(0x7f0ca8072870 legacy=0x7f0ca8148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:30.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.465+0000 7f0ca5d9b640 1 -- 172.21.15.134:0/3879105879 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca80b1bd0 con 0x7f0ca80b31f0 2024-02-17T14:28:30.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.466+0000 7f0ca5d9b640 1 --2- 172.21.15.134:0/3879105879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca80b31f0 0x7f0ca80b57e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009e50 tx=0x7f0c9c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d6684c955babb9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:30.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.466+0000 7f0ca559a640 1 -- 172.21.15.134:0/3879105879 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c02ca70 con 0x7f0ca80b31f0 2024-02-17T14:28:30.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.466+0000 7f0ca559a640 1 -- 172.21.15.134:0/3879105879 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c02cbd0 con 0x7f0ca80b31f0 2024-02-17T14:28:30.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.466+0000 7f0ca559a640 1 -- 172.21.15.134:0/3879105879 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0343f0 con 0x7f0ca80b31f0 2024-02-17T14:28:30.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.466+0000 7f0cacac0640 1 -- 172.21.15.134:0/3879105879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca80b31f0 msgr2=0x7f0ca80b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.466+0000 7f0cacac0640 1 --2- 172.21.15.134:0/3879105879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca80b31f0 0x7f0ca80b57e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009e50 tx=0x7f0c9c02bed0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.466+0000 7f0cacac0640 1 -- 172.21.15.134:0/3879105879 shutdown_connections 2024-02-17T14:28:30.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.466+0000 7f0cacac0640 1 --2- 172.21.15.134:0/3879105879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca813e7a0 0x7f0ca813ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.466+0000 7f0cacac0640 1 --2- 172.21.15.134:0/3879105879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca80b31f0 0x7f0ca80b57e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.466+0000 7f0cacac0640 1 -- 172.21.15.134:0/3879105879 >> 172.21.15.134:0/3879105879 conn(0x7f0ca80b9310 msgr2=0x7f0ca80b9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:30.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.466+0000 7f0cacac0640 1 -- 172.21.15.134:0/3879105879 shutdown_connections 2024-02-17T14:28:30.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.466+0000 7f0cacac0640 1 -- 172.21.15.134:0/3879105879 wait complete. 2024-02-17T14:28:30.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.467+0000 7f0cacac0640 1 Processor -- start 2024-02-17T14:28:30.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.467+0000 7f0cacac0640 1 -- start start 2024-02-17T14:28:30.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0cacac0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ca8072870 0x7f0ca80ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0cacac0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca80b31f0 0x7f0ca81dfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0cacac0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca813e7a0 0x7f0ca80ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0cacac0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8144cb0 con 0x7f0ca80b31f0 2024-02-17T14:28:30.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0cacac0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80af450 con 0x7f0ca8072870 2024-02-17T14:28:30.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0cacac0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80aeee0 con 0x7f0ca813e7a0 2024-02-17T14:28:30.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0ca5d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca80b31f0 0x7f0ca81dfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0ca5d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca80b31f0 0x7f0ca81dfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46536/0 (socket says 172.21.15.134:46536) 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0ca5d9b640 1 -- 172.21.15.134:0/2617318781 learned_addr learned my addr 172.21.15.134:0/2617318781 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0ca6d9d640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca813e7a0 0x7f0ca80ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0ca659c640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ca8072870 0x7f0ca80ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0ca5d9b640 1 -- 172.21.15.134:0/2617318781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca813e7a0 msgr2=0x7f0ca80ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0ca5d9b640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca813e7a0 0x7f0ca80ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0ca5d9b640 1 -- 172.21.15.134:0/2617318781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ca8072870 msgr2=0x7f0ca80ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0ca5d9b640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ca8072870 0x7f0ca80ae9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.468+0000 7f0ca5d9b640 1 -- 172.21.15.134:0/2617318781 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c009b30 con 0x7f0ca80b31f0 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.469+0000 7f0ca5d9b640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca80b31f0 0x7f0ca81dfbc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c036040 tx=0x7f0c9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.469+0000 7f0c96ffd640 1 -- 172.21.15.134:0/2617318781 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c009510 con 0x7f0ca80b31f0 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.469+0000 7f0c96ffd640 1 -- 172.21.15.134:0/2617318781 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c03e450 con 0x7f0ca80b31f0 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.469+0000 7f0cacac0640 1 -- 172.21.15.134:0/2617318781 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca8144740 con 0x7f0ca80b31f0 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.469+0000 7f0c96ffd640 1 -- 172.21.15.134:0/2617318781 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c03e800 con 0x7f0ca80b31f0 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.469+0000 7f0cacac0640 1 -- 172.21.15.134:0/2617318781 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca81442f0 con 0x7f0ca80b31f0 2024-02-17T14:28:30.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.470+0000 7f0cacac0640 1 -- 172.21.15.134:0/2617318781 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca81445a0 con 0x7f0ca80b31f0 2024-02-17T14:28:30.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.470+0000 7f0c96ffd640 1 -- 172.21.15.134:0/2617318781 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0c9c03e960 con 0x7f0ca80b31f0 2024-02-17T14:28:30.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.471+0000 7f0c96ffd640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0c8806b840 0x7f0c8806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.471+0000 7f0c96ffd640 1 -- 172.21.15.134:0/2617318781 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0c9c0ad100 con 0x7f0ca80b31f0 2024-02-17T14:28:30.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.471+0000 7f0ca659c640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0c8806b840 0x7f0c8806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.471+0000 7f0ca659c640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0c8806b840 0x7f0c8806dd00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0001780 tx=0x7f0ca0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:30.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.475+0000 7f0c96ffd640 1 -- 172.21.15.134:0/2617318781 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ca81445a0 con 0x7f0ca80b31f0 2024-02-17T14:28:30.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.680+0000 7f0cacac0640 1 -- 172.21.15.134:0/2617318781 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0ca81451d0 con 0x7f0ca80b31f0 2024-02-17T14:28:30.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.680+0000 7f0c96ffd640 1 -- 172.21.15.134:0/2617318781 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0ca81451d0 con 0x7f0ca80b31f0 2024-02-17T14:28:30.680 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:30.680 INFO:teuthology.orchestra.run.smithi134.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-17T14:28:30.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.682+0000 7f0cacac0640 1 -- 172.21.15.134:0/2617318781 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0c8806b840 msgr2=0x7f0c8806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.682+0000 7f0cacac0640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0c8806b840 0x7f0c8806dd00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0001780 tx=0x7f0ca0009040 comp rx=0 tx=0).stop 2024-02-17T14:28:30.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.682+0000 7f0cacac0640 1 -- 172.21.15.134:0/2617318781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca80b31f0 msgr2=0x7f0ca81dfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.682+0000 7f0cacac0640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca80b31f0 0x7f0ca81dfbc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c036040 tx=0x7f0c9c004a40 comp rx=0 tx=0).stop 2024-02-17T14:28:30.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.682+0000 7f0cacac0640 1 -- 172.21.15.134:0/2617318781 shutdown_connections 2024-02-17T14:28:30.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.682+0000 7f0cacac0640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca813e7a0 0x7f0ca80ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.682+0000 7f0cacac0640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0c8806b840 0x7f0c8806dd00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.682+0000 7f0cacac0640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca80b31f0 0x7f0ca81dfbc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.682+0000 7f0cacac0640 1 --2- 172.21.15.134:0/2617318781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ca8072870 0x7f0ca80ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.682+0000 7f0cacac0640 1 -- 172.21.15.134:0/2617318781 >> 172.21.15.134:0/2617318781 conn(0x7f0ca80b9310 msgr2=0x7f0ca806b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:30.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.682+0000 7f0cacac0640 1 -- 172.21.15.134:0/2617318781 shutdown_connections 2024-02-17T14:28:30.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.682+0000 7f0cacac0640 1 -- 172.21.15.134:0/2617318781 wait complete. 2024-02-17T14:28:30.692 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-17T14:28:30.693 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:30.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.794+0000 7f0e2258c640 1 Processor -- start 2024-02-17T14:28:30.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.794+0000 7f0e2258c640 1 -- start start 2024-02-17T14:28:30.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.795+0000 7f0e2258c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0e1c09b3f0 0x7f0e1c0b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.795+0000 7f0e2258c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1c06b530 con 0x7f0e1c146f20 2024-02-17T14:28:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.795+0000 7f0e2258c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1c0b85e0 con 0x7f0e1c14f7b0 2024-02-17T14:28:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.795+0000 7f0e2258c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1c09b7d0 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.795+0000 7f0e1bfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0e1c09b3f0 0x7f0e1c0b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.795+0000 7f0e1b7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0e1c146f20 0x7f0e1c147380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51206/0 (socket says 172.21.15.134:51206) 2024-02-17T14:28:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.795+0000 7f0e1b7fe640 1 -- 172.21.15.134:0/2468934520 learned_addr learned my addr 172.21.15.134:0/2468934520 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.795+0000 7f0e1bfff640 1 -- 172.21.15.134:0/2468934520 >> v1:172.21.15.142:6789/0 conn(0x7f0e1c14f7b0 legacy=0x7f0e1c151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.795+0000 7f0e1bfff640 1 -- 172.21.15.134:0/2468934520 >> v1:172.21.15.134:6789/0 conn(0x7f0e1c146f20 legacy=0x7f0e1c147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.795+0000 7f0e1affd640 1 -- 172.21.15.134:0/2468934520 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592764487 0 0) 0x7f0e1c06b530 con 0x7f0e1c146f20 2024-02-17T14:28:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.795+0000 7f0e1bfff640 1 -- 172.21.15.134:0/2468934520 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c06af00 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.796+0000 7f0e1bfff640 1 --2- 172.21.15.134:0/2468934520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1c09b3f0 0x7f0e1c0b6fb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0097a0 tx=0x7f0e0c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1187a5da7b15144b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.796+0000 7f0e1affd640 1 -- 172.21.15.134:0/2468934520 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c031830 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.796+0000 7f0e1affd640 1 -- 172.21.15.134:0/2468934520 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c031990 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.796+0000 7f0e1affd640 1 -- 172.21.15.134:0/2468934520 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c031d20 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.797+0000 7f0e2258c640 1 -- 172.21.15.134:0/2468934520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1c09b3f0 msgr2=0x7f0e1c0b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.797+0000 7f0e2258c640 1 --2- 172.21.15.134:0/2468934520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1c09b3f0 0x7f0e1c0b6fb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0097a0 tx=0x7f0e0c02b8d0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.797+0000 7f0e2258c640 1 -- 172.21.15.134:0/2468934520 shutdown_connections 2024-02-17T14:28:30.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.797+0000 7f0e2258c640 1 --2- 172.21.15.134:0/2468934520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1c09b3f0 0x7f0e1c0b6fb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.797+0000 7f0e2258c640 1 -- 172.21.15.134:0/2468934520 >> 172.21.15.134:0/2468934520 conn(0x7f0e1c0bc630 msgr2=0x7f0e1c0bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:30.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.797+0000 7f0e2258c640 1 -- 172.21.15.134:0/2468934520 shutdown_connections 2024-02-17T14:28:30.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.797+0000 7f0e2258c640 1 -- 172.21.15.134:0/2468934520 wait complete. 2024-02-17T14:28:30.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.798+0000 7f0e2258c640 1 Processor -- start 2024-02-17T14:28:30.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.798+0000 7f0e2258c640 1 -- start start 2024-02-17T14:28:30.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.798+0000 7f0e2258c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1c09b3f0 0x7f0e1c1e0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e2258c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e1c146f20 0x7f0e1c1dd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e2258c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c14f7b0 0x7f0e1c1dd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e2258c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c1e1510 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e2258c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c0b65c0 con 0x7f0e1c146f20 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e2258c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c0b56e0 con 0x7f0e1c14f7b0 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e1bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1c09b3f0 0x7f0e1c1e0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e1bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1c09b3f0 0x7f0e1c1e0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46542/0 (socket says 172.21.15.134:46542) 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e1bfff640 1 -- 172.21.15.134:0/2044037350 learned_addr learned my addr 172.21.15.134:0/2044037350 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e1bfff640 1 -- 172.21.15.134:0/2044037350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c14f7b0 msgr2=0x7f0e1c1dd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e1bfff640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c14f7b0 0x7f0e1c1dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e1b7fe640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e1c146f20 0x7f0e1c1dd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e1bfff640 1 -- 172.21.15.134:0/2044037350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e1c146f20 msgr2=0x7f0e1c1dd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e1bfff640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e1c146f20 0x7f0e1c1dd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e1bfff640 1 -- 172.21.15.134:0/2044037350 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c009400 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e1b7fe640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e1c146f20 0x7f0e1c1dd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e1bfff640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1c09b3f0 0x7f0e1c1e0aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c02bee0 tx=0x7f0e0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e18ff9640 1 -- 172.21.15.134:0/2044037350 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c03ba70 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e18ff9640 1 -- 172.21.15.134:0/2044037350 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c03bbd0 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e2258c640 1 -- 172.21.15.134:0/2044037350 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1c1e1130 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e18ff9640 1 -- 172.21.15.134:0/2044037350 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0453f0 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.799+0000 7f0e2258c640 1 -- 172.21.15.134:0/2044037350 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1c0af6f0 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.800+0000 7f0e2258c640 1 -- 172.21.15.134:0/2044037350 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1c1e1650 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.801+0000 7f0e18ff9640 1 -- 172.21.15.134:0/2044037350 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0e0c045550 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.801+0000 7f0e18ff9640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0e0806b810 0x7f0e0806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.801+0000 7f0e18ff9640 1 -- 172.21.15.134:0/2044037350 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0e0c0ac9f0 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.801+0000 7f0e1b7fe640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0e0806b810 0x7f0e0806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:30.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.801+0000 7f0e1b7fe640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0e0806b810 0x7f0e0806dcd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c141c80 tx=0x7f0e10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:30.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.805+0000 7f0e18ff9640 1 -- 172.21.15.134:0/2044037350 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0e0c077280 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.975+0000 7f0e2258c640 1 -- 172.21.15.134:0/2044037350 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e1c067b70 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.976+0000 7f0e18ff9640 1 -- 172.21.15.134:0/2044037350 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f0e0c07a940 con 0x7f0e1c09b3f0 2024-02-17T14:28:30.976 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:30.976 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:07.990271+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:30.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.978+0000 7f0e2258c640 1 -- 172.21.15.134:0/2044037350 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0e0806b810 msgr2=0x7f0e0806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.978+0000 7f0e2258c640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0e0806b810 0x7f0e0806dcd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c141c80 tx=0x7f0e10009040 comp rx=0 tx=0).stop 2024-02-17T14:28:30.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.978+0000 7f0e2258c640 1 -- 172.21.15.134:0/2044037350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1c09b3f0 msgr2=0x7f0e1c1e0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:30.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.978+0000 7f0e2258c640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1c09b3f0 0x7f0e1c1e0aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c02bee0 tx=0x7f0e0c0046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.978+0000 7f0e2258c640 1 -- 172.21.15.134:0/2044037350 shutdown_connections 2024-02-17T14:28:30.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.978+0000 7f0e2258c640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c14f7b0 0x7f0e1c1dd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.978+0000 7f0e2258c640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e1c146f20 0x7f0e1c1dd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.978+0000 7f0e2258c640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f0e0806b810 0x7f0e0806dcd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.978+0000 7f0e2258c640 1 --2- 172.21.15.134:0/2044037350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e1c09b3f0 0x7f0e1c1e0aa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:30.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.978+0000 7f0e2258c640 1 -- 172.21.15.134:0/2044037350 >> 172.21.15.134:0/2044037350 conn(0x7f0e1c0bc630 msgr2=0x7f0e1c145110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:30.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.978+0000 7f0e2258c640 1 -- 172.21.15.134:0/2044037350 shutdown_connections 2024-02-17T14:28:30.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:30.978+0000 7f0e2258c640 1 -- 172.21.15.134:0/2044037350 wait complete. 2024-02-17T14:28:30.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T14:27:58.602268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T14:28:01.178917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T14:28:02.371936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T14:28:05.647194+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T14:28:30.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T14:28:31.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.092+0000 7fe26bbe2640 1 Processor -- start 2024-02-17T14:28:31.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.092+0000 7fe26bbe2640 1 -- start start 2024-02-17T14:28:31.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.093+0000 7fe26bbe2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2640b51e0 0x7fe2640ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.093+0000 7fe26bbe2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe264148b40 0x7fe26414f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.093+0000 7fe26bbe2640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2640b6520 con 0x7fe2640b21d0 2024-02-17T14:28:31.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.093+0000 7fe26bbe2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2640b5d70 con 0x7fe2640b51e0 2024-02-17T14:28:31.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.093+0000 7fe26bbe2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640b26e0 con 0x7fe264148b40 2024-02-17T14:28:31.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.093+0000 7fe26917d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe2640b21d0 0x7fe264148430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51208/0 (socket says 172.21.15.134:51208) 2024-02-17T14:28:31.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.093+0000 7fe26917d640 1 -- 172.21.15.134:0/1719287401 learned_addr learned my addr 172.21.15.134:0/1719287401 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:31.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.093+0000 7fe26a17f640 1 --2- 172.21.15.134:0/1719287401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe264148b40 0x7fe26414f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.093+0000 7fe26997e640 1 --2- 172.21.15.134:0/1719287401 >> v2:172.21.15.142:3300/0 conn(0x7fe2640b51e0 0x7fe2640ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.093+0000 7fe26897c640 1 -- 172.21.15.134:0/1719287401 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777017941 0 0) 0x7fe2640b6520 con 0x7fe2640b21d0 2024-02-17T14:28:31.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.093+0000 7fe26897c640 1 -- 172.21.15.134:0/1719287401 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe250003520 con 0x7fe2640b21d0 2024-02-17T14:28:31.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.094+0000 7fe26a17f640 1 -- 172.21.15.134:0/1719287401 >> v2:172.21.15.142:3300/0 conn(0x7fe2640b51e0 msgr2=0x7fe2640ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:31.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.094+0000 7fe26a17f640 1 --2- 172.21.15.134:0/1719287401 >> v2:172.21.15.142:3300/0 conn(0x7fe2640b51e0 0x7fe2640ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.094+0000 7fe26a17f640 1 -- 172.21.15.134:0/1719287401 >> v1:172.21.15.134:6789/0 conn(0x7fe2640b21d0 legacy=0x7fe264148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.094+0000 7fe26a17f640 1 -- 172.21.15.134:0/1719287401 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2640b29c0 con 0x7fe264148b40 2024-02-17T14:28:31.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.094+0000 7fe26997e640 1 --2- 172.21.15.134:0/1719287401 >> v2:172.21.15.142:3300/0 conn(0x7fe2640b51e0 0x7fe2640ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:31.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.094+0000 7fe26a17f640 1 --2- 172.21.15.134:0/1719287401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe264148b40 0x7fe26414f970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0097a0 tx=0x7fe25c02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1e68313c1b897fd server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:31.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.095+0000 7fe26897c640 1 -- 172.21.15.134:0/1719287401 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c02f050 con 0x7fe264148b40 2024-02-17T14:28:31.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.095+0000 7fe26897c640 1 -- 172.21.15.134:0/1719287401 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c031700 con 0x7fe264148b40 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.095+0000 7fe26897c640 1 -- 172.21.15.134:0/1719287401 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c031a90 con 0x7fe264148b40 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.095+0000 7fe26bbe2640 1 -- 172.21.15.134:0/1719287401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe264148b40 msgr2=0x7fe26414f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.095+0000 7fe26bbe2640 1 --2- 172.21.15.134:0/1719287401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe264148b40 0x7fe26414f970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0097a0 tx=0x7fe25c02b7a0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.095+0000 7fe26bbe2640 1 -- 172.21.15.134:0/1719287401 shutdown_connections 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.095+0000 7fe26bbe2640 1 --2- 172.21.15.134:0/1719287401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe264148b40 0x7fe26414f970 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.095+0000 7fe26bbe2640 1 --2- 172.21.15.134:0/1719287401 >> v2:172.21.15.142:3300/0 conn(0x7fe2640b51e0 0x7fe2640ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.095+0000 7fe26bbe2640 1 -- 172.21.15.134:0/1719287401 >> 172.21.15.134:0/1719287401 conn(0x7fe2640ba420 msgr2=0x7fe2640ba830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.095+0000 7fe26bbe2640 1 -- 172.21.15.134:0/1719287401 shutdown_connections 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.095+0000 7fe26bbe2640 1 -- 172.21.15.134:0/1719287401 wait complete. 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.096+0000 7fe26bbe2640 1 Processor -- start 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.096+0000 7fe26bbe2640 1 -- start start 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26bbe2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b51e0 0x7fe2641444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26bbe2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe264148b40 0x7fe2641dd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26bbe2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2640ad560 0x7fe264140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26bbe2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640ab400 con 0x7fe2640ad560 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26bbe2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2641ddc30 con 0x7fe264148b40 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26bbe2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640ac710 con 0x7fe2640b51e0 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26a17f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2640ad560 0x7fe264140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26997e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b51e0 0x7fe2641444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26a17f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2640ad560 0x7fe264140b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46554/0 (socket says 172.21.15.134:46554) 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26a17f640 1 -- 172.21.15.134:0/751655084 learned_addr learned my addr 172.21.15.134:0/751655084 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26917d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe264148b40 0x7fe2641dd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26a17f640 1 -- 172.21.15.134:0/751655084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b51e0 msgr2=0x7fe2641444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26a17f640 1 --2- 172.21.15.134:0/751655084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b51e0 0x7fe2641444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26a17f640 1 -- 172.21.15.134:0/751655084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe264148b40 msgr2=0x7fe2641dd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26a17f640 1 --2- 172.21.15.134:0/751655084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe264148b40 0x7fe2641dd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26a17f640 1 -- 172.21.15.134:0/751655084 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe260009a70 con 0x7fe2640ad560 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26997e640 1 --2- 172.21.15.134:0/751655084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b51e0 0x7fe2641444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe26a17f640 1 --2- 172.21.15.134:0/751655084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2640ad560 0x7fe264140b50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe25c02b7e0 tx=0x7fe25c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:31.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe25a7fc640 1 -- 172.21.15.134:0/751655084 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c006e10 con 0x7fe2640ad560 2024-02-17T14:28:31.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.097+0000 7fe25a7fc640 1 -- 172.21.15.134:0/751655084 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c033a30 con 0x7fe2640ad560 2024-02-17T14:28:31.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.098+0000 7fe26bbe2640 1 -- 172.21.15.134:0/751655084 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c009400 con 0x7fe2640ad560 2024-02-17T14:28:31.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.098+0000 7fe25a7fc640 1 -- 172.21.15.134:0/751655084 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c033dc0 con 0x7fe2640ad560 2024-02-17T14:28:31.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.098+0000 7fe26bbe2640 1 -- 172.21.15.134:0/751655084 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe264145060 con 0x7fe2640ad560 2024-02-17T14:28:31.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.099+0000 7fe26bbe2640 1 -- 172.21.15.134:0/751655084 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2640ad280 con 0x7fe2640ad560 2024-02-17T14:28:31.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.099+0000 7fe25a7fc640 1 -- 172.21.15.134:0/751655084 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fe25c03a040 con 0x7fe2640ad560 2024-02-17T14:28:31.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.099+0000 7fe25a7fc640 1 --2- 172.21.15.134:0/751655084 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe24806b810 0x7fe24806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.099+0000 7fe25a7fc640 1 -- 172.21.15.134:0/751655084 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe25c0ab780 con 0x7fe2640ad560 2024-02-17T14:28:31.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.099+0000 7fe26997e640 1 --2- 172.21.15.134:0/751655084 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe24806b810 0x7fe24806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.100+0000 7fe26997e640 1 --2- 172.21.15.134:0/751655084 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe24806b810 0x7fe24806dcd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe260003dc0 tx=0x7fe26000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:31.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.104+0000 7fe25a7fc640 1 -- 172.21.15.134:0/751655084 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe2640ad280 con 0x7fe2640ad560 2024-02-17T14:28:31.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.273+0000 7fe26bbe2640 1 -- 172.21.15.134:0/751655084 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2640ad280 con 0x7fe2640ad560 2024-02-17T14:28:31.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.273+0000 7fe25a7fc640 1 -- 172.21.15.134:0/751655084 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2640ad280 con 0x7fe2640ad560 2024-02-17T14:28:31.273 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-02-17T14:28:31.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.275+0000 7fe26bbe2640 1 -- 172.21.15.134:0/751655084 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe24806b810 msgr2=0x7fe24806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.275+0000 7fe26bbe2640 1 --2- 172.21.15.134:0/751655084 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe24806b810 0x7fe24806dcd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe260003dc0 tx=0x7fe26000b040 comp rx=0 tx=0).stop 2024-02-17T14:28:31.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.275+0000 7fe26bbe2640 1 -- 172.21.15.134:0/751655084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2640ad560 msgr2=0x7fe264140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.275+0000 7fe26bbe2640 1 --2- 172.21.15.134:0/751655084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2640ad560 0x7fe264140b50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe25c02b7e0 tx=0x7fe25c0046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.275+0000 7fe26bbe2640 1 -- 172.21.15.134:0/751655084 shutdown_connections 2024-02-17T14:28:31.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.275+0000 7fe26bbe2640 1 --2- 172.21.15.134:0/751655084 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fe24806b810 0x7fe24806dcd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.275+0000 7fe26bbe2640 1 --2- 172.21.15.134:0/751655084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2640ad560 0x7fe264140b50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.275+0000 7fe26bbe2640 1 --2- 172.21.15.134:0/751655084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe264148b40 0x7fe2641dd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.275+0000 7fe26bbe2640 1 --2- 172.21.15.134:0/751655084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2640b51e0 0x7fe2641444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.275+0000 7fe26bbe2640 1 -- 172.21.15.134:0/751655084 >> 172.21.15.134:0/751655084 conn(0x7fe2640ba420 msgr2=0x7fe2640713b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:31.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.276+0000 7fe26bbe2640 1 -- 172.21.15.134:0/751655084 shutdown_connections 2024-02-17T14:28:31.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.276+0000 7fe26bbe2640 1 -- 172.21.15.134:0/751655084 wait complete. 2024-02-17T14:28:31.286 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T14:28:31.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.391+0000 7fa89b2f4640 1 Processor -- start 2024-02-17T14:28:31.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.391+0000 7fa89b2f4640 1 -- start start 2024-02-17T14:28:31.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.391+0000 7fa89b2f4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa89406ae10 0x7fa894072a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.391+0000 7fa89b2f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8940afe40 0x7fa8940b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.391+0000 7fa89b2f4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8940b57b0 con 0x7fa894072f90 2024-02-17T14:28:31.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.391+0000 7fa89b2f4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8940703f0 con 0x7fa89406ae10 2024-02-17T14:28:31.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.391+0000 7fa89b2f4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89406b1f0 con 0x7fa8940afe40 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.392+0000 7fa899090640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa89406ae10 0x7fa894072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.392+0000 7fa899090640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa89406ae10 0x7fa894072a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46570/0 (socket says 172.21.15.134:46570) 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.392+0000 7fa899090640 1 -- 172.21.15.134:0/3376160826 learned_addr learned my addr 172.21.15.134:0/3376160826 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.392+0000 7fa899891640 1 --2- 172.21.15.134:0/3376160826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8940afe40 0x7fa8940b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.392+0000 7fa899090640 1 -- 172.21.15.134:0/3376160826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8940afe40 msgr2=0x7fa8940b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.392+0000 7fa899090640 1 --2- 172.21.15.134:0/3376160826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8940afe40 0x7fa8940b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.392+0000 7fa899090640 1 -- 172.21.15.134:0/3376160826 >> v1:172.21.15.134:6789/0 conn(0x7fa894072f90 legacy=0x7fa8940b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.392+0000 7fa88bfff640 1 -- 172.21.15.134:0/3376160826 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303723782 0 0) 0x7fa8940b57b0 con 0x7fa894072f90 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.392+0000 7fa899090640 1 -- 172.21.15.134:0/3376160826 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8940722e0 con 0x7fa89406ae10 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.392+0000 7fa899891640 1 --2- 172.21.15.134:0/3376160826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8940afe40 0x7fa8940b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.393+0000 7fa899090640 1 --2- 172.21.15.134:0/3376160826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa89406ae10 0x7fa894072a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa890009870 tx=0x7fa89002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb9a0c3a8ee2d72 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.393+0000 7fa88bfff640 1 -- 172.21.15.134:0/3376160826 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890031640 con 0x7fa89406ae10 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.393+0000 7fa88bfff640 1 -- 172.21.15.134:0/3376160826 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8900317a0 con 0x7fa89406ae10 2024-02-17T14:28:31.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.393+0000 7fa88bfff640 1 -- 172.21.15.134:0/3376160826 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890031b30 con 0x7fa89406ae10 2024-02-17T14:28:31.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.393+0000 7fa89b2f4640 1 -- 172.21.15.134:0/3376160826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa89406ae10 msgr2=0x7fa894072a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.393+0000 7fa89b2f4640 1 --2- 172.21.15.134:0/3376160826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa89406ae10 0x7fa894072a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa890009870 tx=0x7fa89002b8f0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.393+0000 7fa89b2f4640 1 -- 172.21.15.134:0/3376160826 shutdown_connections 2024-02-17T14:28:31.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.393+0000 7fa89b2f4640 1 --2- 172.21.15.134:0/3376160826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8940afe40 0x7fa8940b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.393+0000 7fa89b2f4640 1 --2- 172.21.15.134:0/3376160826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa89406ae10 0x7fa894072a50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.393+0000 7fa89b2f4640 1 -- 172.21.15.134:0/3376160826 >> 172.21.15.134:0/3376160826 conn(0x7fa8940b9310 msgr2=0x7fa8940b9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:31.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.393+0000 7fa89b2f4640 1 -- 172.21.15.134:0/3376160826 shutdown_connections 2024-02-17T14:28:31.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.393+0000 7fa89b2f4640 1 -- 172.21.15.134:0/3376160826 wait complete. 2024-02-17T14:28:31.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.394+0000 7fa89b2f4640 1 Processor -- start 2024-02-17T14:28:31.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.394+0000 7fa89b2f4640 1 -- start start 2024-02-17T14:28:31.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89b2f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89406ae10 0x7fa8940af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89b2f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa894072f90 0x7fa8941dc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89b2f4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8940afe40 0x7fa894143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89b2f4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8941dfc00 con 0x7fa894072f90 2024-02-17T14:28:31.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89b2f4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8941dfee0 con 0x7fa8940afe40 2024-02-17T14:28:31.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89b2f4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8941e01c0 con 0x7fa89406ae10 2024-02-17T14:28:31.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89888f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa894072f90 0x7fa8941dc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89888f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa894072f90 0x7fa8941dc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46578/0 (socket says 172.21.15.134:46578) 2024-02-17T14:28:31.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89888f640 1 -- 172.21.15.134:0/382998514 learned_addr learned my addr 172.21.15.134:0/382998514 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa899090640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89406ae10 0x7fa8940af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89888f640 1 -- 172.21.15.134:0/382998514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89406ae10 msgr2=0x7fa8940af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89888f640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89406ae10 0x7fa8940af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89888f640 1 -- 172.21.15.134:0/382998514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8940afe40 msgr2=0x7fa894143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa899891640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8940afe40 0x7fa894143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89888f640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8940afe40 0x7fa894143490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89888f640 1 -- 172.21.15.134:0/382998514 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900094d0 con 0x7fa894072f90 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.395+0000 7fa89888f640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa894072f90 0x7fa8941dc230 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa88400c520 tx=0x7fa88400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.396+0000 7fa889ffb640 1 -- 172.21.15.134:0/382998514 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8840035f0 con 0x7fa894072f90 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.396+0000 7fa889ffb640 1 -- 172.21.15.134:0/382998514 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa884003770 con 0x7fa894072f90 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.396+0000 7fa89b2f4640 1 -- 172.21.15.134:0/382998514 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8940709c0 con 0x7fa894072f90 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.396+0000 7fa889ffb640 1 -- 172.21.15.134:0/382998514 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884003b20 con 0x7fa894072f90 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.396+0000 7fa89b2f4640 1 -- 172.21.15.134:0/382998514 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8941e06e0 con 0x7fa894072f90 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.397+0000 7fa89b2f4640 1 -- 172.21.15.134:0/382998514 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa894067b70 con 0x7fa894072f90 2024-02-17T14:28:31.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.397+0000 7fa889ffb640 1 -- 172.21.15.134:0/382998514 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa884003c80 con 0x7fa894072f90 2024-02-17T14:28:31.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.397+0000 7fa889ffb640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa87806b810 0x7fa87806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.397+0000 7fa889ffb640 1 -- 172.21.15.134:0/382998514 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa884089b40 con 0x7fa894072f90 2024-02-17T14:28:31.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.398+0000 7fa899090640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa87806b810 0x7fa87806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.398+0000 7fa899090640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa87806b810 0x7fa87806dcd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa890036000 tx=0x7fa89003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:31.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.402+0000 7fa889ffb640 1 -- 172.21.15.134:0/382998514 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8840542b0 con 0x7fa894072f90 2024-02-17T14:28:31.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.570+0000 7fa89b2f4640 1 -- 172.21.15.134:0/382998514 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8940b3320 con 0x7fa894072f90 2024-02-17T14:28:31.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.570+0000 7fa889ffb640 1 -- 172.21.15.134:0/382998514 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa884017020 con 0x7fa894072f90 2024-02-17T14:28:31.570 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-17T14:28:31.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.573+0000 7fa89b2f4640 1 -- 172.21.15.134:0/382998514 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa87806b810 msgr2=0x7fa87806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.573+0000 7fa89b2f4640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa87806b810 0x7fa87806dcd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa890036000 tx=0x7fa89003c040 comp rx=0 tx=0).stop 2024-02-17T14:28:31.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.573+0000 7fa89b2f4640 1 -- 172.21.15.134:0/382998514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa894072f90 msgr2=0x7fa8941dc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.573+0000 7fa89b2f4640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa894072f90 0x7fa8941dc230 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa88400c520 tx=0x7fa88400c9e0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.573+0000 7fa89b2f4640 1 -- 172.21.15.134:0/382998514 shutdown_connections 2024-02-17T14:28:31.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.573+0000 7fa89b2f4640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8940afe40 0x7fa894143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.573+0000 7fa89b2f4640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa87806b810 0x7fa87806dcd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.573+0000 7fa89b2f4640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa894072f90 0x7fa8941dc230 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.573+0000 7fa89b2f4640 1 --2- 172.21.15.134:0/382998514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa89406ae10 0x7fa8940af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.573+0000 7fa89b2f4640 1 -- 172.21.15.134:0/382998514 >> 172.21.15.134:0/382998514 conn(0x7fa8940b9310 msgr2=0x7fa8940b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:31.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.573+0000 7fa89b2f4640 1 -- 172.21.15.134:0/382998514 shutdown_connections 2024-02-17T14:28:31.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.573+0000 7fa89b2f4640 1 -- 172.21.15.134:0/382998514 wait complete. 2024-02-17T14:28:31.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T14:28:31.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.689+0000 7ff28d2ae640 1 Processor -- start 2024-02-17T14:28:31.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.689+0000 7ff28d2ae640 1 -- start start 2024-02-17T14:28:31.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.689+0000 7ff28d2ae640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff2880b5610 0x7ff28806e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.689+0000 7ff28d2ae640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff28809bd10 0x7ff2880b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.689+0000 7ff28d2ae640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff288146f40 0x7ff28806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.689+0000 7ff28d2ae640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2880b6190 con 0x7ff2880b5610 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.689+0000 7ff28d2ae640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28806de70 con 0x7ff288146f40 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.689+0000 7ff28d2ae640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28806e270 con 0x7ff28809bd10 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.689+0000 7ff286ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff2880b5610 0x7ff28806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.689+0000 7ff286ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff2880b5610 0x7ff28806e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46580/0 (socket says 172.21.15.134:46580) 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.689+0000 7ff286ffd640 1 -- 172.21.15.134:0/2808373499 learned_addr learned my addr 172.21.15.134:0/2808373499 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.689+0000 7ff2867fc640 1 --2- 172.21.15.134:0/2808373499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff28809bd10 0x7ff2880b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.690+0000 7ff2877fe640 1 --2- 172.21.15.134:0/2808373499 >> v2:172.21.15.142:3300/0 conn(0x7ff288146f40 0x7ff28806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.690+0000 7ff286ffd640 1 -- 172.21.15.134:0/2808373499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff28809bd10 msgr2=0x7ff2880b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.690+0000 7ff286ffd640 1 --2- 172.21.15.134:0/2808373499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff28809bd10 0x7ff2880b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.690+0000 7ff286ffd640 1 -- 172.21.15.134:0/2808373499 >> v2:172.21.15.142:3300/0 conn(0x7ff288146f40 msgr2=0x7ff28806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.690+0000 7ff286ffd640 1 --2- 172.21.15.134:0/2808373499 >> v2:172.21.15.142:3300/0 conn(0x7ff288146f40 0x7ff28806cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.690+0000 7ff286ffd640 1 -- 172.21.15.134:0/2808373499 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2881473f0 con 0x7ff2880b5610 2024-02-17T14:28:31.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.690+0000 7ff286ffd640 1 --2- 172.21.15.134:0/2808373499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2880b5610 0x7ff28806e700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff2880b66d0 tx=0x7ff27802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f3882eab17e268 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:31.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.690+0000 7ff285ffb640 1 -- 172.21.15.134:0/2808373499 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278031750 con 0x7ff2880b5610 2024-02-17T14:28:31.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.691+0000 7ff285ffb640 1 -- 172.21.15.134:0/2808373499 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2780318b0 con 0x7ff2880b5610 2024-02-17T14:28:31.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.691+0000 7ff285ffb640 1 -- 172.21.15.134:0/2808373499 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278031c40 con 0x7ff2880b5610 2024-02-17T14:28:31.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.691+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2808373499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2880b5610 msgr2=0x7ff28806e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.691+0000 7ff28d2ae640 1 --2- 172.21.15.134:0/2808373499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2880b5610 0x7ff28806e700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff2880b66d0 tx=0x7ff27802b7f0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.691+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2808373499 shutdown_connections 2024-02-17T14:28:31.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.691+0000 7ff28d2ae640 1 --2- 172.21.15.134:0/2808373499 >> v2:172.21.15.142:3300/0 conn(0x7ff288146f40 0x7ff28806cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.691+0000 7ff28d2ae640 1 --2- 172.21.15.134:0/2808373499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff28809bd10 0x7ff2880b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.691+0000 7ff28d2ae640 1 --2- 172.21.15.134:0/2808373499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2880b5610 0x7ff28806e700 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.691+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2808373499 >> 172.21.15.134:0/2808373499 conn(0x7ff2880ba430 msgr2=0x7ff2880ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:31.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.691+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2808373499 shutdown_connections 2024-02-17T14:28:31.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.691+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2808373499 wait complete. 2024-02-17T14:28:31.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.692+0000 7ff28d2ae640 1 Processor -- start 2024-02-17T14:28:31.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.692+0000 7ff28d2ae640 1 -- start start 2024-02-17T14:28:31.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff28d2ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff28809bd10 0x7ff288142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff28d2ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2880b5610 0x7ff288144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff28d2ae640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff288146f40 0x7ff2881dca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff28d2ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff288144300 con 0x7ff28809bd10 2024-02-17T14:28:31.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff28d2ae640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28809fdc0 con 0x7ff2880b5610 2024-02-17T14:28:31.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff28d2ae640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff288144c90 con 0x7ff288146f40 2024-02-17T14:28:31.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff286ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff28809bd10 0x7ff288142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff286ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff28809bd10 0x7ff288142230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46584/0 (socket says 172.21.15.134:46584) 2024-02-17T14:28:31.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff286ffd640 1 -- 172.21.15.134:0/2098979111 learned_addr learned my addr 172.21.15.134:0/2098979111 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:31.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff2867fc640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2880b5610 0x7ff288144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff2877fe640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff288146f40 0x7ff2881dca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff286ffd640 1 -- 172.21.15.134:0/2098979111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff288146f40 msgr2=0x7ff2881dca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff286ffd640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff288146f40 0x7ff2881dca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff286ffd640 1 -- 172.21.15.134:0/2098979111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2880b5610 msgr2=0x7ff288144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff286ffd640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2880b5610 0x7ff288144750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff286ffd640 1 -- 172.21.15.134:0/2098979111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2780094d0 con 0x7ff28809bd10 2024-02-17T14:28:31.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.693+0000 7ff286ffd640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff28809bd10 0x7ff288142230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff278000c00 tx=0x7ff2780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:31.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.694+0000 7ff26f7fe640 1 -- 172.21.15.134:0/2098979111 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278033c80 con 0x7ff28809bd10 2024-02-17T14:28:31.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.694+0000 7ff26f7fe640 1 -- 172.21.15.134:0/2098979111 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff278033de0 con 0x7ff28809bd10 2024-02-17T14:28:31.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.694+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2098979111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff288143e70 con 0x7ff28809bd10 2024-02-17T14:28:31.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.694+0000 7ff26f7fe640 1 -- 172.21.15.134:0/2098979111 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27803d690 con 0x7ff28809bd10 2024-02-17T14:28:31.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.694+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2098979111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2880a02f0 con 0x7ff28809bd10 2024-02-17T14:28:31.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.695+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2098979111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff288144470 con 0x7ff28809bd10 2024-02-17T14:28:31.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.695+0000 7ff26f7fe640 1 -- 172.21.15.134:0/2098979111 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff27803a040 con 0x7ff28809bd10 2024-02-17T14:28:31.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.695+0000 7ff26f7fe640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff27406b810 0x7ff27406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.696+0000 7ff2867fc640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff27406b810 0x7ff27406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.696+0000 7ff26f7fe640 1 -- 172.21.15.134:0/2098979111 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff2780ac5c0 con 0x7ff28809bd10 2024-02-17T14:28:31.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.696+0000 7ff2867fc640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff27406b810 0x7ff27406dcd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff2880ba150 tx=0x7ff27c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:31.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.700+0000 7ff26f7fe640 1 -- 172.21.15.134:0/2098979111 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff288144470 con 0x7ff28809bd10 2024-02-17T14:28:31.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.873+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2098979111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff288144440 con 0x7ff28809bd10 2024-02-17T14:28:31.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.874+0000 7ff26f7fe640 1 -- 172.21.15.134:0/2098979111 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff278076f00 con 0x7ff28809bd10 2024-02-17T14:28:31.873 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 64 2024-02-17T14:28:31.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.876+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2098979111 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff27406b810 msgr2=0x7ff27406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.876+0000 7ff28d2ae640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff27406b810 0x7ff27406dcd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff2880ba150 tx=0x7ff27c008040 comp rx=0 tx=0).stop 2024-02-17T14:28:31.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.876+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2098979111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff28809bd10 msgr2=0x7ff288142230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.876+0000 7ff28d2ae640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff28809bd10 0x7ff288142230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff278000c00 tx=0x7ff2780046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.876+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2098979111 shutdown_connections 2024-02-17T14:28:31.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.876+0000 7ff28d2ae640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff288146f40 0x7ff2881dca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.876+0000 7ff28d2ae640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2880b5610 0x7ff288144750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.876+0000 7ff28d2ae640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff27406b810 0x7ff27406dcd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.876+0000 7ff28d2ae640 1 --2- 172.21.15.134:0/2098979111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff28809bd10 0x7ff288142230 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.876+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2098979111 >> 172.21.15.134:0/2098979111 conn(0x7ff2880ba430 msgr2=0x7ff288145880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:31.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.876+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2098979111 shutdown_connections 2024-02-17T14:28:31.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.876+0000 7ff28d2ae640 1 -- 172.21.15.134:0/2098979111 wait complete. 2024-02-17T14:28:31.886 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T14:28:31.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.990+0000 7f4884a39640 1 Processor -- start 2024-02-17T14:28:31.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.990+0000 7f4884a39640 1 -- start start 2024-02-17T14:28:31.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.990+0000 7f4884a39640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4880146f20 0x7f4880147380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.990+0000 7f4884a39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f488014f7b0 0x7f4880151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.991+0000 7f4884a39640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488006b530 con 0x7f488009b3f0 2024-02-17T14:28:31.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.991+0000 7f4884a39640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48800b76c0 con 0x7f4880146f20 2024-02-17T14:28:31.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.991+0000 7f4884a39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48800b85e0 con 0x7f488014f7b0 2024-02-17T14:28:31.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.991+0000 7f487dd9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4880146f20 0x7f4880147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.991+0000 7f487dd9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4880146f20 0x7f4880147380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46590/0 (socket says 172.21.15.134:46590) 2024-02-17T14:28:31.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.991+0000 7f487dd9b640 1 -- 172.21.15.134:0/2794058358 learned_addr learned my addr 172.21.15.134:0/2794058358 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:31.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.991+0000 7f487ed9d640 1 --2- 172.21.15.134:0/2794058358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f488014f7b0 0x7f4880151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.991+0000 7f487dd9b640 1 -- 172.21.15.134:0/2794058358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f488014f7b0 msgr2=0x7f4880151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:31.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.991+0000 7f487dd9b640 1 --2- 172.21.15.134:0/2794058358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f488014f7b0 0x7f4880151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.991+0000 7f487dd9b640 1 -- 172.21.15.134:0/2794058358 >> v1:172.21.15.142:6789/0 conn(0x7f488009b3f0 legacy=0x7f48800b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:31.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.991+0000 7f487dd9b640 1 -- 172.21.15.134:0/2794058358 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48801478c0 con 0x7f4880146f20 2024-02-17T14:28:31.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.992+0000 7f487dd9b640 1 --2- 172.21.15.134:0/2794058358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4880146f20 0x7f4880147380 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4874009870 tx=0x7f487402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204afe0635ab2428 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:31.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.992+0000 7f487d59a640 1 -- 172.21.15.134:0/2794058358 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4874031640 con 0x7f4880146f20 2024-02-17T14:28:31.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.992+0000 7f487d59a640 1 -- 172.21.15.134:0/2794058358 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48740317a0 con 0x7f4880146f20 2024-02-17T14:28:31.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.992+0000 7f487d59a640 1 -- 172.21.15.134:0/2794058358 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4874031b30 con 0x7f4880146f20 2024-02-17T14:28:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.992+0000 7f4884a39640 1 -- 172.21.15.134:0/2794058358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4880146f20 msgr2=0x7f4880147380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.992+0000 7f4884a39640 1 --2- 172.21.15.134:0/2794058358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4880146f20 0x7f4880147380 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4874009870 tx=0x7f487402b8f0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.993+0000 7f4884a39640 1 -- 172.21.15.134:0/2794058358 shutdown_connections 2024-02-17T14:28:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.993+0000 7f4884a39640 1 --2- 172.21.15.134:0/2794058358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f488014f7b0 0x7f4880151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.993+0000 7f4884a39640 1 --2- 172.21.15.134:0/2794058358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4880146f20 0x7f4880147380 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.993+0000 7f4884a39640 1 -- 172.21.15.134:0/2794058358 >> 172.21.15.134:0/2794058358 conn(0x7f48800bc630 msgr2=0x7f48800bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.993+0000 7f4884a39640 1 -- 172.21.15.134:0/2794058358 shutdown_connections 2024-02-17T14:28:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.993+0000 7f4884a39640 1 -- 172.21.15.134:0/2794058358 wait complete. 2024-02-17T14:28:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.994+0000 7f4884a39640 1 Processor -- start 2024-02-17T14:28:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.994+0000 7f4884a39640 1 -- start start 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.994+0000 7f4884a39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f488009b3f0 0x7f48800a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.994+0000 7f4884a39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4880146f20 0x7f48800b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.994+0000 7f4884a39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f488014f7b0 0x7f48801e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.994+0000 7f4884a39640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48801494c0 con 0x7f488014f7b0 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.994+0000 7f4884a39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4880148e20 con 0x7f4880146f20 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.994+0000 7f4884a39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4880148620 con 0x7f488009b3f0 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.994+0000 7f487ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f488014f7b0 0x7f48801e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f487ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f488014f7b0 0x7f48801e05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46604/0 (socket says 172.21.15.134:46604) 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f487ed9d640 1 -- 172.21.15.134:0/4277472688 learned_addr learned my addr 172.21.15.134:0/4277472688 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f487e59c640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f488009b3f0 0x7f48800a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f487dd9b640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4880146f20 0x7f48800b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f487ed9d640 1 -- 172.21.15.134:0/4277472688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f488009b3f0 msgr2=0x7f48800a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f487ed9d640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f488009b3f0 0x7f48800a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f487ed9d640 1 -- 172.21.15.134:0/4277472688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4880146f20 msgr2=0x7f48800b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:31.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f487ed9d640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4880146f20 0x7f48800b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:31.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f487ed9d640 1 -- 172.21.15.134:0/4277472688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48740094d0 con 0x7f488014f7b0 2024-02-17T14:28:31.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f487ed9d640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f488014f7b0 0x7f48801e05e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4878007d40 tx=0x7f487800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:31.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f486effd640 1 -- 172.21.15.134:0/4277472688 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878014420 con 0x7f488014f7b0 2024-02-17T14:28:31.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f486effd640 1 -- 172.21.15.134:0/4277472688 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48780145a0 con 0x7f488014f7b0 2024-02-17T14:28:31.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f4884a39640 1 -- 172.21.15.134:0/4277472688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4880148900 con 0x7f488014f7b0 2024-02-17T14:28:31.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f486effd640 1 -- 172.21.15.134:0/4277472688 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878014950 con 0x7f488014f7b0 2024-02-17T14:28:31.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.995+0000 7f4884a39640 1 -- 172.21.15.134:0/4277472688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48800a05a0 con 0x7f488014f7b0 2024-02-17T14:28:31.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.996+0000 7f4884a39640 1 -- 172.21.15.134:0/4277472688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4880148b40 con 0x7f488014f7b0 2024-02-17T14:28:31.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.997+0000 7f486effd640 1 -- 172.21.15.134:0/4277472688 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4878014ab0 con 0x7f488014f7b0 2024-02-17T14:28:31.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.997+0000 7f486effd640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f486006b810 0x7f486006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:31.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.997+0000 7f486effd640 1 -- 172.21.15.134:0/4277472688 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f487808abe0 con 0x7f488014f7b0 2024-02-17T14:28:31.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.997+0000 7f487e59c640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f486006b810 0x7f486006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:31.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:31.997+0000 7f487e59c640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f486006b810 0x7f486006dcd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4870004f60 tx=0x7f4870007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:32.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.001+0000 7f486effd640 1 -- 172.21.15.134:0/4277472688 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4880148b40 con 0x7f488014f7b0 2024-02-17T14:28:32.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.170+0000 7f4884a39640 1 -- 172.21.15.134:0/4277472688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4880148b40 con 0x7f488014f7b0 2024-02-17T14:28:32.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.170+0000 7f486effd640 1 -- 172.21.15.134:0/4277472688 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4880148b40 con 0x7f488014f7b0 2024-02-17T14:28:32.170 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-17T14:28:32.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.172+0000 7f4884a39640 1 -- 172.21.15.134:0/4277472688 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f486006b810 msgr2=0x7f486006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.172+0000 7f4884a39640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f486006b810 0x7f486006dcd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4870004f60 tx=0x7f4870007e30 comp rx=0 tx=0).stop 2024-02-17T14:28:32.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.172+0000 7f4884a39640 1 -- 172.21.15.134:0/4277472688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f488014f7b0 msgr2=0x7f48801e05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.172+0000 7f4884a39640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f488014f7b0 0x7f48801e05e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4878007d40 tx=0x7f487800e4b0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.172+0000 7f4884a39640 1 -- 172.21.15.134:0/4277472688 shutdown_connections 2024-02-17T14:28:32.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.172+0000 7f4884a39640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f486006b810 0x7f486006dcd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.172+0000 7f4884a39640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f488014f7b0 0x7f48801e05e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.172+0000 7f4884a39640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4880146f20 0x7f48800b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.172+0000 7f4884a39640 1 --2- 172.21.15.134:0/4277472688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f488009b3f0 0x7f48800a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.172+0000 7f4884a39640 1 -- 172.21.15.134:0/4277472688 >> 172.21.15.134:0/4277472688 conn(0x7f48800bc630 msgr2=0x7f48800ba410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:32.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.172+0000 7f4884a39640 1 -- 172.21.15.134:0/4277472688 shutdown_connections 2024-02-17T14:28:32.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.172+0000 7f4884a39640 1 -- 172.21.15.134:0/4277472688 wait complete. 2024-02-17T14:28:32.182 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T14:28:32.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.283+0000 7f69b800e640 1 Processor -- start 2024-02-17T14:28:32.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.283+0000 7f69b800e640 1 -- start start 2024-02-17T14:28:32.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b800e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f69b006ae10 0x7f69b0072a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b800e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f69b00afe40 0x7f69b00b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b800e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b00b57b0 con 0x7f69b0072f90 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b800e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b00703f0 con 0x7f69b006ae10 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b800e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b006b1f0 con 0x7f69b00afe40 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b5daa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f69b006ae10 0x7f69b0072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b5daa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f69b006ae10 0x7f69b0072a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46614/0 (socket says 172.21.15.134:46614) 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b5daa640 1 -- 172.21.15.134:0/1831433471 learned_addr learned my addr 172.21.15.134:0/1831433471 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b65ab640 1 --2- 172.21.15.134:0/1831433471 >> v2:172.21.15.142:3300/0 conn(0x7f69b00afe40 0x7f69b00b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b5daa640 1 -- 172.21.15.134:0/1831433471 >> v2:172.21.15.142:3300/0 conn(0x7f69b00afe40 msgr2=0x7f69b00b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b5daa640 1 --2- 172.21.15.134:0/1831433471 >> v2:172.21.15.142:3300/0 conn(0x7f69b00afe40 0x7f69b00b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b5daa640 1 -- 172.21.15.134:0/1831433471 >> v1:172.21.15.142:6789/0 conn(0x7f69b0072f90 legacy=0x7f69b00b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b5daa640 1 -- 172.21.15.134:0/1831433471 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b00722e0 con 0x7f69b006ae10 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.284+0000 7f69b65ab640 1 --2- 172.21.15.134:0/1831433471 >> v2:172.21.15.142:3300/0 conn(0x7f69b00afe40 0x7f69b00b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.285+0000 7f69b5daa640 1 --2- 172.21.15.134:0/1831433471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b006ae10 0x7f69b0072a50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f69b006ba80 tx=0x7f69ac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcbdc084e874a5b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:32.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.285+0000 7f69b4da8640 1 -- 172.21.15.134:0/1831433471 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac0317e0 con 0x7f69b006ae10 2024-02-17T14:28:32.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.285+0000 7f69b4da8640 1 -- 172.21.15.134:0/1831433471 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac031940 con 0x7f69b006ae10 2024-02-17T14:28:32.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.285+0000 7f69b4da8640 1 -- 172.21.15.134:0/1831433471 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac031cd0 con 0x7f69b006ae10 2024-02-17T14:28:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.286+0000 7f69b800e640 1 -- 172.21.15.134:0/1831433471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b006ae10 msgr2=0x7f69b0072a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.286+0000 7f69b800e640 1 --2- 172.21.15.134:0/1831433471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b006ae10 0x7f69b0072a50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f69b006ba80 tx=0x7f69ac02b880 comp rx=0 tx=0).stop 2024-02-17T14:28:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.286+0000 7f69b800e640 1 -- 172.21.15.134:0/1831433471 shutdown_connections 2024-02-17T14:28:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.286+0000 7f69b800e640 1 --2- 172.21.15.134:0/1831433471 >> v2:172.21.15.142:3300/0 conn(0x7f69b00afe40 0x7f69b00b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.286+0000 7f69b800e640 1 --2- 172.21.15.134:0/1831433471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b006ae10 0x7f69b0072a50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.286+0000 7f69b800e640 1 -- 172.21.15.134:0/1831433471 >> 172.21.15.134:0/1831433471 conn(0x7f69b00b9310 msgr2=0x7f69b00b9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.286+0000 7f69b800e640 1 -- 172.21.15.134:0/1831433471 shutdown_connections 2024-02-17T14:28:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.286+0000 7f69b800e640 1 -- 172.21.15.134:0/1831433471 wait complete. 2024-02-17T14:28:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.287+0000 7f69b800e640 1 Processor -- start 2024-02-17T14:28:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.287+0000 7f69b800e640 1 -- start start 2024-02-17T14:28:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.287+0000 7f69b800e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b006ae10 0x7f69b00af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b800e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b0072f90 0x7f69b01d0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b800e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b00afe40 0x7f69b01dfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b800e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b01d0310 con 0x7f69b006ae10 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b800e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b01d4150 con 0x7f69b00afe40 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b800e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b01cfc20 con 0x7f69b0072f90 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b5daa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b006ae10 0x7f69b00af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b5daa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b006ae10 0x7f69b00af300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46628/0 (socket says 172.21.15.134:46628) 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b5daa640 1 -- 172.21.15.134:0/859189123 learned_addr learned my addr 172.21.15.134:0/859189123 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b55a9640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b0072f90 0x7f69b01d0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b65ab640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b00afe40 0x7f69b01dfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b5daa640 1 -- 172.21.15.134:0/859189123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b0072f90 msgr2=0x7f69b01d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b5daa640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b0072f90 0x7f69b01d0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b5daa640 1 -- 172.21.15.134:0/859189123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b00afe40 msgr2=0x7f69b01dfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b5daa640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b00afe40 0x7f69b01dfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b5daa640 1 -- 172.21.15.134:0/859189123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac0094d0 con 0x7f69b006ae10 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b55a9640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b0072f90 0x7f69b01d0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b65ab640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b00afe40 0x7f69b01dfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:32.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b5daa640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b006ae10 0x7f69b00af300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f69ac02b8c0 tx=0x7f69ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69a67fc640 1 -- 172.21.15.134:0/859189123 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac032980 con 0x7f69b006ae10 2024-02-17T14:28:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69a67fc640 1 -- 172.21.15.134:0/859189123 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac032ae0 con 0x7f69b006ae10 2024-02-17T14:28:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b800e640 1 -- 172.21.15.134:0/859189123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b00709c0 con 0x7f69b006ae10 2024-02-17T14:28:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69a67fc640 1 -- 172.21.15.134:0/859189123 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac032e90 con 0x7f69b006ae10 2024-02-17T14:28:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.288+0000 7f69b800e640 1 -- 172.21.15.134:0/859189123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b01d1c30 con 0x7f69b006ae10 2024-02-17T14:28:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.289+0000 7f69b800e640 1 -- 172.21.15.134:0/859189123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b0067b70 con 0x7f69b006ae10 2024-02-17T14:28:32.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.290+0000 7f69a67fc640 1 -- 172.21.15.134:0/859189123 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f69ac0453f0 con 0x7f69b006ae10 2024-02-17T14:28:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.290+0000 7f69a67fc640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f699406b840 0x7f699406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.290+0000 7f69a67fc640 1 -- 172.21.15.134:0/859189123 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f69ac0acaf0 con 0x7f69b006ae10 2024-02-17T14:28:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.290+0000 7f69b55a9640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f699406b840 0x7f699406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.290+0000 7f69b55a9640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f699406b840 0x7f699406dd00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f69b01dd970 tx=0x7f69a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:32.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.294+0000 7f69a67fc640 1 -- 172.21.15.134:0/859189123 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f69ac077380 con 0x7f69b006ae10 2024-02-17T14:28:32.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.499+0000 7f69b800e640 1 -- 172.21.15.134:0/859189123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69b00b3320 con 0x7f69b006ae10 2024-02-17T14:28:32.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.500+0000 7f69a67fc640 1 -- 172.21.15.134:0/859189123 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3354 (secure 0 0 0) 0x7f69ac07aa40 con 0x7f69b006ae10 2024-02-17T14:28:32.499 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:32.499 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/137239145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":137239145},{"type":"v1","addr":"172.21.15.134:6835","nonce":137239145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T14:28:03.523163+0000","modified":"2024-02-17T14:28:24.032729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/177127534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":177127534},{"type":"v1","addr":"172.21.15.142:6833","nonce":177127534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T14:28:32.500 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 9 2024-02-17T14:28:32.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.502+0000 7f69b800e640 1 -- 172.21.15.134:0/859189123 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f699406b840 msgr2=0x7f699406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.502+0000 7f69b800e640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f699406b840 0x7f699406dd00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f69b01dd970 tx=0x7f69a0009040 comp rx=0 tx=0).stop 2024-02-17T14:28:32.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.502+0000 7f69b800e640 1 -- 172.21.15.134:0/859189123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b006ae10 msgr2=0x7f69b00af300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.502+0000 7f69b800e640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b006ae10 0x7f69b00af300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f69ac02b8c0 tx=0x7f69ac0046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.502+0000 7f69b800e640 1 -- 172.21.15.134:0/859189123 shutdown_connections 2024-02-17T14:28:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.502+0000 7f69b800e640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69b00afe40 0x7f69b01dfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.502+0000 7f69b800e640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69b0072f90 0x7f69b01d0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.502+0000 7f69b800e640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f699406b840 0x7f699406dd00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.502+0000 7f69b800e640 1 --2- 172.21.15.134:0/859189123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69b006ae10 0x7f69b00af300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.502+0000 7f69b800e640 1 -- 172.21.15.134:0/859189123 >> 172.21.15.134:0/859189123 conn(0x7f69b00b9310 msgr2=0x7f69b00b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.502+0000 7f69b800e640 1 -- 172.21.15.134:0/859189123 shutdown_connections 2024-02-17T14:28:32.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.502+0000 7f69b800e640 1 -- 172.21.15.134:0/859189123 wait complete. 2024-02-17T14:28:32.512 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:32.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.615+0000 7f4d896fb640 1 Processor -- start 2024-02-17T14:28:32.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.615+0000 7f4d896fb640 1 -- start start 2024-02-17T14:28:32.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.615+0000 7f4d896fb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4d840b56c0 0x7f4d840b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.615+0000 7f4d896fb640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d840afc10 con 0x7f4d8409cc70 2024-02-17T14:28:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.615+0000 7f4d896fb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d840b5aa0 con 0x7f4d841412e0 2024-02-17T14:28:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.615+0000 7f4d896fb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d840b6010 con 0x7f4d840b56c0 2024-02-17T14:28:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.615+0000 7f4d7bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4d8409cc70 0x7f4d84140bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51220/0 (socket says 172.21.15.134:51220) 2024-02-17T14:28:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.615+0000 7f4d7bfff640 1 -- 172.21.15.134:0/3006380379 learned_addr learned my addr 172.21.15.134:0/3006380379 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.615+0000 7f4d82ffd640 1 --2- 172.21.15.134:0/3006380379 >> v2:172.21.15.142:3300/0 conn(0x7f4d840b56c0 0x7f4d840b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.616+0000 7f4d827fc640 1 -- 172.21.15.134:0/3006380379 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940408862 0 0) 0x7f4d840afc10 con 0x7f4d8409cc70 2024-02-17T14:28:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.616+0000 7f4d827fc640 1 -- 172.21.15.134:0/3006380379 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d70003520 con 0x7f4d8409cc70 2024-02-17T14:28:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.616+0000 7f4d827fc640 1 -- 172.21.15.134:0/3006380379 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638940770 0 0) 0x7f4d840b5aa0 con 0x7f4d841412e0 2024-02-17T14:28:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.616+0000 7f4d827fc640 1 -- 172.21.15.134:0/3006380379 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d840afc10 con 0x7f4d841412e0 2024-02-17T14:28:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.616+0000 7f4d82ffd640 1 -- 172.21.15.134:0/3006380379 >> v1:172.21.15.142:6789/0 conn(0x7f4d841412e0 legacy=0x7f4d84151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.616+0000 7f4d82ffd640 1 -- 172.21.15.134:0/3006380379 >> v1:172.21.15.134:6789/0 conn(0x7f4d8409cc70 legacy=0x7f4d84140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.616+0000 7f4d82ffd640 1 -- 172.21.15.134:0/3006380379 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d840b62f0 con 0x7f4d840b56c0 2024-02-17T14:28:32.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.617+0000 7f4d82ffd640 1 --2- 172.21.15.134:0/3006380379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d840b56c0 0x7f4d840b04a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d740097a0 tx=0x7f4d7402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a55ae79050c8566d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:32.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.617+0000 7f4d827fc640 1 -- 172.21.15.134:0/3006380379 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74030610 con 0x7f4d840b56c0 2024-02-17T14:28:32.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.617+0000 7f4d827fc640 1 -- 172.21.15.134:0/3006380379 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d74030770 con 0x7f4d840b56c0 2024-02-17T14:28:32.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.617+0000 7f4d827fc640 1 -- 172.21.15.134:0/3006380379 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74030ae0 con 0x7f4d840b56c0 2024-02-17T14:28:32.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.617+0000 7f4d896fb640 1 -- 172.21.15.134:0/3006380379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d840b56c0 msgr2=0x7f4d840b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.617+0000 7f4d896fb640 1 --2- 172.21.15.134:0/3006380379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d840b56c0 0x7f4d840b04a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d740097a0 tx=0x7f4d7402b960 comp rx=0 tx=0).stop 2024-02-17T14:28:32.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.617+0000 7f4d896fb640 1 -- 172.21.15.134:0/3006380379 shutdown_connections 2024-02-17T14:28:32.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.617+0000 7f4d896fb640 1 --2- 172.21.15.134:0/3006380379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d840b56c0 0x7f4d840b04a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.617+0000 7f4d896fb640 1 -- 172.21.15.134:0/3006380379 >> 172.21.15.134:0/3006380379 conn(0x7f4d840b6e70 msgr2=0x7f4d840b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:32.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.617+0000 7f4d896fb640 1 -- 172.21.15.134:0/3006380379 shutdown_connections 2024-02-17T14:28:32.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.617+0000 7f4d896fb640 1 -- 172.21.15.134:0/3006380379 wait complete. 2024-02-17T14:28:32.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.618+0000 7f4d896fb640 1 Processor -- start 2024-02-17T14:28:32.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.618+0000 7f4d896fb640 1 -- start start 2024-02-17T14:28:32.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d896fb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d8409cc70 0x7f4d841ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d896fb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d840b56c0 0x7f4d841dbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d896fb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d841412e0 0x7f4d8413f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d896fb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8409e090 con 0x7f4d8409cc70 2024-02-17T14:28:32.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d896fb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d841466c0 con 0x7f4d841412e0 2024-02-17T14:28:32.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d896fb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8409d590 con 0x7f4d840b56c0 2024-02-17T14:28:32.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d82ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d8409cc70 0x7f4d841ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d82ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d8409cc70 0x7f4d841ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46640/0 (socket says 172.21.15.134:46640) 2024-02-17T14:28:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d82ffd640 1 -- 172.21.15.134:0/3014874772 learned_addr learned my addr 172.21.15.134:0/3014874772 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d7bfff640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d840b56c0 0x7f4d841dbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d837fe640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d841412e0 0x7f4d8413f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d82ffd640 1 -- 172.21.15.134:0/3014874772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d840b56c0 msgr2=0x7f4d841dbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d82ffd640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d840b56c0 0x7f4d841dbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d82ffd640 1 -- 172.21.15.134:0/3014874772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d841412e0 msgr2=0x7f4d8413f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d82ffd640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d841412e0 0x7f4d8413f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.619+0000 7f4d82ffd640 1 -- 172.21.15.134:0/3014874772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d74009400 con 0x7f4d8409cc70 2024-02-17T14:28:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.620+0000 7f4d82ffd640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d8409cc70 0x7f4d841ce4e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4d7402bf70 tx=0x7f4d74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.620+0000 7f4d7b7fe640 1 -- 172.21.15.134:0/3014874772 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7403e040 con 0x7f4d8409cc70 2024-02-17T14:28:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.620+0000 7f4d7b7fe640 1 -- 172.21.15.134:0/3014874772 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d74039a40 con 0x7f4d8409cc70 2024-02-17T14:28:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.620+0000 7f4d7b7fe640 1 -- 172.21.15.134:0/3014874772 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74039df0 con 0x7f4d8409cc70 2024-02-17T14:28:32.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.620+0000 7f4d896fb640 1 -- 172.21.15.134:0/3014874772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8409e5c0 con 0x7f4d8409cc70 2024-02-17T14:28:32.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.620+0000 7f4d896fb640 1 -- 172.21.15.134:0/3014874772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d841463e0 con 0x7f4d8409cc70 2024-02-17T14:28:32.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.621+0000 7f4d896fb640 1 -- 172.21.15.134:0/3014874772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d84067110 con 0x7f4d8409cc70 2024-02-17T14:28:32.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.621+0000 7f4d7b7fe640 1 -- 172.21.15.134:0/3014874772 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4d740423e0 con 0x7f4d8409cc70 2024-02-17T14:28:32.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.621+0000 7f4d7b7fe640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4d6406b810 0x7f4d6406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.622+0000 7f4d7b7fe640 1 -- 172.21.15.134:0/3014874772 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4d740ac670 con 0x7f4d8409cc70 2024-02-17T14:28:32.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.622+0000 7f4d7bfff640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4d6406b810 0x7f4d6406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.622+0000 7f4d7bfff640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4d6406b810 0x7f4d6406dcd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4d84147210 tx=0x7f4d6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:32.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.626+0000 7f4d7b7fe640 1 -- 172.21.15.134:0/3014874772 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4d74076e90 con 0x7f4d8409cc70 2024-02-17T14:28:32.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.800+0000 7f4d896fb640 1 -- 172.21.15.134:0/3014874772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d84067b70 con 0x7f4d8409cc70 2024-02-17T14:28:32.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.801+0000 7f4d7b7fe640 1 -- 172.21.15.134:0/3014874772 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f4d7407a550 con 0x7f4d8409cc70 2024-02-17T14:28:32.801 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:32.802 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:07.990271+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:32.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.804+0000 7f4d896fb640 1 -- 172.21.15.134:0/3014874772 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4d6406b810 msgr2=0x7f4d6406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.804+0000 7f4d896fb640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4d6406b810 0x7f4d6406dcd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4d84147210 tx=0x7f4d6c009040 comp rx=0 tx=0).stop 2024-02-17T14:28:32.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.804+0000 7f4d896fb640 1 -- 172.21.15.134:0/3014874772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d8409cc70 msgr2=0x7f4d841ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.804+0000 7f4d896fb640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d8409cc70 0x7f4d841ce4e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4d7402bf70 tx=0x7f4d74004730 comp rx=0 tx=0).stop 2024-02-17T14:28:32.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.804+0000 7f4d896fb640 1 -- 172.21.15.134:0/3014874772 shutdown_connections 2024-02-17T14:28:32.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.804+0000 7f4d896fb640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d841412e0 0x7f4d8413f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.804+0000 7f4d896fb640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d840b56c0 0x7f4d841dbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.804+0000 7f4d896fb640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4d6406b810 0x7f4d6406dcd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.804+0000 7f4d896fb640 1 --2- 172.21.15.134:0/3014874772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d8409cc70 0x7f4d841ce4e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.804+0000 7f4d896fb640 1 -- 172.21.15.134:0/3014874772 >> 172.21.15.134:0/3014874772 conn(0x7f4d840b6e70 msgr2=0x7f4d840b7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:32.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.804+0000 7f4d896fb640 1 -- 172.21.15.134:0/3014874772 shutdown_connections 2024-02-17T14:28:32.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.804+0000 7f4d896fb640 1 -- 172.21.15.134:0/3014874772 wait complete. 2024-02-17T14:28:32.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T14:27:58.602268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T14:28:01.178917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T14:28:02.371936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T14:28:05.647194+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T14:28:32.815 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T14:28:32.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.918+0000 7f099240e640 1 Processor -- start 2024-02-17T14:28:32.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.918+0000 7f099240e640 1 -- start start 2024-02-17T14:28:32.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.919+0000 7f099240e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c0b0bb0 0x7f098c140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.919+0000 7f099240e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f098c09cc70 0x7f098c141110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.919+0000 7f099240e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c141650 con 0x7f098c0b56c0 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.919+0000 7f099240e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c0afc10 con 0x7f098c09cc70 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.919+0000 7f099240e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0b5aa0 con 0x7f098c0b0bb0 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.919+0000 7f098bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f098c0b56c0 0x7f098c0b04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51234/0 (socket says 172.21.15.134:51234) 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.919+0000 7f098bfff640 1 -- 172.21.15.134:0/2289751444 learned_addr learned my addr 172.21.15.134:0/2289751444 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.919+0000 7f098b7fe640 1 --2- 172.21.15.134:0/2289751444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c0b0bb0 0x7f098c140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.919+0000 7f09909ab640 1 --2- 172.21.15.134:0/2289751444 >> v2:172.21.15.142:3300/0 conn(0x7f098c09cc70 0x7f098c141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.920+0000 7f098affd640 1 -- 172.21.15.134:0/2289751444 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006966627 0 0) 0x7f098c141650 con 0x7f098c0b56c0 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.920+0000 7f098affd640 1 -- 172.21.15.134:0/2289751444 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0978003520 con 0x7f098c0b56c0 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.920+0000 7f09909ab640 1 -- 172.21.15.134:0/2289751444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c0b0bb0 msgr2=0x7f098c140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.920+0000 7f09909ab640 1 --2- 172.21.15.134:0/2289751444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c0b0bb0 0x7f098c140bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.920+0000 7f09909ab640 1 -- 172.21.15.134:0/2289751444 >> v1:172.21.15.134:6789/0 conn(0x7f098c0b56c0 legacy=0x7f098c0b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.920+0000 7f09909ab640 1 -- 172.21.15.134:0/2289751444 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c0b6010 con 0x7f098c09cc70 2024-02-17T14:28:32.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.920+0000 7f098b7fe640 1 --2- 172.21.15.134:0/2289751444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c0b0bb0 0x7f098c140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:32.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.921+0000 7f09909ab640 1 --2- 172.21.15.134:0/2289751444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c09cc70 0x7f098c141110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0984009d90 tx=0x7f098402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c23471a079515197 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:32.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.921+0000 7f098affd640 1 -- 172.21.15.134:0/2289751444 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098402cc50 con 0x7f098c09cc70 2024-02-17T14:28:32.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.921+0000 7f098affd640 1 -- 172.21.15.134:0/2289751444 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098402cdb0 con 0x7f098c09cc70 2024-02-17T14:28:32.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.921+0000 7f098affd640 1 -- 172.21.15.134:0/2289751444 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984034640 con 0x7f098c09cc70 2024-02-17T14:28:32.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.921+0000 7f099240e640 1 -- 172.21.15.134:0/2289751444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c09cc70 msgr2=0x7f098c141110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.921+0000 7f099240e640 1 --2- 172.21.15.134:0/2289751444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c09cc70 0x7f098c141110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0984009d90 tx=0x7f098402bea0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.921+0000 7f099240e640 1 -- 172.21.15.134:0/2289751444 shutdown_connections 2024-02-17T14:28:32.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.921+0000 7f099240e640 1 --2- 172.21.15.134:0/2289751444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c09cc70 0x7f098c141110 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.921+0000 7f099240e640 1 --2- 172.21.15.134:0/2289751444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c0b0bb0 0x7f098c140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.921+0000 7f099240e640 1 -- 172.21.15.134:0/2289751444 >> 172.21.15.134:0/2289751444 conn(0x7f098c0b6e70 msgr2=0x7f098c0b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:32.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.921+0000 7f099240e640 1 -- 172.21.15.134:0/2289751444 shutdown_connections 2024-02-17T14:28:32.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.921+0000 7f099240e640 1 -- 172.21.15.134:0/2289751444 wait complete. 2024-02-17T14:28:32.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.922+0000 7f099240e640 1 Processor -- start 2024-02-17T14:28:32.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.923+0000 7f099240e640 1 -- start start 2024-02-17T14:28:32.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.923+0000 7f099240e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f098c09cc70 0x7f098c0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.923+0000 7f099240e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c0b0bb0 0x7f098c1df9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.923+0000 7f099240e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c0b56c0 0x7f098c1dff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.923+0000 7f099240e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0b2a60 con 0x7f098c09cc70 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.923+0000 7f099240e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c099bd0 con 0x7f098c0b56c0 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.923+0000 7f099240e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0b1b50 con 0x7f098c0b0bb0 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.923+0000 7f098bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f098c09cc70 0x7f098c0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.923+0000 7f098bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f098c09cc70 0x7f098c0b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46656/0 (socket says 172.21.15.134:46656) 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.923+0000 7f098bfff640 1 -- 172.21.15.134:0/2697417165 learned_addr learned my addr 172.21.15.134:0/2697417165 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.923+0000 7f098b7fe640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c0b0bb0 0x7f098c1df9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.924+0000 7f09909ab640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c0b56c0 0x7f098c1dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.924+0000 7f098bfff640 1 -- 172.21.15.134:0/2697417165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c0b0bb0 msgr2=0x7f098c1df9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.924+0000 7f098bfff640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c0b0bb0 0x7f098c1df9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.924+0000 7f098bfff640 1 -- 172.21.15.134:0/2697417165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c0b56c0 msgr2=0x7f098c1dff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.924+0000 7f098bfff640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c0b56c0 0x7f098c1dff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.924+0000 7f098bfff640 1 -- 172.21.15.134:0/2697417165 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c009400 con 0x7f098c09cc70 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.924+0000 7f098b7fe640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c0b0bb0 0x7f098c1df9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:32.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.924+0000 7f098bfff640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f098c09cc70 0x7f098c0b3ca0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f097400c390 tx=0x7f097400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:32.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.924+0000 7f0988ff9640 1 -- 172.21.15.134:0/2697417165 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974005ce0 con 0x7f098c09cc70 2024-02-17T14:28:32.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.924+0000 7f0988ff9640 1 -- 172.21.15.134:0/2697417165 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0974005e40 con 0x7f098c09cc70 2024-02-17T14:28:32.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.924+0000 7f0988ff9640 1 -- 172.21.15.134:0/2697417165 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740072f0 con 0x7f098c09cc70 2024-02-17T14:28:32.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.924+0000 7f099240e640 1 -- 172.21.15.134:0/2697417165 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0984009a70 con 0x7f098c09cc70 2024-02-17T14:28:32.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.924+0000 7f099240e640 1 -- 172.21.15.134:0/2697417165 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c0b3740 con 0x7f098c09cc70 2024-02-17T14:28:32.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.925+0000 7f099240e640 1 -- 172.21.15.134:0/2697417165 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c067110 con 0x7f098c09cc70 2024-02-17T14:28:32.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.925+0000 7f0988ff9640 1 -- 172.21.15.134:0/2697417165 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0974007450 con 0x7f098c09cc70 2024-02-17T14:28:32.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.926+0000 7f0988ff9640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f096c06b840 0x7f096c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:32.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.926+0000 7f098b7fe640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f096c06b840 0x7f096c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:32.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.926+0000 7f0988ff9640 1 -- 172.21.15.134:0/2697417165 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0974089aa0 con 0x7f098c09cc70 2024-02-17T14:28:32.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.926+0000 7f098b7fe640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f096c06b840 0x7f096c06dd00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f098c0b2610 tx=0x7f097c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:32.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:32.930+0000 7f0988ff9640 1 -- 172.21.15.134:0/2697417165 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0974054210 con 0x7f098c09cc70 2024-02-17T14:28:33.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.102+0000 7f099240e640 1 -- 172.21.15.134:0/2697417165 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f098c0b1d10 con 0x7f098c09cc70 2024-02-17T14:28:33.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.102+0000 7f0988ff9640 1 -- 172.21.15.134:0/2697417165 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f09740170a0 con 0x7f098c09cc70 2024-02-17T14:28:33.102 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-02-17T14:28:33.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.104+0000 7f099240e640 1 -- 172.21.15.134:0/2697417165 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f096c06b840 msgr2=0x7f096c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.104+0000 7f099240e640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f096c06b840 0x7f096c06dd00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f098c0b2610 tx=0x7f097c008040 comp rx=0 tx=0).stop 2024-02-17T14:28:33.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.104+0000 7f099240e640 1 -- 172.21.15.134:0/2697417165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f098c09cc70 msgr2=0x7f098c0b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.104+0000 7f099240e640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f098c09cc70 0x7f098c0b3ca0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f097400c390 tx=0x7f097400c850 comp rx=0 tx=0).stop 2024-02-17T14:28:33.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.104+0000 7f099240e640 1 -- 172.21.15.134:0/2697417165 shutdown_connections 2024-02-17T14:28:33.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.104+0000 7f099240e640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f098c0b56c0 0x7f098c1dff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.104+0000 7f099240e640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f098c0b0bb0 0x7f098c1df9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.104+0000 7f099240e640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f096c06b840 0x7f096c06dd00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.104+0000 7f099240e640 1 --2- 172.21.15.134:0/2697417165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f098c09cc70 0x7f098c0b3ca0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.104+0000 7f099240e640 1 -- 172.21.15.134:0/2697417165 >> 172.21.15.134:0/2697417165 conn(0x7f098c0b6e70 msgr2=0x7f098c0b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:33.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.104+0000 7f099240e640 1 -- 172.21.15.134:0/2697417165 shutdown_connections 2024-02-17T14:28:33.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.104+0000 7f099240e640 1 -- 172.21.15.134:0/2697417165 wait complete. 2024-02-17T14:28:33.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T14:28:33.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.218+0000 7f240fcc0640 1 Processor -- start 2024-02-17T14:28:33.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.218+0000 7f240fcc0640 1 -- start start 2024-02-17T14:28:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.218+0000 7f240fcc0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24080b2e60 0x7f24080b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.218+0000 7f240fcc0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24080b1640 0x7f24080af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240fcc0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2408073040 con 0x7f24080b2460 2024-02-17T14:28:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240fcc0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24080b3240 con 0x7f24080b1640 2024-02-17T14:28:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240fcc0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24080b1ad0 con 0x7f24080b2e60 2024-02-17T14:28:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240e25d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f24080b2460 0x7f24080afc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:51236/0 (socket says 172.21.15.134:51236) 2024-02-17T14:28:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240e25d640 1 -- 172.21.15.134:0/2178905163 learned_addr learned my addr 172.21.15.134:0/2178905163 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240da5c640 1 --2- 172.21.15.134:0/2178905163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24080b2e60 0x7f24080b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240d25b640 1 --2- 172.21.15.134:0/2178905163 >> v2:172.21.15.142:3300/0 conn(0x7f24080b1640 0x7f24080af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240ca5a640 1 -- 172.21.15.134:0/2178905163 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327698635 0 0) 0x7f2408073040 con 0x7f24080b2460 2024-02-17T14:28:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240ca5a640 1 -- 172.21.15.134:0/2178905163 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23f4003520 con 0x7f24080b2460 2024-02-17T14:28:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240ca5a640 1 -- 172.21.15.134:0/2178905163 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 644418336 0 0) 0x7f23f4003520 con 0x7f24080b2460 2024-02-17T14:28:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240da5c640 1 -- 172.21.15.134:0/2178905163 >> v2:172.21.15.142:3300/0 conn(0x7f24080b1640 msgr2=0x7f24080af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240da5c640 1 --2- 172.21.15.134:0/2178905163 >> v2:172.21.15.142:3300/0 conn(0x7f24080b1640 0x7f24080af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240da5c640 1 -- 172.21.15.134:0/2178905163 >> v1:172.21.15.134:6789/0 conn(0x7f24080b2460 legacy=0x7f24080afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240da5c640 1 -- 172.21.15.134:0/2178905163 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2408072b20 con 0x7f24080b2e60 2024-02-17T14:28:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.219+0000 7f240d25b640 1 --2- 172.21.15.134:0/2178905163 >> v2:172.21.15.142:3300/0 conn(0x7f24080b1640 0x7f24080af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.220+0000 7f240da5c640 1 --2- 172.21.15.134:0/2178905163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24080b2e60 0x7f24080b1f20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f24040097a0 tx=0x7f240402b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16fa77a14f9e9268 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.220+0000 7f240ca5a640 1 -- 172.21.15.134:0/2178905163 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24000019f0 con 0x7f24080b2e60 2024-02-17T14:28:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.220+0000 7f240ca5a640 1 -- 172.21.15.134:0/2178905163 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240402e050 con 0x7f24080b2e60 2024-02-17T14:28:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.220+0000 7f240ca5a640 1 -- 172.21.15.134:0/2178905163 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404030710 con 0x7f24080b2e60 2024-02-17T14:28:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.221+0000 7f240fcc0640 1 -- 172.21.15.134:0/2178905163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24080b2e60 msgr2=0x7f24080b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.221+0000 7f240fcc0640 1 --2- 172.21.15.134:0/2178905163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24080b2e60 0x7f24080b1f20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f24040097a0 tx=0x7f240402b660 comp rx=0 tx=0).stop 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.221+0000 7f240fcc0640 1 -- 172.21.15.134:0/2178905163 shutdown_connections 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.221+0000 7f240fcc0640 1 --2- 172.21.15.134:0/2178905163 >> v2:172.21.15.142:3300/0 conn(0x7f24080b1640 0x7f24080af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.221+0000 7f240fcc0640 1 --2- 172.21.15.134:0/2178905163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24080b2e60 0x7f24080b1f20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.221+0000 7f240fcc0640 1 -- 172.21.15.134:0/2178905163 >> 172.21.15.134:0/2178905163 conn(0x7f24080b8270 msgr2=0x7f24080b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.221+0000 7f240fcc0640 1 -- 172.21.15.134:0/2178905163 shutdown_connections 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.221+0000 7f240fcc0640 1 -- 172.21.15.134:0/2178905163 wait complete. 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.222+0000 7f240fcc0640 1 Processor -- start 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.222+0000 7f240fcc0640 1 -- start start 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.222+0000 7f240fcc0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24080b2460 0x7f2408134dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.222+0000 7f240fcc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24080b2e60 0x7f24081338c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.222+0000 7f240fcc0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2408133e00 0x7f240813c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.222+0000 7f240fcc0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2408135300 con 0x7f24080b2460 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.222+0000 7f240fcc0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24081354f0 con 0x7f24080b2e60 2024-02-17T14:28:33.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.222+0000 7f240fcc0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24080b6670 con 0x7f2408133e00 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.222+0000 7f240da5c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24080b2460 0x7f2408134dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.222+0000 7f240da5c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24080b2460 0x7f2408134dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46658/0 (socket says 172.21.15.134:46658) 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.222+0000 7f240da5c640 1 -- 172.21.15.134:0/975430942 learned_addr learned my addr 172.21.15.134:0/975430942 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.223+0000 7f240d25b640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24080b2e60 0x7f24081338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.223+0000 7f240e25d640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2408133e00 0x7f240813c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.223+0000 7f240da5c640 1 -- 172.21.15.134:0/975430942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2408133e00 msgr2=0x7f240813c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.223+0000 7f240da5c640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2408133e00 0x7f240813c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.223+0000 7f240da5c640 1 -- 172.21.15.134:0/975430942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24080b2e60 msgr2=0x7f24081338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.223+0000 7f240da5c640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24080b2e60 0x7f24081338c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.223+0000 7f240da5c640 1 -- 172.21.15.134:0/975430942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f8009400 con 0x7f24080b2460 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.223+0000 7f240da5c640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24080b2460 0x7f2408134dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f240402b6a0 tx=0x7f24040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.223+0000 7f23fe7fc640 1 -- 172.21.15.134:0/975430942 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240403c880 con 0x7f24080b2460 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.223+0000 7f23fe7fc640 1 -- 172.21.15.134:0/975430942 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240403c9e0 con 0x7f24080b2460 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.223+0000 7f23fe7fc640 1 -- 172.21.15.134:0/975430942 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240403cd90 con 0x7f24080b2460 2024-02-17T14:28:33.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.223+0000 7f240fcc0640 1 -- 172.21.15.134:0/975430942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2404009400 con 0x7f24080b2460 2024-02-17T14:28:33.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.223+0000 7f240fcc0640 1 -- 172.21.15.134:0/975430942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24080b7420 con 0x7f24080b2460 2024-02-17T14:28:33.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.224+0000 7f240fcc0640 1 -- 172.21.15.134:0/975430942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2408074650 con 0x7f24080b2460 2024-02-17T14:28:33.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.225+0000 7f23fe7fc640 1 -- 172.21.15.134:0/975430942 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2404039040 con 0x7f24080b2460 2024-02-17T14:28:33.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.225+0000 7f23fe7fc640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f23ec06b810 0x7f23ec06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.225+0000 7f23fe7fc640 1 -- 172.21.15.134:0/975430942 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f24040abea0 con 0x7f24080b2460 2024-02-17T14:28:33.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.225+0000 7f240d25b640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f23ec06b810 0x7f23ec06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.226+0000 7f240d25b640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f23ec06b810 0x7f23ec06dcd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f24081446a0 tx=0x7f23f8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:33.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.229+0000 7f23fe7fc640 1 -- 172.21.15.134:0/975430942 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2404076640 con 0x7f24080b2460 2024-02-17T14:28:33.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.399+0000 7f240fcc0640 1 -- 172.21.15.134:0/975430942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2408071bd0 con 0x7f24080b2460 2024-02-17T14:28:33.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.399+0000 7f23fe7fc640 1 -- 172.21.15.134:0/975430942 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2404079d00 con 0x7f24080b2460 2024-02-17T14:28:33.399 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-17T14:28:33.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.401+0000 7f240fcc0640 1 -- 172.21.15.134:0/975430942 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f23ec06b810 msgr2=0x7f23ec06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.401+0000 7f240fcc0640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f23ec06b810 0x7f23ec06dcd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f24081446a0 tx=0x7f23f8009190 comp rx=0 tx=0).stop 2024-02-17T14:28:33.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.401+0000 7f240fcc0640 1 -- 172.21.15.134:0/975430942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24080b2460 msgr2=0x7f2408134dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.401+0000 7f240fcc0640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24080b2460 0x7f2408134dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f240402b6a0 tx=0x7f24040046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.401+0000 7f240fcc0640 1 -- 172.21.15.134:0/975430942 shutdown_connections 2024-02-17T14:28:33.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.401+0000 7f240fcc0640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2408133e00 0x7f240813c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.401+0000 7f240fcc0640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24080b2e60 0x7f24081338c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.401+0000 7f240fcc0640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f23ec06b810 0x7f23ec06dcd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.401+0000 7f240fcc0640 1 --2- 172.21.15.134:0/975430942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24080b2460 0x7f2408134dc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.401+0000 7f240fcc0640 1 -- 172.21.15.134:0/975430942 >> 172.21.15.134:0/975430942 conn(0x7f24080b8270 msgr2=0x7f24080b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:33.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.401+0000 7f240fcc0640 1 -- 172.21.15.134:0/975430942 shutdown_connections 2024-02-17T14:28:33.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.401+0000 7f240fcc0640 1 -- 172.21.15.134:0/975430942 wait complete. 2024-02-17T14:28:33.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T14:28:33.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.516+0000 7f7ea2cc0640 1 Processor -- start 2024-02-17T14:28:33.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.516+0000 7f7ea2cc0640 1 -- start start 2024-02-17T14:28:33.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.516+0000 7f7ea2cc0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7e9c141250 0x7f7e9c152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.516+0000 7f7ea2cc0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9c072210 con 0x7f7e9c066b20 2024-02-17T14:28:33.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.516+0000 7f7ea2cc0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9c071aa0 con 0x7f7e9c140dd0 2024-02-17T14:28:33.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.516+0000 7f7ea2cc0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9c072960 con 0x7f7e9c141250 2024-02-17T14:28:33.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.516+0000 7f7ea125d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7e9c141250 0x7f7e9c152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.517+0000 7f7ea0a5c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7e9c066b20 0x7f7e9c0b7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:58428/0 (socket says 172.21.15.134:58428) 2024-02-17T14:28:33.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.517+0000 7f7ea0a5c640 1 -- 172.21.15.134:0/2211899338 learned_addr learned my addr 172.21.15.134:0/2211899338 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:33.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.517+0000 7f7ea125d640 1 -- 172.21.15.134:0/2211899338 >> v1:172.21.15.142:6789/0 conn(0x7f7e9c140dd0 legacy=0x7f7e9c14f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.517+0000 7f7ea125d640 1 -- 172.21.15.134:0/2211899338 >> v1:172.21.15.134:6789/0 conn(0x7f7e9c066b20 legacy=0x7f7e9c0b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.517+0000 7f7ea125d640 1 -- 172.21.15.134:0/2211899338 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c066f00 con 0x7f7e9c141250 2024-02-17T14:28:33.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.518+0000 7f7ea125d640 1 --2- 172.21.15.134:0/2211899338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e9c141250 0x7f7e9c152ee0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009d90 tx=0x7f7e9402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce909083afc074e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:33.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.518+0000 7f7e9b7fe640 1 -- 172.21.15.134:0/2211899338 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9402cc60 con 0x7f7e9c141250 2024-02-17T14:28:33.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.518+0000 7f7e9b7fe640 1 -- 172.21.15.134:0/2211899338 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9402cdc0 con 0x7f7e9c141250 2024-02-17T14:28:33.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.518+0000 7f7e9b7fe640 1 -- 172.21.15.134:0/2211899338 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94034660 con 0x7f7e9c141250 2024-02-17T14:28:33.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.518+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/2211899338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e9c141250 msgr2=0x7f7e9c152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.518+0000 7f7ea2cc0640 1 --2- 172.21.15.134:0/2211899338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e9c141250 0x7f7e9c152ee0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009d90 tx=0x7f7e9402beb0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.518+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/2211899338 shutdown_connections 2024-02-17T14:28:33.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.518+0000 7f7ea2cc0640 1 --2- 172.21.15.134:0/2211899338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e9c141250 0x7f7e9c152ee0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.518+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/2211899338 >> 172.21.15.134:0/2211899338 conn(0x7f7e9c0b5fe0 msgr2=0x7f7e9c0b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:33.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.518+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/2211899338 shutdown_connections 2024-02-17T14:28:33.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.518+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/2211899338 wait complete. 2024-02-17T14:28:33.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.519+0000 7f7ea2cc0640 1 Processor -- start 2024-02-17T14:28:33.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.519+0000 7f7ea2cc0640 1 -- start start 2024-02-17T14:28:33.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea2cc0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e9c066b20 0x7f7e9c0accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea2cc0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e9c140dd0 0x7f7e9c135840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea2cc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e9c141250 0x7f7e9c0b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea2cc0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0ae3a0 con 0x7f7e9c066b20 2024-02-17T14:28:33.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea2cc0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0ad210 con 0x7f7e9c141250 2024-02-17T14:28:33.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea2cc0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c1e0030 con 0x7f7e9c140dd0 2024-02-17T14:28:33.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea0a5c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e9c066b20 0x7f7e9c0accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea0a5c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e9c066b20 0x7f7e9c0accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50134/0 (socket says 172.21.15.134:50134) 2024-02-17T14:28:33.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea0a5c640 1 -- 172.21.15.134:0/22967927 learned_addr learned my addr 172.21.15.134:0/22967927 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:33.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea0a5c640 1 -- 172.21.15.134:0/22967927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e9c140dd0 msgr2=0x7f7e9c135840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea0a5c640 1 --2- 172.21.15.134:0/22967927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e9c140dd0 0x7f7e9c135840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea0a5c640 1 -- 172.21.15.134:0/22967927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e9c141250 msgr2=0x7f7e9c0b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea0a5c640 1 --2- 172.21.15.134:0/22967927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e9c141250 0x7f7e9c0b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea0a5c640 1 -- 172.21.15.134:0/22967927 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e94009a70 con 0x7f7e9c066b20 2024-02-17T14:28:33.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.520+0000 7f7ea0a5c640 1 --2- 172.21.15.134:0/22967927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e9c066b20 0x7f7e9c0accd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7e9000c4d0 tx=0x7f7e9000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:33.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.521+0000 7f7e997fa640 1 -- 172.21.15.134:0/22967927 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e90005ce0 con 0x7f7e9c066b20 2024-02-17T14:28:33.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.521+0000 7f7e997fa640 1 -- 172.21.15.134:0/22967927 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e90005e40 con 0x7f7e9c066b20 2024-02-17T14:28:33.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.521+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/22967927 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c0af7c0 con 0x7f7e9c066b20 2024-02-17T14:28:33.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.521+0000 7f7e997fa640 1 -- 172.21.15.134:0/22967927 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e90007270 con 0x7f7e9c066b20 2024-02-17T14:28:33.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.521+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/22967927 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c1e0330 con 0x7f7e9c066b20 2024-02-17T14:28:33.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.522+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/22967927 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9c0b2ff0 con 0x7f7e9c066b20 2024-02-17T14:28:33.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.522+0000 7f7e997fa640 1 -- 172.21.15.134:0/22967927 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7e900073d0 con 0x7f7e9c066b20 2024-02-17T14:28:33.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.522+0000 7f7e997fa640 1 --2- 172.21.15.134:0/22967927 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7e8006b810 0x7f7e8006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.522+0000 7f7e997fa640 1 -- 172.21.15.134:0/22967927 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7e90089930 con 0x7f7e9c066b20 2024-02-17T14:28:33.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.522+0000 7f7e9bfff640 1 --2- 172.21.15.134:0/22967927 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7e8006b810 0x7f7e8006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.523+0000 7f7e9bfff640 1 --2- 172.21.15.134:0/22967927 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7e8006b810 0x7f7e8006dcd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7e88000f60 tx=0x7f7e880079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:33.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.527+0000 7f7e997fa640 1 -- 172.21.15.134:0/22967927 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7e900540c0 con 0x7f7e9c066b20 2024-02-17T14:28:33.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.695+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/22967927 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e9c1e0990 con 0x7f7e9c066b20 2024-02-17T14:28:33.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.695+0000 7f7e997fa640 1 -- 172.21.15.134:0/22967927 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e90017020 con 0x7f7e9c066b20 2024-02-17T14:28:33.695 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 64 2024-02-17T14:28:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.697+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/22967927 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7e8006b810 msgr2=0x7f7e8006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.697+0000 7f7ea2cc0640 1 --2- 172.21.15.134:0/22967927 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7e8006b810 0x7f7e8006dcd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7e88000f60 tx=0x7f7e880079d0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.697+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/22967927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e9c066b20 msgr2=0x7f7e9c0accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.697+0000 7f7ea2cc0640 1 --2- 172.21.15.134:0/22967927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e9c066b20 0x7f7e9c0accd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7e9000c4d0 tx=0x7f7e9000c990 comp rx=0 tx=0).stop 2024-02-17T14:28:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.697+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/22967927 shutdown_connections 2024-02-17T14:28:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.697+0000 7f7ea2cc0640 1 --2- 172.21.15.134:0/22967927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e9c141250 0x7f7e9c0b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.697+0000 7f7ea2cc0640 1 --2- 172.21.15.134:0/22967927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e9c140dd0 0x7f7e9c135840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.697+0000 7f7ea2cc0640 1 --2- 172.21.15.134:0/22967927 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7e8006b810 0x7f7e8006dcd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.697+0000 7f7ea2cc0640 1 --2- 172.21.15.134:0/22967927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e9c066b20 0x7f7e9c0accd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.697+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/22967927 >> 172.21.15.134:0/22967927 conn(0x7f7e9c0b5fe0 msgr2=0x7f7e9c13f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.697+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/22967927 shutdown_connections 2024-02-17T14:28:33.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.697+0000 7f7ea2cc0640 1 -- 172.21.15.134:0/22967927 wait complete. 2024-02-17T14:28:33.708 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T14:28:33.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.812+0000 7f2c09cdb640 1 Processor -- start 2024-02-17T14:28:33.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.812+0000 7f2c09cdb640 1 -- start start 2024-02-17T14:28:33.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.813+0000 7f2c09cdb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2c040b5020 0x7f2c0406d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.813+0000 7f2c09cdb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c041475b0 0x7f2c04071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.813+0000 7f2c09cdb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c040715e0 con 0x7f2c0406d5e0 2024-02-17T14:28:33.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.813+0000 7f2c09cdb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c0406ddb0 con 0x7f2c040b5020 2024-02-17T14:28:33.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.813+0000 7f2c09cdb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040b5400 con 0x7f2c041475b0 2024-02-17T14:28:33.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.813+0000 7f2c037fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2c040b5020 0x7f2c0406d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.813+0000 7f2c03fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c041475b0 0x7f2c04071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.813+0000 7f2c037fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2c040b5020 0x7f2c0406d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:59344/0 (socket says 172.21.15.134:59344) 2024-02-17T14:28:33.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.813+0000 7f2c02ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2c0406d5e0 0x7f2c04146ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:58222/0 (socket says 172.21.15.134:58222) 2024-02-17T14:28:33.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.813+0000 7f2c037fe640 1 -- 172.21.15.134:0/1469302308 learned_addr learned my addr 172.21.15.134:0/1469302308 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:33.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.813+0000 7f2c03fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c041475b0 0x7f2c04071a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:54566/0 (socket says 172.21.15.134:54566) 2024-02-17T14:28:33.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.814+0000 7f2c037fe640 1 -- 172.21.15.134:0/1469302308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c041475b0 msgr2=0x7f2c04071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:33.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.814+0000 7f2c037fe640 1 --2- 172.21.15.134:0/1469302308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c041475b0 0x7f2c04071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.814+0000 7f2c037fe640 1 -- 172.21.15.134:0/1469302308 >> v1:172.21.15.142:6789/0 conn(0x7f2c0406d5e0 legacy=0x7f2c04146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.814+0000 7f2c037fe640 1 -- 172.21.15.134:0/1469302308 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c04147a50 con 0x7f2c040b5020 2024-02-17T14:28:33.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.814+0000 7f2c037fe640 1 --2- 172.21.15.134:0/1469302308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c040b5020 0x7f2c0406d0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009870 tx=0x7f2bf402ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8312dcf78a88d809 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:33.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.815+0000 7f2c027fc640 1 -- 172.21.15.134:0/1469302308 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf402f840 con 0x7f2c040b5020 2024-02-17T14:28:33.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.815+0000 7f2c027fc640 1 -- 172.21.15.134:0/1469302308 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf402f9a0 con 0x7f2c040b5020 2024-02-17T14:28:33.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.815+0000 7f2c027fc640 1 -- 172.21.15.134:0/1469302308 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf402fd30 con 0x7f2c040b5020 2024-02-17T14:28:33.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.815+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1469302308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c040b5020 msgr2=0x7f2c0406d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.815+0000 7f2c09cdb640 1 --2- 172.21.15.134:0/1469302308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c040b5020 0x7f2c0406d0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009870 tx=0x7f2bf402ba20 comp rx=0 tx=0).stop 2024-02-17T14:28:33.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.815+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1469302308 shutdown_connections 2024-02-17T14:28:33.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.815+0000 7f2c09cdb640 1 --2- 172.21.15.134:0/1469302308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c041475b0 0x7f2c04071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.815+0000 7f2c09cdb640 1 --2- 172.21.15.134:0/1469302308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c040b5020 0x7f2c0406d0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.815+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1469302308 >> 172.21.15.134:0/1469302308 conn(0x7f2c040ba430 msgr2=0x7f2c040ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:33.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.815+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1469302308 shutdown_connections 2024-02-17T14:28:33.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.815+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1469302308 wait complete. 2024-02-17T14:28:33.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.816+0000 7f2c09cdb640 1 Processor -- start 2024-02-17T14:28:33.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.816+0000 7f2c09cdb640 1 -- start start 2024-02-17T14:28:33.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c09cdb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c0406d5e0 0x7f2c0413cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c09cdb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c040b5020 0x7f2c041e0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c09cdb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c041475b0 0x7f2c040b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c09cdb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040af650 con 0x7f2c041475b0 2024-02-17T14:28:33.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c09cdb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0413f440 con 0x7f2c0406d5e0 2024-02-17T14:28:33.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c09cdb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c04140110 con 0x7f2c040b5020 2024-02-17T14:28:33.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c03fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c041475b0 0x7f2c040b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c03fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c041475b0 0x7f2c040b0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50142/0 (socket says 172.21.15.134:50142) 2024-02-17T14:28:33.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c03fff640 1 -- 172.21.15.134:0/1130837850 learned_addr learned my addr 172.21.15.134:0/1130837850 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:33.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c02ffd640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c040b5020 0x7f2c041e0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c037fe640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c0406d5e0 0x7f2c0413cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c03fff640 1 -- 172.21.15.134:0/1130837850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c040b5020 msgr2=0x7f2c041e0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c03fff640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c040b5020 0x7f2c041e0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c03fff640 1 -- 172.21.15.134:0/1130837850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c0406d5e0 msgr2=0x7f2c0413cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c03fff640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c0406d5e0 0x7f2c0413cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c03fff640 1 -- 172.21.15.134:0/1130837850 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf40094d0 con 0x7f2c041475b0 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.817+0000 7f2c037fe640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c0406d5e0 0x7f2c0413cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.818+0000 7f2c03fff640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c041475b0 0x7f2c040b0a80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009e30 tx=0x7f2bfc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.818+0000 7f2bebfff640 1 -- 172.21.15.134:0/1130837850 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc009ca0 con 0x7f2c041475b0 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.818+0000 7f2bebfff640 1 -- 172.21.15.134:0/1130837850 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bfc00f040 con 0x7f2c041475b0 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.818+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1130837850 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c0413fda0 con 0x7f2c041475b0 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.818+0000 7f2bebfff640 1 -- 172.21.15.134:0/1130837850 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0146c0 con 0x7f2c041475b0 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.818+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1130837850 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0413f690 con 0x7f2c041475b0 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.819+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1130837850 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c04067b70 con 0x7f2c041475b0 2024-02-17T14:28:33.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.819+0000 7f2bebfff640 1 -- 172.21.15.134:0/1130837850 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f2bfc014820 con 0x7f2c041475b0 2024-02-17T14:28:33.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.820+0000 7f2bebfff640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f2bf006b840 0x7f2bf006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:33.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.820+0000 7f2bebfff640 1 -- 172.21.15.134:0/1130837850 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2bfc08b360 con 0x7f2c041475b0 2024-02-17T14:28:33.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.820+0000 7f2c037fe640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f2bf006b840 0x7f2bf006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:33.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.820+0000 7f2c037fe640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f2bf006b840 0x7f2bf006dd00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4036000 tx=0x7f2bf4039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:33.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.824+0000 7f2bebfff640 1 -- 172.21.15.134:0/1130837850 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2bfc055ad0 con 0x7f2c041475b0 2024-02-17T14:28:33.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.993+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1130837850 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2c04140250 con 0x7f2c041475b0 2024-02-17T14:28:33.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.993+0000 7f2bebfff640 1 -- 172.21.15.134:0/1130837850 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2bfc059190 con 0x7f2c041475b0 2024-02-17T14:28:33.993 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-17T14:28:33.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.995+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1130837850 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f2bf006b840 msgr2=0x7f2bf006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.995+0000 7f2c09cdb640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f2bf006b840 0x7f2bf006dd00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4036000 tx=0x7f2bf4039040 comp rx=0 tx=0).stop 2024-02-17T14:28:33.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.995+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1130837850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c041475b0 msgr2=0x7f2c040b0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:33.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.995+0000 7f2c09cdb640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c041475b0 0x7f2c040b0a80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009e30 tx=0x7f2bfc00c490 comp rx=0 tx=0).stop 2024-02-17T14:28:33.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.995+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1130837850 shutdown_connections 2024-02-17T14:28:33.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.995+0000 7f2c09cdb640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f2bf006b840 0x7f2bf006dd00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.995+0000 7f2c09cdb640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c041475b0 0x7f2c040b0a80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.995+0000 7f2c09cdb640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c040b5020 0x7f2c041e0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.995+0000 7f2c09cdb640 1 --2- 172.21.15.134:0/1130837850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c0406d5e0 0x7f2c0413cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:33.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.995+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1130837850 >> 172.21.15.134:0/1130837850 conn(0x7f2c040ba430 msgr2=0x7f2c0406e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:33.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.995+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1130837850 shutdown_connections 2024-02-17T14:28:33.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:33.995+0000 7f2c09cdb640 1 -- 172.21.15.134:0/1130837850 wait complete. 2024-02-17T14:28:34.006 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T14:28:34.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.106+0000 7fda82617640 1 Processor -- start 2024-02-17T14:28:34.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.106+0000 7fda82617640 1 -- start start 2024-02-17T14:28:34.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.107+0000 7fda82617640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fda7c06ae10 0x7fda7c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.107+0000 7fda82617640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fda7c070ef0 0x7fda7c0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.107+0000 7fda82617640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7c140a90 0x7fda7c140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.107+0000 7fda82617640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7c071850 con 0x7fda7c070ef0 2024-02-17T14:28:34.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.107+0000 7fda82617640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7c073240 con 0x7fda7c06ae10 2024-02-17T14:28:34.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.107+0000 7fda82617640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c072510 con 0x7fda7c140a90 2024-02-17T14:28:34.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.107+0000 7fda7b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fda7c070ef0 0x7fda7c0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.107+0000 7fda7b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fda7c070ef0 0x7fda7c0afe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50144/0 (socket says 172.21.15.134:50144) 2024-02-17T14:28:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.107+0000 7fda7b7fe640 1 -- 172.21.15.134:0/858344053 learned_addr learned my addr 172.21.15.134:0/858344053 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.107+0000 7fda80bb4640 1 --2- 172.21.15.134:0/858344053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7c140a90 0x7fda7c140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.107+0000 7fda7bfff640 1 --2- 172.21.15.134:0/858344053 >> v2:172.21.15.142:3300/0 conn(0x7fda7c06ae10 0x7fda7c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.108+0000 7fda7b7fe640 1 -- 172.21.15.134:0/858344053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7c140a90 msgr2=0x7fda7c140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.108+0000 7fda7b7fe640 1 --2- 172.21.15.134:0/858344053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7c140a90 0x7fda7c140ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.108+0000 7fda7b7fe640 1 -- 172.21.15.134:0/858344053 >> v2:172.21.15.142:3300/0 conn(0x7fda7c06ae10 msgr2=0x7fda7c0b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.108+0000 7fda7b7fe640 1 --2- 172.21.15.134:0/858344053 >> v2:172.21.15.142:3300/0 conn(0x7fda7c06ae10 0x7fda7c0b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.108+0000 7fda7b7fe640 1 -- 172.21.15.134:0/858344053 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c071360 con 0x7fda7c070ef0 2024-02-17T14:28:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.108+0000 7fda7b7fe640 1 --2- 172.21.15.134:0/858344053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda7c070ef0 0x7fda7c0afe40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0b6e40 tx=0x7fda7002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29138ebfe1b430ef server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.109+0000 7fda7affd640 1 -- 172.21.15.134:0/858344053 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70031870 con 0x7fda7c070ef0 2024-02-17T14:28:34.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.109+0000 7fda7affd640 1 -- 172.21.15.134:0/858344053 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda700319d0 con 0x7fda7c070ef0 2024-02-17T14:28:34.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.109+0000 7fda7affd640 1 -- 172.21.15.134:0/858344053 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70031d60 con 0x7fda7c070ef0 2024-02-17T14:28:34.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.109+0000 7fda82617640 1 -- 172.21.15.134:0/858344053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda7c070ef0 msgr2=0x7fda7c0afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.109+0000 7fda82617640 1 --2- 172.21.15.134:0/858344053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda7c070ef0 0x7fda7c0afe40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0b6e40 tx=0x7fda7002b910 comp rx=0 tx=0).stop 2024-02-17T14:28:34.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.109+0000 7fda82617640 1 -- 172.21.15.134:0/858344053 shutdown_connections 2024-02-17T14:28:34.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.109+0000 7fda82617640 1 --2- 172.21.15.134:0/858344053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7c140a90 0x7fda7c140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.109+0000 7fda82617640 1 --2- 172.21.15.134:0/858344053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda7c070ef0 0x7fda7c0afe40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.109+0000 7fda82617640 1 --2- 172.21.15.134:0/858344053 >> v2:172.21.15.142:3300/0 conn(0x7fda7c06ae10 0x7fda7c0b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.109+0000 7fda82617640 1 -- 172.21.15.134:0/858344053 >> 172.21.15.134:0/858344053 conn(0x7fda7c0b9350 msgr2=0x7fda7c0b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:34.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.109+0000 7fda82617640 1 -- 172.21.15.134:0/858344053 shutdown_connections 2024-02-17T14:28:34.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.109+0000 7fda82617640 1 -- 172.21.15.134:0/858344053 wait complete. 2024-02-17T14:28:34.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.110+0000 7fda82617640 1 Processor -- start 2024-02-17T14:28:34.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.110+0000 7fda82617640 1 -- start start 2024-02-17T14:28:34.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda82617640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda7c06ae10 0x7fda7c0ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda82617640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda7c070ef0 0x7fda7c1dc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda82617640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7c140a90 0x7fda7c1dcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda82617640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c147d70 con 0x7fda7c070ef0 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda82617640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c147b20 con 0x7fda7c06ae10 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda82617640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0ae1a0 con 0x7fda7c140a90 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda7b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda7c070ef0 0x7fda7c1dc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda7b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda7c070ef0 0x7fda7c1dc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50152/0 (socket says 172.21.15.134:50152) 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda7b7fe640 1 -- 172.21.15.134:0/1977419657 learned_addr learned my addr 172.21.15.134:0/1977419657 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda80bb4640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7c140a90 0x7fda7c1dcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda7bfff640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda7c06ae10 0x7fda7c0ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda7b7fe640 1 -- 172.21.15.134:0/1977419657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7c140a90 msgr2=0x7fda7c1dcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda7b7fe640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7c140a90 0x7fda7c1dcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda7b7fe640 1 -- 172.21.15.134:0/1977419657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda7c06ae10 msgr2=0x7fda7c0ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda7b7fe640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda7c06ae10 0x7fda7c0ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda7b7fe640 1 -- 172.21.15.134:0/1977419657 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda700094d0 con 0x7fda7c070ef0 2024-02-17T14:28:34.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda7bfff640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda7c06ae10 0x7fda7c0ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:34.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.111+0000 7fda7b7fe640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda7c070ef0 0x7fda7c1dc7e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fda70000c00 tx=0x7fda700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:34.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.112+0000 7fda78ff9640 1 -- 172.21.15.134:0/1977419657 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7003ac60 con 0x7fda7c070ef0 2024-02-17T14:28:34.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.112+0000 7fda78ff9640 1 -- 172.21.15.134:0/1977419657 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7003ade0 con 0x7fda7c070ef0 2024-02-17T14:28:34.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.112+0000 7fda82617640 1 -- 172.21.15.134:0/1977419657 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c0adc20 con 0x7fda7c070ef0 2024-02-17T14:28:34.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.112+0000 7fda78ff9640 1 -- 172.21.15.134:0/1977419657 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70042630 con 0x7fda7c070ef0 2024-02-17T14:28:34.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.112+0000 7fda82617640 1 -- 172.21.15.134:0/1977419657 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c0aee90 con 0x7fda7c070ef0 2024-02-17T14:28:34.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.113+0000 7fda82617640 1 -- 172.21.15.134:0/1977419657 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7c0ae2e0 con 0x7fda7c070ef0 2024-02-17T14:28:34.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.113+0000 7fda78ff9640 1 -- 172.21.15.134:0/1977419657 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fda700303c0 con 0x7fda7c070ef0 2024-02-17T14:28:34.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.113+0000 7fda78ff9640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fda6806b840 0x7fda6806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.114+0000 7fda78ff9640 1 -- 172.21.15.134:0/1977419657 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fda7002d040 con 0x7fda7c070ef0 2024-02-17T14:28:34.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.114+0000 7fda7bfff640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fda6806b840 0x7fda6806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.114+0000 7fda7bfff640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fda6806b840 0x7fda6806dd00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009b90 tx=0x7fda6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:34.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.118+0000 7fda78ff9640 1 -- 172.21.15.134:0/1977419657 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda7c0ae2e0 con 0x7fda7c070ef0 2024-02-17T14:28:34.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.322+0000 7fda82617640 1 -- 172.21.15.134:0/1977419657 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda7c0ae2e0 con 0x7fda7c070ef0 2024-02-17T14:28:34.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.323+0000 7fda78ff9640 1 -- 172.21.15.134:0/1977419657 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3354 (secure 0 0 0) 0x7fda70035d30 con 0x7fda7c070ef0 2024-02-17T14:28:34.323 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:34.323 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/137239145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":137239145},{"type":"v1","addr":"172.21.15.134:6835","nonce":137239145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T14:28:03.523163+0000","modified":"2024-02-17T14:28:24.032729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/177127534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":177127534},{"type":"v1","addr":"172.21.15.142:6833","nonce":177127534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T14:28:34.324 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 9 2024-02-17T14:28:34.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.325+0000 7fda82617640 1 -- 172.21.15.134:0/1977419657 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fda6806b840 msgr2=0x7fda6806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.325+0000 7fda82617640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fda6806b840 0x7fda6806dd00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009b90 tx=0x7fda6c008040 comp rx=0 tx=0).stop 2024-02-17T14:28:34.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.325+0000 7fda82617640 1 -- 172.21.15.134:0/1977419657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda7c070ef0 msgr2=0x7fda7c1dc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.325+0000 7fda82617640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda7c070ef0 0x7fda7c1dc7e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fda70000c00 tx=0x7fda700046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.325+0000 7fda82617640 1 -- 172.21.15.134:0/1977419657 shutdown_connections 2024-02-17T14:28:34.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.325+0000 7fda82617640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda7c140a90 0x7fda7c1dcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.325+0000 7fda82617640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fda6806b840 0x7fda6806dd00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.325+0000 7fda82617640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda7c070ef0 0x7fda7c1dc7e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.325+0000 7fda82617640 1 --2- 172.21.15.134:0/1977419657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda7c06ae10 0x7fda7c0ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.325+0000 7fda82617640 1 -- 172.21.15.134:0/1977419657 >> 172.21.15.134:0/1977419657 conn(0x7fda7c0b9350 msgr2=0x7fda7c13ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:34.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.325+0000 7fda82617640 1 -- 172.21.15.134:0/1977419657 shutdown_connections 2024-02-17T14:28:34.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.325+0000 7fda82617640 1 -- 172.21.15.134:0/1977419657 wait complete. 2024-02-17T14:28:34.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:28:34.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.437+0000 7f4e2f864640 1 Processor -- start 2024-02-17T14:28:34.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.437+0000 7f4e2f864640 1 -- start start 2024-02-17T14:28:34.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2f864640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4e280b56c0 0x7f4e280b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2f864640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4e2809cc70 0x7f4e280b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2f864640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e280afc10 con 0x7f4e28140bd0 2024-02-17T14:28:34.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2f864640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e280b5aa0 con 0x7f4e280b56c0 2024-02-17T14:28:34.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2f864640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e280b6010 con 0x7f4e2809cc70 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2d600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4e280b56c0 0x7f4e280b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2d600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4e280b56c0 0x7f4e280b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50162/0 (socket says 172.21.15.134:50162) 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2d600640 1 -- 172.21.15.134:0/1640384570 learned_addr learned my addr 172.21.15.134:0/1640384570 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2cdff640 1 --2- 172.21.15.134:0/1640384570 >> v2:172.21.15.142:3300/0 conn(0x7f4e2809cc70 0x7f4e280b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2d600640 1 -- 172.21.15.134:0/1640384570 >> v2:172.21.15.142:3300/0 conn(0x7f4e2809cc70 msgr2=0x7f4e280b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2d600640 1 --2- 172.21.15.134:0/1640384570 >> v2:172.21.15.142:3300/0 conn(0x7f4e2809cc70 0x7f4e280b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2d600640 1 -- 172.21.15.134:0/1640384570 >> v1:172.21.15.142:6789/0 conn(0x7f4e28140bd0 legacy=0x7f4e28141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2d600640 1 -- 172.21.15.134:0/1640384570 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e280b62f0 con 0x7f4e280b56c0 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.438+0000 7f4e2cdff640 1 --2- 172.21.15.134:0/1640384570 >> v2:172.21.15.142:3300/0 conn(0x7f4e2809cc70 0x7f4e280b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.439+0000 7f4e2d600640 1 --2- 172.21.15.134:0/1640384570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e280b56c0 0x7f4e280b04a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4e28074720 tx=0x7f4e1802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5de680bc18bb3bf server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.439+0000 7f4e1ffff640 1 -- 172.21.15.134:0/1640384570 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18030860 con 0x7f4e280b56c0 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.439+0000 7f4e1ffff640 1 -- 172.21.15.134:0/1640384570 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e180309c0 con 0x7f4e280b56c0 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.439+0000 7f4e1ffff640 1 -- 172.21.15.134:0/1640384570 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18030d50 con 0x7f4e280b56c0 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.440+0000 7f4e2f864640 1 -- 172.21.15.134:0/1640384570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e280b56c0 msgr2=0x7f4e280b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.440+0000 7f4e2f864640 1 --2- 172.21.15.134:0/1640384570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e280b56c0 0x7f4e280b04a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4e28074720 tx=0x7f4e1802b9a0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.440+0000 7f4e2f864640 1 -- 172.21.15.134:0/1640384570 shutdown_connections 2024-02-17T14:28:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.440+0000 7f4e2f864640 1 --2- 172.21.15.134:0/1640384570 >> v2:172.21.15.142:3300/0 conn(0x7f4e2809cc70 0x7f4e280b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.440+0000 7f4e2f864640 1 --2- 172.21.15.134:0/1640384570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e280b56c0 0x7f4e280b04a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.440+0000 7f4e2f864640 1 -- 172.21.15.134:0/1640384570 >> 172.21.15.134:0/1640384570 conn(0x7f4e280b6e70 msgr2=0x7f4e280b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.440+0000 7f4e2f864640 1 -- 172.21.15.134:0/1640384570 shutdown_connections 2024-02-17T14:28:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.440+0000 7f4e2f864640 1 -- 172.21.15.134:0/1640384570 wait complete. 2024-02-17T14:28:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.441+0000 7f4e2f864640 1 Processor -- start 2024-02-17T14:28:34.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.441+0000 7f4e2f864640 1 -- start start 2024-02-17T14:28:34.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.441+0000 7f4e2f864640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e2809cc70 0x7f4e2809b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.441+0000 7f4e2f864640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e280b56c0 0x7f4e281dbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.441+0000 7f4e2f864640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e28140bd0 0x7f4e281dc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.441+0000 7f4e2f864640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e280b26b0 con 0x7f4e28140bd0 2024-02-17T14:28:34.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.441+0000 7f4e2f864640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e281e0340 con 0x7f4e2809cc70 2024-02-17T14:28:34.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.441+0000 7f4e2f864640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e281df8c0 con 0x7f4e280b56c0 2024-02-17T14:28:34.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.441+0000 7f4e2de01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e28140bd0 0x7f4e281dc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.441+0000 7f4e2de01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e28140bd0 0x7f4e281dc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50166/0 (socket says 172.21.15.134:50166) 2024-02-17T14:28:34.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.441+0000 7f4e2de01640 1 -- 172.21.15.134:0/4257510493 learned_addr learned my addr 172.21.15.134:0/4257510493 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:34.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e2cdff640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e280b56c0 0x7f4e281dbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e2d600640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e2809cc70 0x7f4e2809b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e2de01640 1 -- 172.21.15.134:0/4257510493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e280b56c0 msgr2=0x7f4e281dbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e2de01640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e280b56c0 0x7f4e281dbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e2de01640 1 -- 172.21.15.134:0/4257510493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e2809cc70 msgr2=0x7f4e2809b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e2de01640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e2809cc70 0x7f4e2809b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e2de01640 1 -- 172.21.15.134:0/4257510493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e180094d0 con 0x7f4e28140bd0 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e2cdff640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e280b56c0 0x7f4e281dbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e2d600640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e2809cc70 0x7f4e2809b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e2de01640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e28140bd0 0x7f4e281dc330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000c760 tx=0x7f4e2000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e1dffb640 1 -- 172.21.15.134:0/4257510493 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20003b90 con 0x7f4e28140bd0 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e1dffb640 1 -- 172.21.15.134:0/4257510493 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e20003cf0 con 0x7f4e28140bd0 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e2f864640 1 -- 172.21.15.134:0/4257510493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e281dfb40 con 0x7f4e28140bd0 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e1dffb640 1 -- 172.21.15.134:0/4257510493 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000aa90 con 0x7f4e28140bd0 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.442+0000 7f4e2f864640 1 -- 172.21.15.134:0/4257510493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e280b28b0 con 0x7f4e28140bd0 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.443+0000 7f4e2f864640 1 -- 172.21.15.134:0/4257510493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e28067110 con 0x7f4e28140bd0 2024-02-17T14:28:34.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.444+0000 7f4e1dffb640 1 -- 172.21.15.134:0/4257510493 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4e2000abf0 con 0x7f4e28140bd0 2024-02-17T14:28:34.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.444+0000 7f4e1dffb640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4e0c06b810 0x7f4e0c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.444+0000 7f4e1dffb640 1 -- 172.21.15.134:0/4257510493 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4e2008a1d0 con 0x7f4e28140bd0 2024-02-17T14:28:34.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.444+0000 7f4e2d600640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4e0c06b810 0x7f4e0c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.445+0000 7f4e2d600640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4e0c06b810 0x7f4e0c06dcd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e18036000 tx=0x7f4e18008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:34.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.448+0000 7f4e1dffb640 1 -- 172.21.15.134:0/4257510493 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4e20054940 con 0x7f4e28140bd0 2024-02-17T14:28:34.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.620+0000 7f4e2f864640 1 -- 172.21.15.134:0/4257510493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e281e0000 con 0x7f4e28140bd0 2024-02-17T14:28:34.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.621+0000 7f4e1dffb640 1 -- 172.21.15.134:0/4257510493 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18550 (secure 0 0 0) 0x7f4e20003e60 con 0x7f4e28140bd0 2024-02-17T14:28:34.621 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:34.621 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:07.990271+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:28:34.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.623+0000 7f4e2f864640 1 -- 172.21.15.134:0/4257510493 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4e0c06b810 msgr2=0x7f4e0c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.623+0000 7f4e2f864640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4e0c06b810 0x7f4e0c06dcd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e18036000 tx=0x7f4e18008030 comp rx=0 tx=0).stop 2024-02-17T14:28:34.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.623+0000 7f4e2f864640 1 -- 172.21.15.134:0/4257510493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e28140bd0 msgr2=0x7f4e281dc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.623+0000 7f4e2f864640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e28140bd0 0x7f4e281dc330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000c760 tx=0x7f4e2000cc20 comp rx=0 tx=0).stop 2024-02-17T14:28:34.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.623+0000 7f4e2f864640 1 -- 172.21.15.134:0/4257510493 shutdown_connections 2024-02-17T14:28:34.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.623+0000 7f4e2f864640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4e0c06b810 0x7f4e0c06dcd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.623+0000 7f4e2f864640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e28140bd0 0x7f4e281dc330 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.623+0000 7f4e2f864640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e280b56c0 0x7f4e281dbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.623+0000 7f4e2f864640 1 --2- 172.21.15.134:0/4257510493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e2809cc70 0x7f4e2809b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.623+0000 7f4e2f864640 1 -- 172.21.15.134:0/4257510493 >> 172.21.15.134:0/4257510493 conn(0x7f4e280b6e70 msgr2=0x7f4e280b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:34.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.623+0000 7f4e2f864640 1 -- 172.21.15.134:0/4257510493 shutdown_connections 2024-02-17T14:28:34.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.623+0000 7f4e2f864640 1 -- 172.21.15.134:0/4257510493 wait complete. 2024-02-17T14:28:34.634 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T14:28:34.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.735+0000 7faba79c7640 1 Processor -- start 2024-02-17T14:28:34.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.735+0000 7faba79c7640 1 -- start start 2024-02-17T14:28:34.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.735+0000 7faba79c7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faba0072180 0x7faba006cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.735+0000 7faba79c7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba006d8d0 con 0x7faba00b5610 2024-02-17T14:28:34.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.735+0000 7faba79c7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba0147e80 con 0x7faba006d440 2024-02-17T14:28:34.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.735+0000 7faba79c7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba0147ba0 con 0x7faba0072180 2024-02-17T14:28:34.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.736+0000 7faba4f62640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faba0072180 0x7faba006cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.736+0000 7faba5763640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7faba00b5610 0x7faba0071a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:58434/0 (socket says 172.21.15.134:58434) 2024-02-17T14:28:34.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.736+0000 7faba5763640 1 -- 172.21.15.134:0/2722365619 learned_addr learned my addr 172.21.15.134:0/2722365619 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:28:34.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.736+0000 7faba4f62640 1 -- 172.21.15.134:0/2722365619 >> v1:172.21.15.142:6789/0 conn(0x7faba006d440 legacy=0x7faba0146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:34.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.736+0000 7faba4f62640 1 -- 172.21.15.134:0/2722365619 >> v1:172.21.15.134:6789/0 conn(0x7faba00b5610 legacy=0x7faba0071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.736+0000 7faba4f62640 1 -- 172.21.15.134:0/2722365619 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba0071550 con 0x7faba0072180 2024-02-17T14:28:34.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.736+0000 7fab97fff640 1 -- 172.21.15.134:0/2722365619 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867264863 0 0) 0x7faba006d8d0 con 0x7faba00b5610 2024-02-17T14:28:34.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.737+0000 7faba4f62640 1 --2- 172.21.15.134:0/2722365619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba0072180 0x7faba006cf00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fab900097a0 tx=0x7fab9002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d1c737699875b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:34.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.737+0000 7fab97fff640 1 -- 172.21.15.134:0/2722365619 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9002e070 con 0x7faba0072180 2024-02-17T14:28:34.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.737+0000 7fab97fff640 1 -- 172.21.15.134:0/2722365619 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab900315a0 con 0x7faba0072180 2024-02-17T14:28:34.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.737+0000 7fab97fff640 1 -- 172.21.15.134:0/2722365619 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90031930 con 0x7faba0072180 2024-02-17T14:28:34.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.737+0000 7faba79c7640 1 -- 172.21.15.134:0/2722365619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba0072180 msgr2=0x7faba006cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.737+0000 7faba79c7640 1 --2- 172.21.15.134:0/2722365619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba0072180 0x7faba006cf00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fab900097a0 tx=0x7fab9002b840 comp rx=0 tx=0).stop 2024-02-17T14:28:34.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.737+0000 7faba79c7640 1 -- 172.21.15.134:0/2722365619 shutdown_connections 2024-02-17T14:28:34.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.737+0000 7faba79c7640 1 --2- 172.21.15.134:0/2722365619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba0072180 0x7faba006cf00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.737+0000 7faba79c7640 1 -- 172.21.15.134:0/2722365619 >> 172.21.15.134:0/2722365619 conn(0x7faba00ba430 msgr2=0x7faba00ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:34.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.737+0000 7faba79c7640 1 -- 172.21.15.134:0/2722365619 shutdown_connections 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.737+0000 7faba79c7640 1 -- 172.21.15.134:0/2722365619 wait complete. 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.738+0000 7faba79c7640 1 Processor -- start 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.738+0000 7faba79c7640 1 -- start start 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba79c7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba006d440 0x7faba00af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba79c7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba0072180 0x7faba00b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba79c7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba00b5610 0x7faba009fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba79c7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba009d210 con 0x7faba006d440 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba79c7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba009f7b0 con 0x7faba00b5610 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba79c7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba00b4570 con 0x7faba0072180 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba5763640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba006d440 0x7faba00af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba5763640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba006d440 0x7faba00af980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50196/0 (socket says 172.21.15.134:50196) 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba5763640 1 -- 172.21.15.134:0/736793568 learned_addr learned my addr 172.21.15.134:0/736793568 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba4f62640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba0072180 0x7faba00b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba5763640 1 -- 172.21.15.134:0/736793568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba0072180 msgr2=0x7faba00b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba5f64640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba00b5610 0x7faba009fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba5763640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba0072180 0x7faba00b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba5763640 1 -- 172.21.15.134:0/736793568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba00b5610 msgr2=0x7faba009fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba5763640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba00b5610 0x7faba009fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba5763640 1 -- 172.21.15.134:0/736793568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90009400 con 0x7faba006d440 2024-02-17T14:28:34.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba4f62640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba0072180 0x7faba00b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:28:34.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.739+0000 7faba5763640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba006d440 0x7faba00af980 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00c430 tx=0x7fab9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:34.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.740+0000 7fab95ffb640 1 -- 172.21.15.134:0/736793568 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0074e0 con 0x7faba006d440 2024-02-17T14:28:34.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.740+0000 7fab95ffb640 1 -- 172.21.15.134:0/736793568 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c007660 con 0x7faba006d440 2024-02-17T14:28:34.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.740+0000 7faba79c7640 1 -- 172.21.15.134:0/736793568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba00b0ff0 con 0x7faba006d440 2024-02-17T14:28:34.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.740+0000 7fab95ffb640 1 -- 172.21.15.134:0/736793568 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c004a20 con 0x7faba006d440 2024-02-17T14:28:34.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.740+0000 7faba79c7640 1 -- 172.21.15.134:0/736793568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba00b0b00 con 0x7faba006d440 2024-02-17T14:28:34.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.741+0000 7faba79c7640 1 -- 172.21.15.134:0/736793568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba00b0d50 con 0x7faba006d440 2024-02-17T14:28:34.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.741+0000 7fab95ffb640 1 -- 172.21.15.134:0/736793568 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fab9c004b80 con 0x7faba006d440 2024-02-17T14:28:34.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.741+0000 7fab95ffb640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fab8406b810 0x7fab8406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:34.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.741+0000 7fab95ffb640 1 -- 172.21.15.134:0/736793568 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fab9c08a290 con 0x7faba006d440 2024-02-17T14:28:34.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.742+0000 7faba4f62640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fab8406b810 0x7fab8406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:34.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.742+0000 7faba4f62640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fab8406b810 0x7fab8406dcd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fab90036000 tx=0x7fab90008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:34.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.746+0000 7fab95ffb640 1 -- 172.21.15.134:0/736793568 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab9c054a00 con 0x7faba006d440 2024-02-17T14:28:34.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.953+0000 7faba79c7640 1 -- 172.21.15.134:0/736793568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faba00b9b10 con 0x7faba006d440 2024-02-17T14:28:34.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.953+0000 7fab95ffb640 1 -- 172.21.15.134:0/736793568 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3354 (secure 0 0 0) 0x7fab9c0580c0 con 0x7faba006d440 2024-02-17T14:28:34.953 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:28:34.953 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/137239145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":137239145},{"type":"v1","addr":"172.21.15.134:6835","nonce":137239145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T14:28:03.523163+0000","modified":"2024-02-17T14:28:24.032729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/177127534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":177127534},{"type":"v1","addr":"172.21.15.142:6833","nonce":177127534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T14:28:34.953 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 9 2024-02-17T14:28:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.956+0000 7faba79c7640 1 -- 172.21.15.134:0/736793568 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fab8406b810 msgr2=0x7fab8406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.956+0000 7faba79c7640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fab8406b810 0x7fab8406dcd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fab90036000 tx=0x7fab90008030 comp rx=0 tx=0).stop 2024-02-17T14:28:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.956+0000 7faba79c7640 1 -- 172.21.15.134:0/736793568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba006d440 msgr2=0x7faba00af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.956+0000 7faba79c7640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba006d440 0x7faba00af980 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00c430 tx=0x7fab9c00c8f0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.956+0000 7faba79c7640 1 -- 172.21.15.134:0/736793568 shutdown_connections 2024-02-17T14:28:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.956+0000 7faba79c7640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba00b5610 0x7faba009fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.956+0000 7faba79c7640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faba0072180 0x7faba00b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.956+0000 7faba79c7640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fab8406b810 0x7fab8406dcd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.956+0000 7faba79c7640 1 --2- 172.21.15.134:0/736793568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faba006d440 0x7faba00af980 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.956+0000 7faba79c7640 1 -- 172.21.15.134:0/736793568 >> 172.21.15.134:0/736793568 conn(0x7faba00ba430 msgr2=0x7faba006c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.956+0000 7faba79c7640 1 -- 172.21.15.134:0/736793568 shutdown_connections 2024-02-17T14:28:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:34.956+0000 7faba79c7640 1 -- 172.21.15.134:0/736793568 wait complete. 2024-02-17T14:28:35.168 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-17T14:28:03.523163+0000', 'modified': '2024-02-17T14:28:24.032729+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6833/177127534', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 177127534}, {'type': 'v1', 'addr': '172.21.15.142:6833', 'nonce': 177127534}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-17T14:28:35.168 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-17T14:28:35.168 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-02-17T14:28:35.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.271+0000 7f6cd30ae640 1 Processor -- start 2024-02-17T14:28:35.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.271+0000 7f6cd30ae640 1 -- start start 2024-02-17T14:28:35.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.271+0000 7f6cd30ae640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6ccc0b56c0 0x7f6ccc0b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.271+0000 7f6cd30ae640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ccc09cc70 0x7f6ccc0b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.271+0000 7f6cd30ae640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ccc140bd0 0x7f6ccc141060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.271+0000 7f6cd30ae640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc0afc10 con 0x7f6ccc0b56c0 2024-02-17T14:28:35.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.271+0000 7f6cd30ae640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc0b5aa0 con 0x7f6ccc140bd0 2024-02-17T14:28:35.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.271+0000 7f6cd30ae640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0b6010 con 0x7f6ccc09cc70 2024-02-17T14:28:35.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.271+0000 7f6cd0e4a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6ccc0b56c0 0x7f6ccc0b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.272+0000 7f6cd0e4a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6ccc0b56c0 0x7f6ccc0b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50202/0 (socket says 172.21.15.134:50202) 2024-02-17T14:28:35.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.272+0000 7f6cd0e4a640 1 -- 172.21.15.134:0/4050043561 learned_addr learned my addr 172.21.15.134:0/4050043561 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:35.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.272+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/4050043561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ccc09cc70 0x7f6ccc0b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.272+0000 7f6cd164b640 1 --2- 172.21.15.134:0/4050043561 >> v2:172.21.15.142:3300/0 conn(0x7f6ccc140bd0 0x7f6ccc141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.272+0000 7f6cd0e4a640 1 -- 172.21.15.134:0/4050043561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ccc09cc70 msgr2=0x7f6ccc0b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:35.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.272+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/4050043561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ccc09cc70 0x7f6ccc0b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.272+0000 7f6cd0e4a640 1 -- 172.21.15.134:0/4050043561 >> v2:172.21.15.142:3300/0 conn(0x7f6ccc140bd0 msgr2=0x7f6ccc141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:35.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.272+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/4050043561 >> v2:172.21.15.142:3300/0 conn(0x7f6ccc140bd0 0x7f6ccc141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.272+0000 7f6cd0e4a640 1 -- 172.21.15.134:0/4050043561 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc0b62f0 con 0x7f6ccc0b56c0 2024-02-17T14:28:35.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.272+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/4050043561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ccc0b56c0 0x7f6ccc0b04a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc09d090 tx=0x7f6cc002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2fb4c7634d1b41 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:35.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.273+0000 7f6ccb7fe640 1 -- 172.21.15.134:0/4050043561 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0031870 con 0x7f6ccc0b56c0 2024-02-17T14:28:35.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.273+0000 7f6ccb7fe640 1 -- 172.21.15.134:0/4050043561 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc00319d0 con 0x7f6ccc0b56c0 2024-02-17T14:28:35.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.273+0000 7f6ccb7fe640 1 -- 172.21.15.134:0/4050043561 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0031d60 con 0x7f6ccc0b56c0 2024-02-17T14:28:35.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.273+0000 7f6cd30ae640 1 -- 172.21.15.134:0/4050043561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ccc0b56c0 msgr2=0x7f6ccc0b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.273+0000 7f6cd30ae640 1 --2- 172.21.15.134:0/4050043561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ccc0b56c0 0x7f6ccc0b04a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc09d090 tx=0x7f6cc002b910 comp rx=0 tx=0).stop 2024-02-17T14:28:35.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.273+0000 7f6cd30ae640 1 -- 172.21.15.134:0/4050043561 shutdown_connections 2024-02-17T14:28:35.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.273+0000 7f6cd30ae640 1 --2- 172.21.15.134:0/4050043561 >> v2:172.21.15.142:3300/0 conn(0x7f6ccc140bd0 0x7f6ccc141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.273+0000 7f6cd30ae640 1 --2- 172.21.15.134:0/4050043561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ccc09cc70 0x7f6ccc0b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.273+0000 7f6cd30ae640 1 --2- 172.21.15.134:0/4050043561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ccc0b56c0 0x7f6ccc0b04a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.273+0000 7f6cd30ae640 1 -- 172.21.15.134:0/4050043561 >> 172.21.15.134:0/4050043561 conn(0x7f6ccc0b6e70 msgr2=0x7f6ccc0b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.273+0000 7f6cd30ae640 1 -- 172.21.15.134:0/4050043561 shutdown_connections 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.273+0000 7f6cd30ae640 1 -- 172.21.15.134:0/4050043561 wait complete. 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.274+0000 7f6cd30ae640 1 Processor -- start 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.274+0000 7f6cd30ae640 1 -- start start 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd30ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ccc09cc70 0x7f6ccc1dc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd30ae640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ccc0b56c0 0x7f6ccc099ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd30ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc140bd0 0x7f6ccc1e05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd30ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc1dd5b0 con 0x7f6ccc09cc70 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd30ae640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc1dfb70 con 0x7f6ccc140bd0 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd30ae640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc1e0130 con 0x7f6ccc0b56c0 2024-02-17T14:28:35.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd0e4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ccc09cc70 0x7f6ccc1dc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd0e4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ccc09cc70 0x7f6ccc1dc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50216/0 (socket says 172.21.15.134:50216) 2024-02-17T14:28:35.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd0e4a640 1 -- 172.21.15.134:0/3272952891 learned_addr learned my addr 172.21.15.134:0/3272952891 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:35.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd164b640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc140bd0 0x7f6ccc1e05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ccc0b56c0 0x7f6ccc099ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd0e4a640 1 -- 172.21.15.134:0/3272952891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ccc0b56c0 msgr2=0x7f6ccc099ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ccc0b56c0 0x7f6ccc099ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd0e4a640 1 -- 172.21.15.134:0/3272952891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc140bd0 msgr2=0x7f6ccc1e05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc140bd0 0x7f6ccc1e05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6cd0e4a640 1 -- 172.21.15.134:0/3272952891 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc00094d0 con 0x7f6ccc09cc70 2024-02-17T14:28:35.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.275+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ccc0b56c0 0x7f6ccc099ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:35.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.276+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ccc09cc70 0x7f6ccc1dc600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0000c00 tx=0x7f6cc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:35.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.276+0000 7f6cc97fa640 1 -- 172.21.15.134:0/3272952891 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc003ac60 con 0x7f6ccc09cc70 2024-02-17T14:28:35.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.276+0000 7f6cc97fa640 1 -- 172.21.15.134:0/3272952891 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc003ade0 con 0x7f6ccc09cc70 2024-02-17T14:28:35.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.276+0000 7f6cd30ae640 1 -- 172.21.15.134:0/3272952891 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc09c3e0 con 0x7f6ccc09cc70 2024-02-17T14:28:35.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.276+0000 7f6cc97fa640 1 -- 172.21.15.134:0/3272952891 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0042630 con 0x7f6ccc09cc70 2024-02-17T14:28:35.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.276+0000 7f6cd30ae640 1 -- 172.21.15.134:0/3272952891 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc1dfdc0 con 0x7f6ccc09cc70 2024-02-17T14:28:35.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.277+0000 7f6cc97fa640 1 -- 172.21.15.134:0/3272952891 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f6cc00303c0 con 0x7f6ccc09cc70 2024-02-17T14:28:35.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.278+0000 7f6cc97fa640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6cb006b810 0x7f6cb006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.278+0000 7f6cc97fa640 1 -- 172.21.15.134:0/3272952891 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6cc002d040 con 0x7f6ccc09cc70 2024-02-17T14:28:35.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.278+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6cb006b810 0x7f6cb006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.278+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6cb006b810 0x7f6cb006dcd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc09a4d0 tx=0x7f6cb8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:35.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd5c81740 1 Processor -- start 2024-02-17T14:28:35.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd5c81740 1 -- start start 2024-02-17T14:28:35.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd5c81740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd90c9a0 0x5596cd93bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd5c81740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd93c400 0x5596cd934e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd5c81740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd935820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd5c81740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596cd8c8cd0 con 0x5596cd9353a0 2024-02-17T14:28:35.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd5c81740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596cd87bf20 con 0x5596cd90c9a0 2024-02-17T14:28:35.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd5c81740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596cd879450 con 0x5596cd93c400 2024-02-17T14:28:35.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd164b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd935820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd164b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd935820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50230/0 (socket says 172.21.15.134:50230) 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd164b640 1 -- 172.21.15.134:0/1850970099 learned_addr learned my addr 172.21.15.134:0/1850970099 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/1850970099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd93c400 0x5596cd934e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/1850970099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd90c9a0 0x5596cd93bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd164b640 1 -- 172.21.15.134:0/1850970099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd93c400 msgr2=0x5596cd934e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd164b640 1 --2- 172.21.15.134:0/1850970099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd93c400 0x5596cd934e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd164b640 1 -- 172.21.15.134:0/1850970099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd90c9a0 msgr2=0x5596cd93bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd164b640 1 --2- 172.21.15.134:0/1850970099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd90c9a0 0x5596cd93bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.279+0000 7f6cd164b640 1 -- 172.21.15.134:0/1850970099 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596cd829f20 con 0x5596cd9353a0 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.280+0000 7f6cd164b640 1 --2- 172.21.15.134:0/1850970099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd935820 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4011550 tx=0x7f6cc4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b622b95c6afd01b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.280+0000 7f6cb67fc640 1 -- 172.21.15.134:0/1850970099 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc400e040 con 0x5596cd9353a0 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.280+0000 7f6cb67fc640 1 -- 172.21.15.134:0/1850970099 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc400f040 con 0x5596cd9353a0 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.280+0000 7f6cb67fc640 1 -- 172.21.15.134:0/1850970099 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4015a40 con 0x5596cd9353a0 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.280+0000 7f6cd5c81740 1 -- 172.21.15.134:0/1850970099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 msgr2=0x5596cd935820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.280+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/1850970099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd935820 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4011550 tx=0x7f6cc4009750 comp rx=0 tx=0).stop 2024-02-17T14:28:35.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.280+0000 7f6cd5c81740 1 -- 172.21.15.134:0/1850970099 shutdown_connections 2024-02-17T14:28:35.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.280+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/1850970099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd935820 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.280+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/1850970099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd93c400 0x5596cd934e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.280+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/1850970099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd90c9a0 0x5596cd93bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.280+0000 7f6cd5c81740 1 -- 172.21.15.134:0/1850970099 >> 172.21.15.134:0/1850970099 conn(0x5596cd909f70 msgr2=0x5596cd90bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:35.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.280+0000 7f6cd5c81740 1 -- 172.21.15.134:0/1850970099 shutdown_connections 2024-02-17T14:28:35.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.280+0000 7f6cd5c81740 1 -- 172.21.15.134:0/1850970099 wait complete. 2024-02-17T14:28:35.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.281+0000 7f6cd5c81740 1 -- start start 2024-02-17T14:28:35.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.281+0000 7f6cd5c81740 1 Processor -- start 2024-02-17T14:28:35.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6cd5c81740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd9353a0 0x5596cd933ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6cd5c81740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd93c400 0x5596cd9317e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6cd5c81740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd92d190 0x5596cd92d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6cd5c81740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596cd874c30 con 0x5596cd93c400 2024-02-17T14:28:35.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6cd5c81740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596cd819d30 con 0x5596cd92d190 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6cd5c81740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596cd548310 con 0x5596cd9353a0 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6cd5c81740 10 client.0 _ll_register_callbacks cb 0x5596cd821d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6ccbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd93c400 0x5596cd9317e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6ccbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd93c400 0x5596cd9317e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50236/0 (socket says 172.21.15.134:50236) 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6ccbfff640 1 -- 172.21.15.134:0/965923202 learned_addr learned my addr 172.21.15.134:0/965923202 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/965923202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd9353a0 0x5596cd933ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6cd164b640 1 --2- 172.21.15.134:0/965923202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd92d190 0x5596cd92d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6ccbfff640 1 -- 172.21.15.134:0/965923202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd9353a0 msgr2=0x5596cd933ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/965923202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd9353a0 0x5596cd933ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6ccbfff640 1 -- 172.21.15.134:0/965923202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd92d190 msgr2=0x5596cd92d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/965923202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd92d190 0x5596cd92d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6ccbfff640 1 -- 172.21.15.134:0/965923202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc4011230 con 0x5596cd93c400 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/965923202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd93c400 0x5596cd9317e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8015720 tx=0x7f6cb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1a239389c698e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6cab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-02-17T14:28:35.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6cab7fe640 1 -- 172.21.15.134:0/965923202 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8014830 con 0x5596cd93c400 2024-02-17T14:28:35.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6cab7fe640 1 -- 172.21.15.134:0/965923202 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6cb8014990 con 0x5596cd93c400 2024-02-17T14:28:35.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.282+0000 7f6cd5c81740 1 -- 172.21.15.134:0/965923202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596cd5746c0 con 0x5596cd93c400 2024-02-17T14:28:35.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cab7fe640 1 -- 172.21.15.134:0/965923202 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cb8014b50 con 0x5596cd93c400 2024-02-17T14:28:35.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cd5c81740 10 client.4818 fetch_fsmap learned FSMap version 9 2024-02-17T14:28:35.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cd5c81740 1 -- 172.21.15.134:0/965923202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5596cd8732b0 con 0x5596cd93c400 2024-02-17T14:28:35.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cab7fe640 1 -- 172.21.15.134:0/965923202 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5596cd5746c0 con 0x5596cd93c400 2024-02-17T14:28:35.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cab7fe640 1 -- 172.21.15.134:0/965923202 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 9) v1 ==== 2152+0+0 (secure 0 0 0) 0x7f6cb802bd10 con 0x5596cd93c400 2024-02-17T14:28:35.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cd5c81740 10 client.4818 fetch_fsmap finished waiting for FSMap version 9 2024-02-17T14:28:35.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cd5c81740 10 client.4818 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-17T14:28:35.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cd5c81740 20 client.4818 populate_metadata read hostname 'smithi134' 2024-02-17T14:28:35.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/965923202 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x5596cd94c5d0 0x5596cd94c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cd5c81740 4 client.4818 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cd5c81740 1 -- 172.21.15.134:0/965923202 --> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5596cd5c5270 con 0x5596cd94c5d0 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/965923202 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x5596cd94c5d0 0x5596cd94c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cab7fe640 10 client.4818 ms_handle_connect on v2:172.21.15.142:6832/177127534 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.283+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/965923202 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x5596cd94c5d0 0x5596cd94c9b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a83cd2f2c189cb5b server_cookie=15bd2488925ec0e8 in_seq=0 out_seq=0 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cab7fe640 1 -- 172.21.15.134:0/965923202 <== mds.0 v2:172.21.15.142:6832/177127534 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5596cd5c5270 con 0x5596cd94c5d0 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cab7fe640 10 client.4818 handle_command_reply: tid=0 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cd5c81740 1 client.4818 shutdown 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cd5c81740 1 -- 172.21.15.134:0/965923202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd93c400 msgr2=0x5596cd9317e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/965923202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd93c400 0x5596cd9317e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8015720 tx=0x7f6cb80046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cd5c81740 1 -- 172.21.15.134:0/965923202 shutdown_connections 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/965923202 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x5596cd94c5d0 0x5596cd94c9b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/965923202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd92d190 0x5596cd92d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/965923202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd93c400 0x5596cd9317e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/965923202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd9353a0 0x5596cd933ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cab7fe640 0 client.4818 ms_handle_reset on v2:172.21.15.142:6832/177127534 2024-02-17T14:28:35.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cd5c81740 1 -- 172.21.15.134:0/965923202 >> 172.21.15.134:0/965923202 conn(0x5596cd90c9a0 msgr2=0x5596cd906f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:35.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cd5c81740 1 -- 172.21.15.134:0/965923202 shutdown_connections 2024-02-17T14:28:35.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cd5c81740 1 -- 172.21.15.134:0/965923202 wait complete. 2024-02-17T14:28:35.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.284+0000 7f6cd5c81740 20 client.4818 trim_cache size 0 max 16384 2024-02-17T14:28:35.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.300+0000 7f6cd5c81740 1 Processor -- start 2024-02-17T14:28:35.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.300+0000 7f6cd5c81740 1 -- start start 2024-02-17T14:28:35.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6cd5c81740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd92d190 0x5596cd934bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6cd5c81740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd907170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6cd5c81740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd93c400 0x5596cd90cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6cd5c81740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596cd7fa490 con 0x5596cd9353a0 2024-02-17T14:28:35.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6cd5c81740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596cd93c7e0 con 0x5596cd92d190 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6cd5c81740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596cd5c5270 con 0x5596cd93c400 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6ccbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd907170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6ccbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd907170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50242/0 (socket says 172.21.15.134:50242) 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6ccbfff640 1 -- 172.21.15.134:0/1471570186 learned_addr learned my addr 172.21.15.134:0/1471570186 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6cd164b640 1 --2- 172.21.15.134:0/1471570186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd93c400 0x5596cd90cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/1471570186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd92d190 0x5596cd934bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6ccbfff640 1 -- 172.21.15.134:0/1471570186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd93c400 msgr2=0x5596cd90cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/1471570186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd93c400 0x5596cd90cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6ccbfff640 1 -- 172.21.15.134:0/1471570186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd92d190 msgr2=0x5596cd934bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/1471570186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd92d190 0x5596cd934bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6ccbfff640 1 -- 172.21.15.134:0/1471570186 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596cd80fa20 con 0x5596cd9353a0 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/1471570186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd92d190 0x5596cd934bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/1471570186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd907170 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8008010 tx=0x7f6cb8022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bd5f21246ebfe9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6cb5ffb640 1 -- 172.21.15.134:0/1471570186 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80143e0 con 0x5596cd9353a0 2024-02-17T14:28:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6cb5ffb640 1 -- 172.21.15.134:0/1471570186 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8039070 con 0x5596cd9353a0 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.301+0000 7f6cb5ffb640 1 -- 172.21.15.134:0/1471570186 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8011e90 con 0x5596cd9353a0 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.302+0000 7f6cd5c81740 1 -- 172.21.15.134:0/1471570186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 msgr2=0x5596cd907170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.302+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/1471570186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd907170 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8008010 tx=0x7f6cb8022000 comp rx=0 tx=0).stop 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.302+0000 7f6cd5c81740 1 -- 172.21.15.134:0/1471570186 shutdown_connections 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.302+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/1471570186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd93c400 0x5596cd90cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.302+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/1471570186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd907170 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.302+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/1471570186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd92d190 0x5596cd934bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.302+0000 7f6cd5c81740 1 -- 172.21.15.134:0/1471570186 >> 172.21.15.134:0/1471570186 conn(0x5596cd90c9a0 msgr2=0x5596cd903660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.302+0000 7f6cd5c81740 1 -- 172.21.15.134:0/1471570186 shutdown_connections 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.302+0000 7f6cd5c81740 1 -- 172.21.15.134:0/1471570186 wait complete. 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.302+0000 7f6cd5c81740 1 -- start start 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.302+0000 7f6cd5c81740 1 Processor -- start 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6cd5c81740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd92d190 0x5596cd9a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6cd5c81740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd9a1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6cd5c81740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd93c400 0x5596cd90d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6cd5c81740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596cd9aa8b0 con 0x5596cd9353a0 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6cd5c81740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596cd908170 con 0x5596cd93c400 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6cd5c81740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596cd908950 con 0x5596cd92d190 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6cd5c81740 10 client.0 _ll_register_callbacks cb 0x7f6cc4009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6ccbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd9a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6cd0e4a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd92d190 0x5596cd9a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6ccbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd9a1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50256/0 (socket says 172.21.15.134:50256) 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6ccbfff640 1 -- 172.21.15.134:0/4228570871 learned_addr learned my addr 172.21.15.134:0/4228570871 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6cd164b640 1 --2- 172.21.15.134:0/4228570871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd93c400 0x5596cd90d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6ccbfff640 1 -- 172.21.15.134:0/4228570871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd92d190 msgr2=0x5596cd9a0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/4228570871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd92d190 0x5596cd9a0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6ccbfff640 1 -- 172.21.15.134:0/4228570871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd93c400 msgr2=0x5596cd90d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/4228570871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd93c400 0x5596cd90d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6ccbfff640 1 -- 172.21.15.134:0/4228570871 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596cd8732b0 con 0x5596cd9353a0 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.303+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/4228570871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd92d190 0x5596cd9a0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6ccbfff640 1 --2- 172.21.15.134:0/4228570871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd9a1420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8000c00 tx=0x7f6cb8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed36200d443a838 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cab7fe640 1 -- 172.21.15.134:0/4228570871 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8011e90 con 0x5596cd9353a0 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cab7fe640 1 -- 172.21.15.134:0/4228570871 <== mon.0 v2:172.21.15.134:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6cb803b070 con 0x5596cd9353a0 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cd5c81740 1 -- 172.21.15.134:0/4228570871 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6cc400f040 con 0x5596cd9353a0 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cab7fe640 1 -- 172.21.15.134:0/4228570871 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cb8015440 con 0x5596cd9353a0 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cd5c81740 10 client.4824 fetch_fsmap learned FSMap version 9 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cd5c81740 1 -- 172.21.15.134:0/4228570871 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5596cd835780 con 0x5596cd9353a0 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cab7fe640 1 -- 172.21.15.134:0/4228570871 <== mon.0 v2:172.21.15.134:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc400f040 con 0x5596cd9353a0 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cab7fe640 1 -- 172.21.15.134:0/4228570871 <== mon.0 v2:172.21.15.134:3300/0 5 ==== fsmap(e 9) v1 ==== 2152+0+0 (secure 0 0 0) 0x7f6cb8040480 con 0x5596cd9353a0 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cd5c81740 10 client.4824 fetch_fsmap finished waiting for FSMap version 9 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cd5c81740 10 client.4824 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cd5c81740 20 client.4824 populate_metadata read hostname 'smithi134' 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/4228570871 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x5596cd90d6c0 0x5596cd93f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cd5c81740 4 client.4824 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cd5c81740 1 -- 172.21.15.134:0/4228570871 --> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5596cd5b1610 con 0x5596cd90d6c0 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.304+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/4228570871 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x5596cd90d6c0 0x5596cd93f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cd0e4a640 1 --2- 172.21.15.134:0/4228570871 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x5596cd90d6c0 0x5596cd93f0d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87c80a1e1d029d7e server_cookie=d03c11466e3777f7 in_seq=0 out_seq=0 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cab7fe640 10 client.4824 ms_handle_connect on v2:172.21.15.142:6832/177127534 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cab7fe640 1 -- 172.21.15.134:0/4228570871 <== mds.0 v2:172.21.15.142:6832/177127534 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5596cd5b1610 con 0x5596cd90d6c0 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cab7fe640 10 client.4824 handle_command_reply: tid=0 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cd5c81740 1 client.4824 shutdown 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cd5c81740 1 -- 172.21.15.134:0/4228570871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 msgr2=0x5596cd9a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/4228570871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd9a1420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8000c00 tx=0x7f6cb8016000 comp rx=0 tx=0).stop 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cd5c81740 1 -- 172.21.15.134:0/4228570871 shutdown_connections 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/4228570871 >> [v2:172.21.15.142:6832/177127534,v1:172.21.15.142:6833/177127534] conn(0x5596cd90d6c0 0x5596cd93f0d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/4228570871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596cd93c400 0x5596cd90d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cab7fe640 0 client.4824 ms_handle_reset on v2:172.21.15.142:6832/177127534 2024-02-17T14:28:35.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/4228570871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596cd9353a0 0x5596cd9a1420 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cd5c81740 1 --2- 172.21.15.134:0/4228570871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5596cd92d190 0x5596cd9a0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cd5c81740 1 -- 172.21.15.134:0/4228570871 >> 172.21.15.134:0/4228570871 conn(0x5596cd90c9a0 msgr2=0x5596cd934bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:35.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cd5c81740 1 -- 172.21.15.134:0/4228570871 shutdown_connections 2024-02-17T14:28:35.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cd5c81740 1 -- 172.21.15.134:0/4228570871 wait complete. 2024-02-17T14:28:35.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.305+0000 7f6cd5c81740 20 client.4824 trim_cache size 0 max 16384 2024-02-17T14:28:35.311 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-17T14:28:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: "cluster_fsid": "b1013434-3edf-47fa-8dd2-e861b79d4deb", 2024-02-17T14:28:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: "whoami": 0, 2024-02-17T14:28:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 4264, 2024-02-17T14:28:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "want_state": "up:active", 2024-02-17T14:28:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "state": "up:active", 2024-02-17T14:28:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs", 2024-02-17T14:28:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "rank_uptime": 31.251468055, 2024-02-17T14:28:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "mdsmap_epoch": 9, 2024-02-17T14:28:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch": 25, 2024-02-17T14:28:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_epoch_barrier": 25, 2024-02-17T14:28:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "uptime": 38.261393257999998 2024-02-17T14:28:35.312 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-17T14:28:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.306+0000 7f6cd30ae640 1 -- 172.21.15.134:0/3272952891 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6cb006b810 msgr2=0x7f6cb006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.306+0000 7f6cd30ae640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6cb006b810 0x7f6cb006dcd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc09a4d0 tx=0x7f6cb8008040 comp rx=0 tx=0).stop 2024-02-17T14:28:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.306+0000 7f6cd30ae640 1 -- 172.21.15.134:0/3272952891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ccc09cc70 msgr2=0x7f6ccc1dc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.306+0000 7f6cd30ae640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ccc09cc70 0x7f6ccc1dc600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0000c00 tx=0x7f6cc00046c0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.306+0000 7f6cd30ae640 1 -- 172.21.15.134:0/3272952891 shutdown_connections 2024-02-17T14:28:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.306+0000 7f6cd30ae640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc140bd0 0x7f6ccc1e05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.306+0000 7f6cd30ae640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ccc0b56c0 0x7f6ccc099ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.306+0000 7f6cd30ae640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f6cb006b810 0x7f6cb006dcd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.306+0000 7f6cd30ae640 1 --2- 172.21.15.134:0/3272952891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ccc09cc70 0x7f6ccc1dc600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.306+0000 7f6cd30ae640 1 -- 172.21.15.134:0/3272952891 >> 172.21.15.134:0/3272952891 conn(0x7f6ccc0b6e70 msgr2=0x7f6ccc0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:35.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.306+0000 7f6cd30ae640 1 -- 172.21.15.134:0/3272952891 shutdown_connections 2024-02-17T14:28:35.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.306+0000 7f6cd30ae640 1 -- 172.21.15.134:0/3272952891 wait complete. 2024-02-17T14:28:35.316 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-02-17T14:28:35.329 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-02-17T14:28:35.329 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-02-17T14:28:35.329 INFO:tasks.ceph_fuse:client.0 config is {} 2024-02-17T14:28:35.329 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-17T14:28:35.329 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T14:28:35.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:35.329 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-02-17T14:28:35.344 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-02-17T14:28:35.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:35.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-17T14:28:35.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:35.413 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-02-17T14:28:35.509 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-02-17T14:28:35.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T14:28:35.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.613+0000 7fab1da57640 1 Processor -- start 2024-02-17T14:28:35.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.613+0000 7fab1da57640 1 -- start start 2024-02-17T14:28:35.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.614+0000 7fab1da57640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fab180b1b50 0x7fab180b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.614+0000 7fab1da57640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab1806f370 0x7fab180729e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.614+0000 7fab1da57640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fab1813eb30 0x7fab1813ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.614+0000 7fab1da57640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1806f7b0 con 0x7fab180b1b50 2024-02-17T14:28:35.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.614+0000 7fab1da57640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab180b1f30 con 0x7fab1813eb30 2024-02-17T14:28:35.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.614+0000 7fab1da57640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1806fc70 con 0x7fab1806f370 2024-02-17T14:28:35.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.614+0000 7fab16ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fab180b1b50 0x7fab180b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.614+0000 7fab16ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fab180b1b50 0x7fab180b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50266/0 (socket says 172.21.15.134:50266) 2024-02-17T14:28:35.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.614+0000 7fab16ffd640 1 -- 172.21.15.134:0/2166603929 learned_addr learned my addr 172.21.15.134:0/2166603929 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:35.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.614+0000 7fab177fe640 1 --2- 172.21.15.134:0/2166603929 >> v2:172.21.15.142:3300/0 conn(0x7fab1813eb30 0x7fab1813ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.614+0000 7fab167fc640 1 --2- 172.21.15.134:0/2166603929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab1806f370 0x7fab180729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.614+0000 7fab16ffd640 1 -- 172.21.15.134:0/2166603929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab1806f370 msgr2=0x7fab180729e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:35.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.614+0000 7fab16ffd640 1 --2- 172.21.15.134:0/2166603929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab1806f370 0x7fab180729e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.615+0000 7fab16ffd640 1 -- 172.21.15.134:0/2166603929 >> v2:172.21.15.142:3300/0 conn(0x7fab1813eb30 msgr2=0x7fab1813ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:28:35.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.615+0000 7fab16ffd640 1 --2- 172.21.15.134:0/2166603929 >> v2:172.21.15.142:3300/0 conn(0x7fab1813eb30 0x7fab1813ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.615+0000 7fab16ffd640 1 -- 172.21.15.134:0/2166603929 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1806ff30 con 0x7fab180b1b50 2024-02-17T14:28:35.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.615+0000 7fab16ffd640 1 --2- 172.21.15.134:0/2166603929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab180b1b50 0x7fab180b3f90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab180716e0 tx=0x7fab0802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8023f895729c690d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:35.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.615+0000 7fab15ffb640 1 -- 172.21.15.134:0/2166603929 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0802c950 con 0x7fab180b1b50 2024-02-17T14:28:35.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.615+0000 7fab15ffb640 1 -- 172.21.15.134:0/2166603929 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0802cab0 con 0x7fab180b1b50 2024-02-17T14:28:35.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.615+0000 7fab15ffb640 1 -- 172.21.15.134:0/2166603929 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0802ce40 con 0x7fab180b1b50 2024-02-17T14:28:35.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.616+0000 7fab1da57640 1 -- 172.21.15.134:0/2166603929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab180b1b50 msgr2=0x7fab180b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.616+0000 7fab1da57640 1 --2- 172.21.15.134:0/2166603929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab180b1b50 0x7fab180b3f90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab180716e0 tx=0x7fab0802bdb0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.616+0000 7fab1da57640 1 -- 172.21.15.134:0/2166603929 shutdown_connections 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.616+0000 7fab1da57640 1 --2- 172.21.15.134:0/2166603929 >> v2:172.21.15.142:3300/0 conn(0x7fab1813eb30 0x7fab1813ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.616+0000 7fab1da57640 1 --2- 172.21.15.134:0/2166603929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab1806f370 0x7fab180729e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.616+0000 7fab1da57640 1 --2- 172.21.15.134:0/2166603929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab180b1b50 0x7fab180b3f90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.616+0000 7fab1da57640 1 -- 172.21.15.134:0/2166603929 >> 172.21.15.134:0/2166603929 conn(0x7fab180b8270 msgr2=0x7fab180b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.616+0000 7fab1da57640 1 -- 172.21.15.134:0/2166603929 shutdown_connections 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.616+0000 7fab1da57640 1 -- 172.21.15.134:0/2166603929 wait complete. 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.617+0000 7fab1da57640 1 Processor -- start 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.617+0000 7fab1da57640 1 -- start start 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab1da57640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab1806f370 0x7fab1813a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab1da57640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab180b1b50 0x7fab18146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab1da57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab1813eb30 0x7fab181e0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab1da57640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab18147ed0 con 0x7fab1813eb30 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab1da57640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab180b74a0 con 0x7fab180b1b50 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab1da57640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab18148a40 con 0x7fab1806f370 2024-02-17T14:28:35.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab177fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab1813eb30 0x7fab181e0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab16ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab1806f370 0x7fab1813a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab177fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab1813eb30 0x7fab181e0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50268/0 (socket says 172.21.15.134:50268) 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab177fe640 1 -- 172.21.15.134:0/2807701651 learned_addr learned my addr 172.21.15.134:0/2807701651 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab167fc640 1 --2- 172.21.15.134:0/2807701651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab180b1b50 0x7fab18146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab177fe640 1 -- 172.21.15.134:0/2807701651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab1806f370 msgr2=0x7fab1813a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab177fe640 1 --2- 172.21.15.134:0/2807701651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab1806f370 0x7fab1813a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab177fe640 1 -- 172.21.15.134:0/2807701651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab180b1b50 msgr2=0x7fab18146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab177fe640 1 --2- 172.21.15.134:0/2807701651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab180b1b50 0x7fab18146890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab177fe640 1 -- 172.21.15.134:0/2807701651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab08009b30 con 0x7fab1813eb30 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab177fe640 1 --2- 172.21.15.134:0/2807701651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab1813eb30 0x7fab181e0a40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fab1000d5d0 tx=0x7fab1000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7faafffff640 1 -- 172.21.15.134:0/2807701651 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab100125f0 con 0x7fab1813eb30 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7faafffff640 1 -- 172.21.15.134:0/2807701651 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab10012770 con 0x7fab1813eb30 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7faafffff640 1 -- 172.21.15.134:0/2807701651 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10012b20 con 0x7fab1813eb30 2024-02-17T14:28:35.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.618+0000 7fab1da57640 1 -- 172.21.15.134:0/2807701651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab18148d20 con 0x7fab1813eb30 2024-02-17T14:28:35.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.619+0000 7fab1da57640 1 -- 172.21.15.134:0/2807701651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab181485d0 con 0x7fab1813eb30 2024-02-17T14:28:35.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.620+0000 7fab1da57640 1 -- 172.21.15.134:0/2807701651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1806fa60 con 0x7fab1813eb30 2024-02-17T14:28:35.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.620+0000 7faafffff640 1 -- 172.21.15.134:0/2807701651 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fab10012c80 con 0x7fab1813eb30 2024-02-17T14:28:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.620+0000 7faafffff640 1 --2- 172.21.15.134:0/2807701651 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fab0406b810 0x7fab0406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:28:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.621+0000 7fab16ffd640 1 --2- 172.21.15.134:0/2807701651 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fab0406b810 0x7fab0406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:28:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.621+0000 7faafffff640 1 -- 172.21.15.134:0/2807701651 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fab1008a7f0 con 0x7fab1813eb30 2024-02-17T14:28:35.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.621+0000 7fab16ffd640 1 --2- 172.21.15.134:0/2807701651 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fab0406b810 0x7fab0406dcd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab08035000 tx=0x7fab08030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:28:35.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.625+0000 7faafffff640 1 -- 172.21.15.134:0/2807701651 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab10054f90 con 0x7fab1813eb30 2024-02-17T14:28:35.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.834+0000 7fab1da57640 1 -- 172.21.15.134:0/2807701651 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fab18067b70 con 0x7fab1813eb30 2024-02-17T14:28:35.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.834+0000 7faafffff640 1 -- 172.21.15.134:0/2807701651 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fab10058650 con 0x7fab1813eb30 2024-02-17T14:28:35.834 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-17T14:28:35.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.836+0000 7fab1da57640 1 -- 172.21.15.134:0/2807701651 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fab0406b810 msgr2=0x7fab0406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.836+0000 7fab1da57640 1 --2- 172.21.15.134:0/2807701651 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fab0406b810 0x7fab0406dcd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab08035000 tx=0x7fab08030000 comp rx=0 tx=0).stop 2024-02-17T14:28:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.836+0000 7fab1da57640 1 -- 172.21.15.134:0/2807701651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab1813eb30 msgr2=0x7fab181e0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:28:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.836+0000 7fab1da57640 1 --2- 172.21.15.134:0/2807701651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab1813eb30 0x7fab181e0a40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fab1000d5d0 tx=0x7fab1000da90 comp rx=0 tx=0).stop 2024-02-17T14:28:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.836+0000 7fab1da57640 1 -- 172.21.15.134:0/2807701651 shutdown_connections 2024-02-17T14:28:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.836+0000 7fab1da57640 1 --2- 172.21.15.134:0/2807701651 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fab0406b810 0x7fab0406dcd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.836+0000 7fab1da57640 1 --2- 172.21.15.134:0/2807701651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab1813eb30 0x7fab181e0a40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.836+0000 7fab1da57640 1 --2- 172.21.15.134:0/2807701651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab180b1b50 0x7fab18146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.836+0000 7fab1da57640 1 --2- 172.21.15.134:0/2807701651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab1806f370 0x7fab1813a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:28:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.836+0000 7fab1da57640 1 -- 172.21.15.134:0/2807701651 >> 172.21.15.134:0/2807701651 conn(0x7fab180b8270 msgr2=0x7fab1813d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:28:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.836+0000 7fab1da57640 1 -- 172.21.15.134:0/2807701651 shutdown_connections 2024-02-17T14:28:35.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:35.836+0000 7fab1da57640 1 -- 172.21.15.134:0/2807701651 wait complete. 2024-02-17T14:28:35.846 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-17T14:28:35.846 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T14:28:35.846 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-02-17T14:28:35.846 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-17T14:28:35.846 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T14:28:35.846 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-17T14:28:35.846 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-17T14:28:35.846 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T14:28:35.847 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T14:28:35.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:35.847 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-02-17T14:28:35.862 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T14:28:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T14:28:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T14:28:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-02-17T14:28:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-02-17T14:28:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-02-17T14:28:35.862 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T14:28:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-02-17T14:28:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-02-17T14:28:35.862 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T14:28:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-02-17T14:28:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-02-17T14:28:35.863 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-17T14:28:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-02-17T14:28:35.863 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T14:28:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-02-17T14:28:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-17T14:28:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42705sec preferred_lft 42705sec 2024-02-17T14:28:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2024-02-17T14:28:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-02-17T14:28:35.863 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-17T14:28:35.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:35.863 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-17T14:28:35.863 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-17T14:28:35.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2024-02-17T14:28:35.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2024-02-17T14:28:35.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2024-02-17T14:28:35.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-17T14:28:35.864 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-17T14:28:35.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:35.971 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T14:28:35.997 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-02-17T14:28:36.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:36.000 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-02-17T14:28:36.056 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-02-17T14:28:36.057 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T14:28:36.057 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T14:28:36.057 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T14:28:36.057 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T14:28:36.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:36.058 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-17T14:28:36.058 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-17T14:28:36.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T14:28:36.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T14:28:36.059 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T14:28:36.059 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-17T14:28:36.130 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:28:36.142 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:28:36.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:36.154 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-02-17T14:28:36.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:36.243 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-02-17T14:28:36.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:36.298 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-17T14:28:36.299 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-17T14:28:36.299 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T14:28:36.299 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-17T14:28:36.299 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-17T14:28:36.380 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-17T14:28:36.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:36.381 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-17T14:28:36.381 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-17T14:28:36.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-17T14:28:36.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-17T14:28:36.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-17T14:28:36.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-17T14:28:36.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-17T14:28:36.381 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-17T14:28:36.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:36.508 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-02-17T14:28:36.508 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-02-17T14:28:36.508 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-02-17T14:28:36.508 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2024-02-17T14:28:36.508 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-02-17T14:28:36.549 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-02-17T14:28:36.549 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T14:28:36.549 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-17T14:28:36.602 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-17T14:28:36.603 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T14:28:36.603 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-17T14:28:36.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo modprobe fuse 2024-02-17T14:28:36.725 DEBUG:teuthology.orchestra.run.smithi134:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T14:28:36.781 INFO:teuthology.orchestra.run.smithi134.stdout:/proc 2024-02-17T14:28:36.781 INFO:teuthology.orchestra.run.smithi134.stdout:/sys 2024-02-17T14:28:36.781 INFO:teuthology.orchestra.run.smithi134.stdout:/dev 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/security 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/shm 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/pts 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/run 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/cgroup 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/pstore 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/bpf 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/ 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/selinux 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/debug 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/mqueue 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/hugepages 2024-02-17T14:28:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/tracing 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/fuse/connections 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/config 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/run/user/1000 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T14:28:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T14:28:36.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:36.784 DEBUG:teuthology.orchestra.run.smithi134:> ls /sys/fs/fuse/connections 2024-02-17T14:28:36.837 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-17T14:28:36.838 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-02-17T14:28:36.879 DEBUG:teuthology.orchestra.run.smithi134:> sudo modprobe fuse 2024-02-17T14:28:36.906 DEBUG:teuthology.orchestra.run.smithi134:> cat /proc/self/mounts | awk '{print $2}' 2024-02-17T14:28:36.962 INFO:teuthology.orchestra.run.smithi134.stdout:/proc 2024-02-17T14:28:36.962 INFO:teuthology.orchestra.run.smithi134.stdout:/sys 2024-02-17T14:28:36.962 INFO:teuthology.orchestra.run.smithi134.stdout:/dev 2024-02-17T14:28:36.962 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/security 2024-02-17T14:28:36.962 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/shm 2024-02-17T14:28:36.962 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/pts 2024-02-17T14:28:36.962 INFO:teuthology.orchestra.run.smithi134.stdout:/run 2024-02-17T14:28:36.962 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/cgroup 2024-02-17T14:28:36.962 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/pstore 2024-02-17T14:28:36.962 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/bpf 2024-02-17T14:28:36.962 INFO:teuthology.orchestra.run.smithi134.stdout:/ 2024-02-17T14:28:36.962 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/selinux 2024-02-17T14:28:36.962 INFO:teuthology.orchestra.run.smithi134.stdout:/proc/sys/fs/binfmt_misc 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/debug 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/mqueue 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/hugepages 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/tracing 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/fs/fuse/connections 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/sys/kernel/config 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-sysctl.service 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/nfs/rpc_pipefs 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/run/user/1000 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-0 2024-02-17T14:28:36.963 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-1 2024-02-17T14:28:36.964 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-2 2024-02-17T14:28:36.964 INFO:teuthology.orchestra.run.smithi134.stdout:/var/lib/ceph/osd/ceph-3 2024-02-17T14:28:36.964 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns 2024-02-17T14:28:36.964 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T14:28:36.964 INFO:teuthology.orchestra.run.smithi134.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T14:28:36.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:36.964 DEBUG:teuthology.orchestra.run.smithi134:> ls /sys/fs/fuse/connections 2024-02-17T14:28:36.965 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi134.stderr:2024-02-17T14:28:36.965+0000 7fad47437480 -1 init, newargv = 0x562a7f357070 newargc=15 2024-02-17T14:28:36.965 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi134.stderr:ceph-fuse[46552]: starting ceph client 2024-02-17T14:28:36.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi134.stderr:ceph-fuse[46552]: starting fuse 2024-02-17T14:28:36.979 INFO:teuthology.orchestra.run.smithi134.stdout:41 2024-02-17T14:28:36.979 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-02-17T14:28:36.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo stdin-killer -- python3 -c ' 2024-02-17T14:28:36.979 DEBUG:teuthology.orchestra.run.smithi134:> import glob 2024-02-17T14:28:36.980 DEBUG:teuthology.orchestra.run.smithi134:> import re 2024-02-17T14:28:36.980 DEBUG:teuthology.orchestra.run.smithi134:> import os 2024-02-17T14:28:36.980 DEBUG:teuthology.orchestra.run.smithi134:> import subprocess 2024-02-17T14:28:36.980 DEBUG:teuthology.orchestra.run.smithi134:> 2024-02-17T14:28:36.980 DEBUG:teuthology.orchestra.run.smithi134:> def _find_admin_socket(client_name): 2024-02-17T14:28:36.980 DEBUG:teuthology.orchestra.run.smithi134:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-17T14:28:36.980 DEBUG:teuthology.orchestra.run.smithi134:> files = glob.glob(asok_path) 2024-02-17T14:28:36.980 DEBUG:teuthology.orchestra.run.smithi134:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-17T14:28:36.980 DEBUG:teuthology.orchestra.run.smithi134:> 2024-02-17T14:28:36.981 DEBUG:teuthology.orchestra.run.smithi134:> # Given a non-glob path, it better be there 2024-02-17T14:28:36.981 DEBUG:teuthology.orchestra.run.smithi134:> if "*" not in asok_path: 2024-02-17T14:28:36.981 DEBUG:teuthology.orchestra.run.smithi134:> assert(len(files) == 1) 2024-02-17T14:28:36.981 DEBUG:teuthology.orchestra.run.smithi134:> return files[0] 2024-02-17T14:28:36.981 DEBUG:teuthology.orchestra.run.smithi134:> 2024-02-17T14:28:36.981 DEBUG:teuthology.orchestra.run.smithi134:> for f in files: 2024-02-17T14:28:36.981 DEBUG:teuthology.orchestra.run.smithi134:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-17T14:28:36.981 DEBUG:teuthology.orchestra.run.smithi134:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-17T14:28:36.981 DEBUG:teuthology.orchestra.run.smithi134:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-17T14:28:36.981 DEBUG:teuthology.orchestra.run.smithi134:> contents = proc_f.read() 2024-02-17T14:28:36.981 DEBUG:teuthology.orchestra.run.smithi134:> if mountpoint in contents: 2024-02-17T14:28:36.981 DEBUG:teuthology.orchestra.run.smithi134:> return f 2024-02-17T14:28:36.982 DEBUG:teuthology.orchestra.run.smithi134:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-17T14:28:36.982 DEBUG:teuthology.orchestra.run.smithi134:> 2024-02-17T14:28:36.982 DEBUG:teuthology.orchestra.run.smithi134:> print(_find_admin_socket("client.0")) 2024-02-17T14:28:36.982 DEBUG:teuthology.orchestra.run.smithi134:> ' 2024-02-17T14:28:37.100 INFO:teuthology.orchestra.run.smithi134.stdout:/var/run/ceph/ceph-client.0.46552.asok 2024-02-17T14:28:37.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:28:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-17T14:28:37.111 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46552.asok 2024-02-17T14:28:37.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:37.111 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46552.asok status 2024-02-17T14:28:37.250 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-17T14:28:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "metadata": { 2024-02-17T14:28:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_sha1": "6822c7b54e949006be7a0802650d01723d834d1d", 2024-02-17T14:28:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 19.0.0-1515-g6822c7b5 (6822c7b54e949006be7a0802650d01723d834d1d) squid (dev)", 2024-02-17T14:28:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "entity_id": "0", 2024-02-17T14:28:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "hostname": "smithi134", 2024-02-17T14:28:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-02-17T14:28:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "pid": "46552", 2024-02-17T14:28:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: "root": "/" 2024-02-17T14:28:37.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "dentry_count": 0, 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "dentry_pinned_count": 0, 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 4836, 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "inst": { 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "name": { 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client", 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "num": 4836 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": { 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "192.168.0.1:0", 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 250210784 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-17T14:28:37.251 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": { 2024-02-17T14:28:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-02-17T14:28:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "192.168.0.1:0", 2024-02-17T14:28:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 250210784 2024-02-17T14:28:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-02-17T14:28:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "inst_str": "client.4836 192.168.0.1:0/250210784", 2024-02-17T14:28:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "addr_str": "192.168.0.1:0/250210784", 2024-02-17T14:28:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "inode_count": 1, 2024-02-17T14:28:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_epoch": 9, 2024-02-17T14:28:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_epoch": 25, 2024-02-17T14:28:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_epoch_barrier": 0, 2024-02-17T14:28:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "blocklisted": false, 2024-02-17T14:28:37.252 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs" 2024-02-17T14:28:37.252 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-17T14:28:37.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:37.259 DEBUG:teuthology.orchestra.run.smithi134:> stat --file-system '--printf=%T 2024-02-17T14:28:37.259 DEBUG:teuthology.orchestra.run.smithi134:> ' -- /home/ubuntu/cephtest/mnt.0 2024-02-17T14:28:37.274 INFO:teuthology.orchestra.run.smithi134.stdout:fuseblk 2024-02-17T14:28:37.274 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-02-17T14:28:37.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:28:37.274 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-17T14:28:37.342 INFO:teuthology.run_tasks:Running task workunit... 2024-02-17T14:28:37.359 INFO:tasks.workunit:Pulling workunits from ref 6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T14:28:37.360 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-17T14:28:37.360 INFO:tasks.workunit:timeout=6h 2024-02-17T14:28:37.360 INFO:tasks.workunit:cleanup=True 2024-02-17T14:28:37.360 DEBUG:teuthology.orchestra.run.smithi134:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-17T14:28:37.397 INFO:teuthology.orchestra.run.smithi134.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-17T14:28:37.398 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-17T14:28:37.398 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-02-17T14:28:37.398 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T14:28:37.398 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-17T14:28:37.398 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-17T14:28:37.398 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-02-17 14:28:04.055214520 +0000 2024-02-17T14:28:37.398 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-02-17 14:28:12.642254751 +0000 2024-02-17T14:28:37.398 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-02-17T14:28:37.398 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-17T14:28:37.398 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-17T14:28:37.475 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T14:28:37.530 INFO:tasks.workunit.client.0.smithi134.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-17T14:29:06.202 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:29:06.206 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:29:33.669 INFO:tasks.workunit.client.0.smithi134.stderr:error: RPC failed; curl 92 HTTP/2 stream 0 was not closed cleanly: CANCEL (err 8) 2024-02-17T14:29:33.670 INFO:tasks.workunit.client.0.smithi134.stderr:error: 3616 bytes of body are still expected 2024-02-17T14:29:33.670 INFO:tasks.workunit.client.0.smithi134.stderr:fetch-pack: unexpected disconnect while reading sideband packet 2024-02-17T14:29:33.671 INFO:tasks.workunit.client.0.smithi134.stderr:fatal: early EOF 2024-02-17T14:29:33.672 INFO:tasks.workunit.client.0.smithi134.stderr:fatal: fetch-pack: invalid index-pack output 2024-02-17T14:29:33.680 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-02-17T14:29:33.681 INFO:tasks.workunit:failed to check out '6822c7b54e949006be7a0802650d01723d834d1d' from https://github.com/ceph/ceph-ci.git; will also try in https://github.com/ceph/ceph.git 2024-02-17T14:29:33.681 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T14:29:33.699 INFO:tasks.workunit.client.0.smithi134.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-17T14:29:36.331 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:29:36.335 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:29:54.470 INFO:tasks.workunit.client.0.smithi134.stderr:error: RPC failed; curl 92 HTTP/2 stream 0 was not closed cleanly: CANCEL (err 8) 2024-02-17T14:29:54.471 INFO:tasks.workunit.client.0.smithi134.stderr:error: 1035 bytes of body are still expected 2024-02-17T14:29:54.472 INFO:tasks.workunit.client.0.smithi134.stderr:fetch-pack: unexpected disconnect while reading sideband packet 2024-02-17T14:29:54.473 INFO:tasks.workunit.client.0.smithi134.stderr:fatal: early EOF 2024-02-17T14:29:54.474 INFO:tasks.workunit.client.0.smithi134.stderr:fatal: fetch-pack: invalid index-pack output 2024-02-17T14:29:54.489 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-02-17T14:29:54.489 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/workunit.py", line 345, in _run_tests remote.run(logger=log.getChild(role), File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi134 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6822c7b54e949006be7a0802650d01723d834d1d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/workunit.py", line 360, in _run_tests remote.run(logger=log.getChild(role), File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi134 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6822c7b54e949006be7a0802650d01723d834d1d' 2024-02-17T14:29:54.736 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=160a9747b1154fd1837e488840f961d7 Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/workunit.py", line 345, in _run_tests remote.run(logger=log.getChild(role), File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi134 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6822c7b54e949006be7a0802650d01723d834d1d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/workunit.py", line 360, in _run_tests remote.run(logger=log.getChild(role), File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi134 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6822c7b54e949006be7a0802650d01723d834d1d' 2024-02-17T14:29:54.739 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-02-17T14:29:54.748 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-02-17T14:29:54.749 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:29:54.749 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T14:29:54.781 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:29:54.781 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T14:29:54.840 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:29:54.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.989+0000 7f17ae06f640 1 Processor -- start 2024-02-17T14:29:54.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.989+0000 7f17ae06f640 1 -- start start 2024-02-17T14:29:54.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.989+0000 7f17ae06f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17a80b1640 0x7f17a813d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:54.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.989+0000 7f17ae06f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f17a80b0ba0 0x7f17a813da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:54.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.989+0000 7f17ae06f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a8073040 con 0x7f17a80b2e60 2024-02-17T14:29:54.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.989+0000 7f17ae06f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a80b3240 con 0x7f17a80b0ba0 2024-02-17T14:29:54.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.989+0000 7f17ae06f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a80b1ad0 con 0x7f17a80b1640 2024-02-17T14:29:54.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.989+0000 7f17a77fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f17a80b2e60 0x7f17a80b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52830/0 (socket says 172.21.15.134:52830) 2024-02-17T14:29:54.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.989+0000 7f17a77fe640 1 -- 172.21.15.134:0/738502918 learned_addr learned my addr 172.21.15.134:0/738502918 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:29:54.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.990+0000 7f17a7fff640 1 --2- 172.21.15.134:0/738502918 >> v2:172.21.15.142:3300/0 conn(0x7f17a80b0ba0 0x7f17a813da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:54.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.990+0000 7f179effd640 1 --2- 172.21.15.134:0/738502918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17a80b1640 0x7f17a813d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:54.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.990+0000 7f17a6ffd640 1 -- 172.21.15.134:0/738502918 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4258352852 0 0) 0x7f17a8073040 con 0x7f17a80b2e60 2024-02-17T14:29:54.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.990+0000 7f17a6ffd640 1 -- 172.21.15.134:0/738502918 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1794003520 con 0x7f17a80b2e60 2024-02-17T14:29:54.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.990+0000 7f17a7fff640 1 -- 172.21.15.134:0/738502918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17a80b1640 msgr2=0x7f17a813d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:54.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.990+0000 7f17a7fff640 1 --2- 172.21.15.134:0/738502918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17a80b1640 0x7f17a813d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:54.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.990+0000 7f17a7fff640 1 -- 172.21.15.134:0/738502918 >> v1:172.21.15.134:6789/0 conn(0x7f17a80b2e60 legacy=0x7f17a80b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:54.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.990+0000 7f17a7fff640 1 -- 172.21.15.134:0/738502918 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a8072b20 con 0x7f17a80b0ba0 2024-02-17T14:29:54.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.990+0000 7f179effd640 1 --2- 172.21.15.134:0/738502918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17a80b1640 0x7f17a813d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:29:54.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.991+0000 7f17a7fff640 1 --2- 172.21.15.134:0/738502918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a80b0ba0 0x7f17a813da10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009d90 tx=0x7f17a002bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcfc0122957112c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:54.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.991+0000 7f17a6ffd640 1 -- 172.21.15.134:0/738502918 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a002cb30 con 0x7f17a80b0ba0 2024-02-17T14:29:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.991+0000 7f17a6ffd640 1 -- 172.21.15.134:0/738502918 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a002cc90 con 0x7f17a80b0ba0 2024-02-17T14:29:54.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.991+0000 7f17a6ffd640 1 -- 172.21.15.134:0/738502918 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0034440 con 0x7f17a80b0ba0 2024-02-17T14:29:54.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.991+0000 7f17ae06f640 1 -- 172.21.15.134:0/738502918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a80b0ba0 msgr2=0x7f17a813da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:54.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.991+0000 7f17ae06f640 1 --2- 172.21.15.134:0/738502918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a80b0ba0 0x7f17a813da10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009d90 tx=0x7f17a002bd80 comp rx=0 tx=0).stop 2024-02-17T14:29:54.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.991+0000 7f17ae06f640 1 -- 172.21.15.134:0/738502918 shutdown_connections 2024-02-17T14:29:54.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.991+0000 7f17ae06f640 1 --2- 172.21.15.134:0/738502918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a80b0ba0 0x7f17a813da10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:54.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.991+0000 7f17ae06f640 1 --2- 172.21.15.134:0/738502918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17a80b1640 0x7f17a813d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:54.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.991+0000 7f17ae06f640 1 -- 172.21.15.134:0/738502918 >> 172.21.15.134:0/738502918 conn(0x7f17a80b8270 msgr2=0x7f17a80b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:55.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.991+0000 7f17ae06f640 1 -- 172.21.15.134:0/738502918 shutdown_connections 2024-02-17T14:29:55.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.992+0000 7f17ae06f640 1 -- 172.21.15.134:0/738502918 wait complete. 2024-02-17T14:29:55.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.993+0000 7f17ae06f640 1 Processor -- start 2024-02-17T14:29:55.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.993+0000 7f17ae06f640 1 -- start start 2024-02-17T14:29:55.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.993+0000 7f17ae06f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17a80b0ba0 0x7f17a80a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.993+0000 7f17ae06f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a80b2e60 0x7f17a80ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.993+0000 7f17ae06f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17a81dacb0 0x7f17a81db110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.993+0000 7f17ae06f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a81da8a0 con 0x7f17a80b0ba0 2024-02-17T14:29:55.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.993+0000 7f17ae06f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a80ab6b0 con 0x7f17a80b2e60 2024-02-17T14:29:55.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.993+0000 7f17ae06f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a81db650 con 0x7f17a81dacb0 2024-02-17T14:29:55.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.993+0000 7f17a77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17a80b0ba0 0x7f17a80a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17a77fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17a80b0ba0 0x7f17a80a96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42692/0 (socket says 172.21.15.134:42692) 2024-02-17T14:29:55.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17a77fe640 1 -- 172.21.15.134:0/1640098269 learned_addr learned my addr 172.21.15.134:0/1640098269 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:55.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f179effd640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a80b2e60 0x7f17a80ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17a7fff640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17a81dacb0 0x7f17a81db110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17a77fe640 1 -- 172.21.15.134:0/1640098269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17a81dacb0 msgr2=0x7f17a81db110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17a77fe640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17a81dacb0 0x7f17a81db110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17a77fe640 1 -- 172.21.15.134:0/1640098269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a80b2e60 msgr2=0x7f17a80ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17a77fe640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a80b2e60 0x7f17a80ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17a77fe640 1 -- 172.21.15.134:0/1640098269 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1790009400 con 0x7f17a80b0ba0 2024-02-17T14:29:55.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17a7fff640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17a81dacb0 0x7f17a81db110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:29:55.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f179effd640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a80b2e60 0x7f17a80ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:29:55.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17a77fe640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17a80b0ba0 0x7f17a80a96d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f179800c390 tx=0x7f179800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:55.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17a4ff9640 1 -- 172.21.15.134:0/1640098269 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798005ce0 con 0x7f17a80b0ba0 2024-02-17T14:29:55.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17a4ff9640 1 -- 172.21.15.134:0/1640098269 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1798005e40 con 0x7f17a80b0ba0 2024-02-17T14:29:55.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17a4ff9640 1 -- 172.21.15.134:0/1640098269 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17980072f0 con 0x7f17a80b0ba0 2024-02-17T14:29:55.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17ae06f640 1 -- 172.21.15.134:0/1640098269 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a0009a70 con 0x7f17a80b0ba0 2024-02-17T14:29:55.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.994+0000 7f17ae06f640 1 -- 172.21.15.134:0/1640098269 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a80aa6a0 con 0x7f17a80b0ba0 2024-02-17T14:29:55.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.995+0000 7f17ae06f640 1 -- 172.21.15.134:0/1640098269 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a80aa4f0 con 0x7f17a80b0ba0 2024-02-17T14:29:55.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.996+0000 7f17a4ff9640 1 -- 172.21.15.134:0/1640098269 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1798007450 con 0x7f17a80b0ba0 2024-02-17T14:29:55.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.996+0000 7f17a4ff9640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f178806b810 0x7f178806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.996+0000 7f17a4ff9640 1 -- 172.21.15.134:0/1640098269 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1798089b40 con 0x7f17a80b0ba0 2024-02-17T14:29:55.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.996+0000 7f179effd640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f178806b810 0x7f178806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:54.997+0000 7f179effd640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f178806b810 0x7f178806dcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f17a81deed0 tx=0x7f1790008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:55.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.001+0000 7f17a4ff9640 1 -- 172.21.15.134:0/1640098269 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f17980541f0 con 0x7f17a80b0ba0 2024-02-17T14:29:55.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.173+0000 7f17ae06f640 1 -- 172.21.15.134:0/1640098269 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17a8067b70 con 0x7f17a80b0ba0 2024-02-17T14:29:55.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.174+0000 7f17a4ff9640 1 -- 172.21.15.134:0/1640098269 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f1798017090 con 0x7f17a80b0ba0 2024-02-17T14:29:55.174 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:29:55.175 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":27,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:51.760520+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:29:55.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.176+0000 7f17ae06f640 1 -- 172.21.15.134:0/1640098269 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f178806b810 msgr2=0x7f178806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.176+0000 7f17ae06f640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f178806b810 0x7f178806dcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f17a81deed0 tx=0x7f1790008040 comp rx=0 tx=0).stop 2024-02-17T14:29:55.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.176+0000 7f17ae06f640 1 -- 172.21.15.134:0/1640098269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17a80b0ba0 msgr2=0x7f17a80a96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.176+0000 7f17ae06f640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17a80b0ba0 0x7f17a80a96d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f179800c390 tx=0x7f179800c850 comp rx=0 tx=0).stop 2024-02-17T14:29:55.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.176+0000 7f17ae06f640 1 -- 172.21.15.134:0/1640098269 shutdown_connections 2024-02-17T14:29:55.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.176+0000 7f17ae06f640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17a81dacb0 0x7f17a81db110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.176+0000 7f17ae06f640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a80b2e60 0x7f17a80ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.176+0000 7f17ae06f640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f178806b810 0x7f178806dcd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.176+0000 7f17ae06f640 1 --2- 172.21.15.134:0/1640098269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17a80b0ba0 0x7f17a80a96d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.176+0000 7f17ae06f640 1 -- 172.21.15.134:0/1640098269 >> 172.21.15.134:0/1640098269 conn(0x7f17a80b8270 msgr2=0x7f17a8143ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:55.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.176+0000 7f17ae06f640 1 -- 172.21.15.134:0/1640098269 shutdown_connections 2024-02-17T14:29:55.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.176+0000 7f17ae06f640 1 -- 172.21.15.134:0/1640098269 wait complete. 2024-02-17T14:29:55.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T14:27:58.602268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T14:28:01.178917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T14:28:02.371936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T14:28:05.647194+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T14:29:55.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T14:29:55.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.292+0000 7fee76902640 1 Processor -- start 2024-02-17T14:29:55.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.292+0000 7fee76902640 1 -- start start 2024-02-17T14:29:55.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.292+0000 7fee76902640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fee700b5020 0x7fee70146f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.292+0000 7fee76902640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fee70147480 0x7fee70071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.292+0000 7fee76902640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee70071e40 0x7fee7006cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.292+0000 7fee76902640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee700714b0 con 0x7fee700b5020 2024-02-17T14:29:55.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.292+0000 7fee76902640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee700722d0 con 0x7fee70147480 2024-02-17T14:29:55.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.292+0000 7fee76902640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee700b5400 con 0x7fee70071e40 2024-02-17T14:29:55.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.293+0000 7fee6ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fee700b5020 0x7fee70146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.293+0000 7fee6ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fee700b5020 0x7fee70146f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42698/0 (socket says 172.21.15.134:42698) 2024-02-17T14:29:55.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.293+0000 7fee6ffff640 1 -- 172.21.15.134:0/3227639711 learned_addr learned my addr 172.21.15.134:0/3227639711 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:55.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.293+0000 7fee74e9f640 1 --2- 172.21.15.134:0/3227639711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee70071e40 0x7fee7006cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.293+0000 7fee6f7fe640 1 --2- 172.21.15.134:0/3227639711 >> v2:172.21.15.142:3300/0 conn(0x7fee70147480 0x7fee70071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.293+0000 7fee6ffff640 1 -- 172.21.15.134:0/3227639711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee70071e40 msgr2=0x7fee7006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:55.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.293+0000 7fee6ffff640 1 --2- 172.21.15.134:0/3227639711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee70071e40 0x7fee7006cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.293+0000 7fee6ffff640 1 -- 172.21.15.134:0/3227639711 >> v2:172.21.15.142:3300/0 conn(0x7fee70147480 msgr2=0x7fee70071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:55.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.293+0000 7fee6ffff640 1 --2- 172.21.15.134:0/3227639711 >> v2:172.21.15.142:3300/0 conn(0x7fee70147480 0x7fee70071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.293+0000 7fee6ffff640 1 -- 172.21.15.134:0/3227639711 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70147a10 con 0x7fee700b5020 2024-02-17T14:29:55.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.294+0000 7fee6ffff640 1 --2- 172.21.15.134:0/3227639711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee700b5020 0x7fee70146f40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fee700732d0 tx=0x7fee6002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2bca04f90950f1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:55.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.294+0000 7fee6effd640 1 -- 172.21.15.134:0/3227639711 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600317e0 con 0x7fee700b5020 2024-02-17T14:29:55.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.294+0000 7fee6effd640 1 -- 172.21.15.134:0/3227639711 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee60031940 con 0x7fee700b5020 2024-02-17T14:29:55.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.294+0000 7fee6effd640 1 -- 172.21.15.134:0/3227639711 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60031cd0 con 0x7fee700b5020 2024-02-17T14:29:55.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.294+0000 7fee76902640 1 -- 172.21.15.134:0/3227639711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee700b5020 msgr2=0x7fee70146f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.294+0000 7fee76902640 1 --2- 172.21.15.134:0/3227639711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee700b5020 0x7fee70146f40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fee700732d0 tx=0x7fee6002b880 comp rx=0 tx=0).stop 2024-02-17T14:29:55.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.294+0000 7fee76902640 1 -- 172.21.15.134:0/3227639711 shutdown_connections 2024-02-17T14:29:55.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.294+0000 7fee76902640 1 --2- 172.21.15.134:0/3227639711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee70071e40 0x7fee7006cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.295+0000 7fee76902640 1 --2- 172.21.15.134:0/3227639711 >> v2:172.21.15.142:3300/0 conn(0x7fee70147480 0x7fee70071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.295+0000 7fee76902640 1 --2- 172.21.15.134:0/3227639711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee700b5020 0x7fee70146f40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.295+0000 7fee76902640 1 -- 172.21.15.134:0/3227639711 >> 172.21.15.134:0/3227639711 conn(0x7fee700ba430 msgr2=0x7fee700ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:55.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.295+0000 7fee76902640 1 -- 172.21.15.134:0/3227639711 shutdown_connections 2024-02-17T14:29:55.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.295+0000 7fee76902640 1 -- 172.21.15.134:0/3227639711 wait complete. 2024-02-17T14:29:55.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.296+0000 7fee76902640 1 Processor -- start 2024-02-17T14:29:55.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.296+0000 7fee76902640 1 -- start start 2024-02-17T14:29:55.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.296+0000 7fee76902640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70071e40 0x7fee700b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.296+0000 7fee76902640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee700b5020 0x7fee700b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.296+0000 7fee76902640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee70147480 0x7fee701dc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.296+0000 7fee76902640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700b3a80 con 0x7fee700b5020 2024-02-17T14:29:55.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.296+0000 7fee76902640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700b3f10 con 0x7fee70071e40 2024-02-17T14:29:55.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.296+0000 7fee76902640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee700b3510 con 0x7fee70147480 2024-02-17T14:29:55.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.296+0000 7fee6f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee700b5020 0x7fee700b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.296+0000 7fee6f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee700b5020 0x7fee700b4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42714/0 (socket says 172.21.15.134:42714) 2024-02-17T14:29:55.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.296+0000 7fee6f7fe640 1 -- 172.21.15.134:0/1583162845 learned_addr learned my addr 172.21.15.134:0/1583162845 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee6ffff640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70071e40 0x7fee700b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee74e9f640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee70147480 0x7fee701dc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee6f7fe640 1 -- 172.21.15.134:0/1583162845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee70147480 msgr2=0x7fee701dc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee6f7fe640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee70147480 0x7fee701dc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee6f7fe640 1 -- 172.21.15.134:0/1583162845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70071e40 msgr2=0x7fee700b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee6f7fe640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70071e40 0x7fee700b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee6f7fe640 1 -- 172.21.15.134:0/1583162845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee600094d0 con 0x7fee700b5020 2024-02-17T14:29:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee6ffff640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70071e40 0x7fee700b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:29:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee74e9f640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee70147480 0x7fee701dc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:29:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee6f7fe640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee700b5020 0x7fee700b4280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fee6400d5f0 tx=0x7fee6400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee6cff9640 1 -- 172.21.15.134:0/1583162845 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee640125f0 con 0x7fee700b5020 2024-02-17T14:29:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee6cff9640 1 -- 172.21.15.134:0/1583162845 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee64012750 con 0x7fee700b5020 2024-02-17T14:29:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee76902640 1 -- 172.21.15.134:0/1583162845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee70141bf0 con 0x7fee700b5020 2024-02-17T14:29:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee6cff9640 1 -- 172.21.15.134:0/1583162845 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee64012b00 con 0x7fee700b5020 2024-02-17T14:29:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.297+0000 7fee76902640 1 -- 172.21.15.134:0/1583162845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee700b47c0 con 0x7fee700b5020 2024-02-17T14:29:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.298+0000 7fee76902640 1 -- 172.21.15.134:0/1583162845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee700b4a80 con 0x7fee700b5020 2024-02-17T14:29:55.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.298+0000 7fee6cff9640 1 -- 172.21.15.134:0/1583162845 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fee64012c60 con 0x7fee700b5020 2024-02-17T14:29:55.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.299+0000 7fee6cff9640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fee5c06b810 0x7fee5c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.299+0000 7fee6cff9640 1 -- 172.21.15.134:0/1583162845 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fee6408a9d0 con 0x7fee700b5020 2024-02-17T14:29:55.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.299+0000 7fee6ffff640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fee5c06b810 0x7fee5c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.299+0000 7fee6ffff640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fee5c06b810 0x7fee5c06dcd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fee60036000 tx=0x7fee6003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:55.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.303+0000 7fee6cff9640 1 -- 172.21.15.134:0/1583162845 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fee64055080 con 0x7fee700b5020 2024-02-17T14:29:55.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.474+0000 7fee76902640 1 -- 172.21.15.134:0/1583162845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee7006dca0 con 0x7fee700b5020 2024-02-17T14:29:55.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.475+0000 7fee6cff9640 1 -- 172.21.15.134:0/1583162845 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee64058740 con 0x7fee700b5020 2024-02-17T14:29:55.475 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-02-17T14:29:55.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.477+0000 7fee76902640 1 -- 172.21.15.134:0/1583162845 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fee5c06b810 msgr2=0x7fee5c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.477+0000 7fee76902640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fee5c06b810 0x7fee5c06dcd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fee60036000 tx=0x7fee6003d040 comp rx=0 tx=0).stop 2024-02-17T14:29:55.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.477+0000 7fee76902640 1 -- 172.21.15.134:0/1583162845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee700b5020 msgr2=0x7fee700b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.477+0000 7fee76902640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee700b5020 0x7fee700b4280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fee6400d5f0 tx=0x7fee6400dab0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.477+0000 7fee76902640 1 -- 172.21.15.134:0/1583162845 shutdown_connections 2024-02-17T14:29:55.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.477+0000 7fee76902640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee70147480 0x7fee701dc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.477+0000 7fee76902640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fee5c06b810 0x7fee5c06dcd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.477+0000 7fee76902640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee700b5020 0x7fee700b4280 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.477+0000 7fee76902640 1 --2- 172.21.15.134:0/1583162845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70071e40 0x7fee700b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.477+0000 7fee76902640 1 -- 172.21.15.134:0/1583162845 >> 172.21.15.134:0/1583162845 conn(0x7fee700ba430 msgr2=0x7fee700b8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:55.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.477+0000 7fee76902640 1 -- 172.21.15.134:0/1583162845 shutdown_connections 2024-02-17T14:29:55.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.477+0000 7fee76902640 1 -- 172.21.15.134:0/1583162845 wait complete. 2024-02-17T14:29:55.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T14:29:55.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.591+0000 7fcae453a640 1 Processor -- start 2024-02-17T14:29:55.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.591+0000 7fcae453a640 1 -- start start 2024-02-17T14:29:55.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.592+0000 7fcae453a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcadc144960 0x7fcadc0b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.592+0000 7fcae453a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcadc09b190 0x7fcadc1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.592+0000 7fcae453a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc14aaf0 con 0x7fcadc14a710 2024-02-17T14:29:55.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.592+0000 7fcae453a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc09c280 con 0x7fcadc144960 2024-02-17T14:29:55.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.592+0000 7fcae453a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc09b5c0 con 0x7fcadc09b190 2024-02-17T14:29:55.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.592+0000 7fcae22d6640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fcadc14a710 0x7fcadc144250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52842/0 (socket says 172.21.15.134:52842) 2024-02-17T14:29:55.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.592+0000 7fcae22d6640 1 -- 172.21.15.134:0/3231509575 learned_addr learned my addr 172.21.15.134:0/3231509575 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:29:55.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.592+0000 7fcae1ad5640 1 --2- 172.21.15.134:0/3231509575 >> v2:172.21.15.134:3300/0 conn(0x7fcadc144960 0x7fcadc0b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.592+0000 7fcae12d4640 1 -- 172.21.15.134:0/3231509575 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677755964 0 0) 0x7fcadc14aaf0 con 0x7fcadc14a710 2024-02-17T14:29:55.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.593+0000 7fcae2ad7640 1 --2- 172.21.15.134:0/3231509575 >> v2:172.21.15.142:3300/0 conn(0x7fcadc09b190 0x7fcadc1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.593+0000 7fcae12d4640 1 -- 172.21.15.134:0/3231509575 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac8003520 con 0x7fcadc14a710 2024-02-17T14:29:55.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.593+0000 7fcae1ad5640 1 -- 172.21.15.134:0/3231509575 >> v2:172.21.15.142:3300/0 conn(0x7fcadc09b190 msgr2=0x7fcadc1517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:55.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.593+0000 7fcae1ad5640 1 --2- 172.21.15.134:0/3231509575 >> v2:172.21.15.142:3300/0 conn(0x7fcadc09b190 0x7fcadc1517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.593+0000 7fcae1ad5640 1 -- 172.21.15.134:0/3231509575 >> v1:172.21.15.134:6789/0 conn(0x7fcadc14a710 legacy=0x7fcadc144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.593+0000 7fcae1ad5640 1 -- 172.21.15.134:0/3231509575 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc09c4f0 con 0x7fcadc144960 2024-02-17T14:29:55.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.593+0000 7fcae1ad5640 1 --2- 172.21.15.134:0/3231509575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcadc144960 0x7fcadc0b6fc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0b00a0 tx=0x7fcacc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26de7c3195dde5fa server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:55.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.593+0000 7fcae12d4640 1 -- 172.21.15.134:0/3231509575 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc02e070 con 0x7fcadc144960 2024-02-17T14:29:55.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.593+0000 7fcae12d4640 1 -- 172.21.15.134:0/3231509575 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc0315a0 con 0x7fcadc144960 2024-02-17T14:29:55.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.593+0000 7fcae12d4640 1 -- 172.21.15.134:0/3231509575 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc031910 con 0x7fcadc144960 2024-02-17T14:29:55.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.594+0000 7fcae453a640 1 -- 172.21.15.134:0/3231509575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcadc144960 msgr2=0x7fcadc0b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.594+0000 7fcae453a640 1 --2- 172.21.15.134:0/3231509575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcadc144960 0x7fcadc0b6fc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0b00a0 tx=0x7fcacc02b840 comp rx=0 tx=0).stop 2024-02-17T14:29:55.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.594+0000 7fcae453a640 1 -- 172.21.15.134:0/3231509575 shutdown_connections 2024-02-17T14:29:55.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.594+0000 7fcae453a640 1 --2- 172.21.15.134:0/3231509575 >> v2:172.21.15.142:3300/0 conn(0x7fcadc09b190 0x7fcadc1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.594+0000 7fcae453a640 1 --2- 172.21.15.134:0/3231509575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcadc144960 0x7fcadc0b6fc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.594+0000 7fcae453a640 1 -- 172.21.15.134:0/3231509575 >> 172.21.15.134:0/3231509575 conn(0x7fcadc0b90c0 msgr2=0x7fcadc0b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:55.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.594+0000 7fcae453a640 1 -- 172.21.15.134:0/3231509575 shutdown_connections 2024-02-17T14:29:55.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.594+0000 7fcae453a640 1 -- 172.21.15.134:0/3231509575 wait complete. 2024-02-17T14:29:55.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.595+0000 7fcae453a640 1 Processor -- start 2024-02-17T14:29:55.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.595+0000 7fcae453a640 1 -- start start 2024-02-17T14:29:55.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae453a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcadc09b190 0x7fcadc0b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae453a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcadc144960 0x7fcadc1e02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae453a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcadc14a710 0x7fcadc1407f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae453a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0b59d0 con 0x7fcadc14a710 2024-02-17T14:29:55.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae453a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc1dfb20 con 0x7fcadc144960 2024-02-17T14:29:55.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae453a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0b12f0 con 0x7fcadc09b190 2024-02-17T14:29:55.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae2ad7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcadc14a710 0x7fcadc1407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae2ad7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcadc14a710 0x7fcadc1407f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42728/0 (socket says 172.21.15.134:42728) 2024-02-17T14:29:55.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae2ad7640 1 -- 172.21.15.134:0/741786701 learned_addr learned my addr 172.21.15.134:0/741786701 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:55.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae1ad5640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcadc144960 0x7fcadc1e02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae22d6640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcadc09b190 0x7fcadc0b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae2ad7640 1 -- 172.21.15.134:0/741786701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcadc09b190 msgr2=0x7fcadc0b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae2ad7640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcadc09b190 0x7fcadc0b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae2ad7640 1 -- 172.21.15.134:0/741786701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcadc144960 msgr2=0x7fcadc1e02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae2ad7640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcadc144960 0x7fcadc1e02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae2ad7640 1 -- 172.21.15.134:0/741786701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc009400 con 0x7fcadc14a710 2024-02-17T14:29:55.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae2ad7640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcadc14a710 0x7fcadc1407f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcad4007e40 tx=0x7fcad400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:55.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcad2ffd640 1 -- 172.21.15.134:0/741786701 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4014620 con 0x7fcadc14a710 2024-02-17T14:29:55.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcad2ffd640 1 -- 172.21.15.134:0/741786701 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad400ee90 con 0x7fcadc14a710 2024-02-17T14:29:55.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae453a640 1 -- 172.21.15.134:0/741786701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcadc0b2d00 con 0x7fcadc14a710 2024-02-17T14:29:55.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcad2ffd640 1 -- 172.21.15.134:0/741786701 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad40149e0 con 0x7fcadc14a710 2024-02-17T14:29:55.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.596+0000 7fcae453a640 1 -- 172.21.15.134:0/741786701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc1dfda0 con 0x7fcadc14a710 2024-02-17T14:29:55.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.597+0000 7fcae453a640 1 -- 172.21.15.134:0/741786701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcadc067b70 con 0x7fcadc14a710 2024-02-17T14:29:55.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.598+0000 7fcad2ffd640 1 -- 172.21.15.134:0/741786701 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcad4014b40 con 0x7fcadc14a710 2024-02-17T14:29:55.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.598+0000 7fcad2ffd640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fcac006b810 0x7fcac006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.598+0000 7fcad2ffd640 1 -- 172.21.15.134:0/741786701 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fcad408ad50 con 0x7fcadc14a710 2024-02-17T14:29:55.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.598+0000 7fcae22d6640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fcac006b810 0x7fcac006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.599+0000 7fcae22d6640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fcac006b810 0x7fcac006dcd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcad8005880 tx=0x7fcad8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:55.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.603+0000 7fcad2ffd640 1 -- 172.21.15.134:0/741786701 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcad408e030 con 0x7fcadc14a710 2024-02-17T14:29:55.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.777+0000 7fcae453a640 1 -- 172.21.15.134:0/741786701 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcadc09a6e0 con 0x7fcadc14a710 2024-02-17T14:29:55.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.777+0000 7fcad2ffd640 1 -- 172.21.15.134:0/741786701 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcad40554b0 con 0x7fcadc14a710 2024-02-17T14:29:55.778 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-17T14:29:55.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.779+0000 7fcae453a640 1 -- 172.21.15.134:0/741786701 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fcac006b810 msgr2=0x7fcac006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.779+0000 7fcae453a640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fcac006b810 0x7fcac006dcd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcad8005880 tx=0x7fcad8009040 comp rx=0 tx=0).stop 2024-02-17T14:29:55.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.779+0000 7fcae453a640 1 -- 172.21.15.134:0/741786701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcadc14a710 msgr2=0x7fcadc1407f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.779+0000 7fcae453a640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcadc14a710 0x7fcadc1407f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcad4007e40 tx=0x7fcad400e4b0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.779+0000 7fcae453a640 1 -- 172.21.15.134:0/741786701 shutdown_connections 2024-02-17T14:29:55.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.779+0000 7fcae453a640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fcac006b810 0x7fcac006dcd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.779+0000 7fcae453a640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcadc14a710 0x7fcadc1407f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.779+0000 7fcae453a640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcadc144960 0x7fcadc1e02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.779+0000 7fcae453a640 1 --2- 172.21.15.134:0/741786701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcadc09b190 0x7fcadc0b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.779+0000 7fcae453a640 1 -- 172.21.15.134:0/741786701 >> 172.21.15.134:0/741786701 conn(0x7fcadc0b90c0 msgr2=0x7fcadc141ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:55.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.779+0000 7fcae453a640 1 -- 172.21.15.134:0/741786701 shutdown_connections 2024-02-17T14:29:55.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.779+0000 7fcae453a640 1 -- 172.21.15.134:0/741786701 wait complete. 2024-02-17T14:29:55.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T14:29:55.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.894+0000 7f4cdea42640 1 Processor -- start 2024-02-17T14:29:55.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.894+0000 7f4cdea42640 1 -- start start 2024-02-17T14:29:55.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.895+0000 7f4cdea42640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cd80b0600 0x7f4cd80b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.895+0000 7f4cdea42640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd80714b0 con 0x7f4cd8071940 2024-02-17T14:29:55.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.895+0000 7f4cdea42640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd80b0ff0 con 0x7f4cd80b5020 2024-02-17T14:29:55.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.895+0000 7f4cdea42640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd80b5eb0 con 0x7f4cd80b0600 2024-02-17T14:29:55.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.895+0000 7f4cd77fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4cd8071940 0x7f4cd8071da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52858/0 (socket says 172.21.15.134:52858) 2024-02-17T14:29:55.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.895+0000 7f4cd77fe640 1 -- 172.21.15.134:0/1566731932 learned_addr learned my addr 172.21.15.134:0/1566731932 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:29:55.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.895+0000 7f4cdcfdf640 1 --2- 172.21.15.134:0/1566731932 >> v2:172.21.15.142:3300/0 conn(0x7f4cd80b0600 0x7f4cd80b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.895+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355241672 0 0) 0x7f4cd80714b0 con 0x7f4cd8071940 2024-02-17T14:29:55.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.895+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc0003520 con 0x7f4cd8071940 2024-02-17T14:29:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.895+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2556568222 0 0) 0x7f4cc0003520 con 0x7f4cd8071940 2024-02-17T14:29:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.895+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 >> v2:172.21.15.142:3300/0 conn(0x7f4cd80b0600 msgr2=0x7f4cd80b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.895+0000 7f4cd6ffd640 1 --2- 172.21.15.134:0/1566731932 >> v2:172.21.15.142:3300/0 conn(0x7f4cd80b0600 0x7f4cd80b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 >> v1:172.21.15.142:6789/0 conn(0x7f4cd80b5020 legacy=0x7f4cd8144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd80b5400 con 0x7f4cd8071940 2024-02-17T14:29:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f4cc8001670 con 0x7f4cd8071940 2024-02-17T14:29:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cdcfdf640 1 --2- 172.21.15.134:0/1566731932 >> v2:172.21.15.142:3300/0 conn(0x7f4cd80b0600 0x7f4cd80b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:29:55.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 >> v1:172.21.15.134:6789/0 conn(0x7f4cd8071940 legacy=0x7f4cd8071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd6ffd640 1 --2- 172.21.15.134:0/1566731932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cc0003970 0x7f4cc0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd6ffd640 1 --2- 172.21.15.134:0/1566731932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cc00047c0 0x7f4cc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd6ffd640 1 --2- 172.21.15.134:0/1566731932 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cc00052a0 0x7f4cc000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd80b5eb0 con 0x7f4cc00047c0 2024-02-17T14:29:55.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc000c170 con 0x7f4cc0003970 2024-02-17T14:29:55.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc000c330 con 0x7f4cc00052a0 2024-02-17T14:29:55.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd77fe640 1 --2- 172.21.15.134:0/1566731932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cc00047c0 0x7f4cc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd7fff640 1 --2- 172.21.15.134:0/1566731932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cc0003970 0x7f4cc0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cdcfdf640 1 --2- 172.21.15.134:0/1566731932 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cc00052a0 0x7f4cc000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd77fe640 1 -- 172.21.15.134:0/1566731932 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cc00052a0 msgr2=0x7f4cc000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:55.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd77fe640 1 --2- 172.21.15.134:0/1566731932 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cc00052a0 0x7f4cc000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd77fe640 1 -- 172.21.15.134:0/1566731932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cc0003970 msgr2=0x7f4cc0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:55.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd77fe640 1 --2- 172.21.15.134:0/1566731932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cc0003970 0x7f4cc0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cd77fe640 1 -- 172.21.15.134:0/1566731932 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc0003520 con 0x7f4cc00047c0 2024-02-17T14:29:55.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.896+0000 7f4cdcfdf640 1 -- 172.21.15.134:0/1566731932 reap_dead start 2024-02-17T14:29:55.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.897+0000 7f4cd77fe640 1 --2- 172.21.15.134:0/1566731932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cc00047c0 0x7f4cc0004c40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80724b0 tx=0x7f4cc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ddd49501eb7e5a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:55.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.897+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc8005ad0 con 0x7f4cc00047c0 2024-02-17T14:29:55.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.897+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc8005c30 con 0x7f4cc00047c0 2024-02-17T14:29:55.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.897+0000 7f4cd6ffd640 1 -- 172.21.15.134:0/1566731932 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc802ca00 con 0x7f4cc00047c0 2024-02-17T14:29:55.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.897+0000 7f4cdea42640 1 -- 172.21.15.134:0/1566731932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cc00047c0 msgr2=0x7f4cc0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.897+0000 7f4cdea42640 1 --2- 172.21.15.134:0/1566731932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cc00047c0 0x7f4cc0004c40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80724b0 tx=0x7f4cc00057f0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.897+0000 7f4cdea42640 1 -- 172.21.15.134:0/1566731932 shutdown_connections 2024-02-17T14:29:55.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.897+0000 7f4cdea42640 1 --2- 172.21.15.134:0/1566731932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cc00047c0 0x7f4cc0004c40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.897+0000 7f4cdea42640 1 -- 172.21.15.134:0/1566731932 >> 172.21.15.134:0/1566731932 conn(0x7f4cd80ba430 msgr2=0x7f4cd80ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:55.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.898+0000 7f4cdea42640 1 -- 172.21.15.134:0/1566731932 shutdown_connections 2024-02-17T14:29:55.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.898+0000 7f4cdea42640 1 -- 172.21.15.134:0/1566731932 wait complete. 2024-02-17T14:29:55.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.898+0000 7f4cdea42640 1 Processor -- start 2024-02-17T14:29:55.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.899+0000 7f4cdea42640 1 -- start start 2024-02-17T14:29:55.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.899+0000 7f4cdea42640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cc00047c0 0x7f4cd80b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.899+0000 7f4cdea42640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd8148b60 0x7f4cd81d9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.899+0000 7f4cdea42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cd80b41f0 0x7f4cd8146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.899+0000 7f4cdea42640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd80b1be0 con 0x7f4cd80b41f0 2024-02-17T14:29:55.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.899+0000 7f4cdea42640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd80b31c0 con 0x7f4cc00047c0 2024-02-17T14:29:55.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.899+0000 7f4cdea42640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd8142780 con 0x7f4cd8148b60 2024-02-17T14:29:55.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.899+0000 7f4cdcfdf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cd80b41f0 0x7f4cd8146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.899+0000 7f4cdcfdf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cd80b41f0 0x7f4cd8146da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42752/0 (socket says 172.21.15.134:42752) 2024-02-17T14:29:55.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.899+0000 7f4cdcfdf640 1 -- 172.21.15.134:0/3733346546 learned_addr learned my addr 172.21.15.134:0/3733346546 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:55.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.899+0000 7f4cd77fe640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd8148b60 0x7f4cd81d9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.899+0000 7f4cd7fff640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cc00047c0 0x7f4cd80b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.900+0000 7f4cdcfdf640 1 -- 172.21.15.134:0/3733346546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd8148b60 msgr2=0x7f4cd81d9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.900+0000 7f4cdcfdf640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd8148b60 0x7f4cd81d9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.900+0000 7f4cdcfdf640 1 -- 172.21.15.134:0/3733346546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cc00047c0 msgr2=0x7f4cd80b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:55.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.900+0000 7f4cdcfdf640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cc00047c0 0x7f4cd80b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:55.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.900+0000 7f4cdcfdf640 1 -- 172.21.15.134:0/3733346546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd8148360 con 0x7f4cd80b41f0 2024-02-17T14:29:55.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.900+0000 7f4cdcfdf640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cd80b41f0 0x7f4cd8146da0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8149260 tx=0x7f4cd000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:55.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.900+0000 7f4cd4ff9640 1 -- 172.21.15.134:0/3733346546 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd001c070 con 0x7f4cd80b41f0 2024-02-17T14:29:55.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.900+0000 7f4cd4ff9640 1 -- 172.21.15.134:0/3733346546 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd000f040 con 0x7f4cd80b41f0 2024-02-17T14:29:55.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.900+0000 7f4cdea42640 1 -- 172.21.15.134:0/3733346546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd80b1900 con 0x7f4cd80b41f0 2024-02-17T14:29:55.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.900+0000 7f4cd4ff9640 1 -- 172.21.15.134:0/3733346546 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd000e040 con 0x7f4cd80b41f0 2024-02-17T14:29:55.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.900+0000 7f4cdea42640 1 -- 172.21.15.134:0/3733346546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd80b3430 con 0x7f4cd80b41f0 2024-02-17T14:29:55.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.901+0000 7f4cdea42640 1 -- 172.21.15.134:0/3733346546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd80b3f10 con 0x7f4cd80b41f0 2024-02-17T14:29:55.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.902+0000 7f4cd4ff9640 1 -- 172.21.15.134:0/3733346546 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4cd0015430 con 0x7f4cd80b41f0 2024-02-17T14:29:55.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.902+0000 7f4cd4ff9640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4cc406b840 0x7f4cc406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:55.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.902+0000 7f4cd4ff9640 1 -- 172.21.15.134:0/3733346546 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4cd008a4d0 con 0x7f4cd80b41f0 2024-02-17T14:29:55.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.902+0000 7f4cd7fff640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4cc406b840 0x7f4cc406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:55.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.902+0000 7f4cd7fff640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4cc406b840 0x7f4cc406dd00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc000c00 tx=0x7f4ccc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:55.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:55.906+0000 7f4cd4ff9640 1 -- 172.21.15.134:0/3733346546 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4cd80b3f10 con 0x7f4cd80b41f0 2024-02-17T14:29:56.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.077+0000 7f4cdea42640 1 -- 172.21.15.134:0/3733346546 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4cd80b3f10 con 0x7f4cd80b41f0 2024-02-17T14:29:56.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.077+0000 7f4cd4ff9640 1 -- 172.21.15.134:0/3733346546 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4cd80b3f10 con 0x7f4cd80b41f0 2024-02-17T14:29:56.078 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 64 2024-02-17T14:29:56.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.080+0000 7f4cdea42640 1 -- 172.21.15.134:0/3733346546 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4cc406b840 msgr2=0x7f4cc406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.080+0000 7f4cdea42640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4cc406b840 0x7f4cc406dd00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc000c00 tx=0x7f4ccc009040 comp rx=0 tx=0).stop 2024-02-17T14:29:56.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.080+0000 7f4cdea42640 1 -- 172.21.15.134:0/3733346546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cd80b41f0 msgr2=0x7f4cd8146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.080+0000 7f4cdea42640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cd80b41f0 0x7f4cd8146da0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8149260 tx=0x7f4cd000f580 comp rx=0 tx=0).stop 2024-02-17T14:29:56.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.080+0000 7f4cdea42640 1 -- 172.21.15.134:0/3733346546 shutdown_connections 2024-02-17T14:29:56.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.080+0000 7f4cdea42640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f4cc406b840 0x7f4cc406dd00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.080+0000 7f4cdea42640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cd80b41f0 0x7f4cd8146da0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.080+0000 7f4cdea42640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd8148b60 0x7f4cd81d9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.080+0000 7f4cdea42640 1 --2- 172.21.15.134:0/3733346546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cc00047c0 0x7f4cd80b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.080+0000 7f4cdea42640 1 -- 172.21.15.134:0/3733346546 >> 172.21.15.134:0/3733346546 conn(0x7f4cd80ba430 msgr2=0x7f4cd80b6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:56.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.080+0000 7f4cdea42640 1 -- 172.21.15.134:0/3733346546 shutdown_connections 2024-02-17T14:29:56.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.080+0000 7f4cdea42640 1 -- 172.21.15.134:0/3733346546 wait complete. 2024-02-17T14:29:56.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T14:29:56.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.194+0000 7f29e3a64640 1 Processor -- start 2024-02-17T14:29:56.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.195+0000 7f29e3a64640 1 -- start start 2024-02-17T14:29:56.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.195+0000 7f29e3a64640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f29dc09bd10 0x7f29dc06e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.195+0000 7f29e3a64640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29dc06d610 0x7f29dc0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.195+0000 7f29e3a64640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc06e270 con 0x7f29dc0b5610 2024-02-17T14:29:56.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.195+0000 7f29e3a64640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc0b6190 con 0x7f29dc09bd10 2024-02-17T14:29:56.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.195+0000 7f29e3a64640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc06de70 con 0x7f29dc06d610 2024-02-17T14:29:56.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.195+0000 7f29e0fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f29dc09bd10 0x7f29dc06e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.195+0000 7f29e1800640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f29dc0b5610 0x7f29dc06cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52866/0 (socket says 172.21.15.134:52866) 2024-02-17T14:29:56.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.195+0000 7f29e1800640 1 -- 172.21.15.134:0/2199388685 learned_addr learned my addr 172.21.15.134:0/2199388685 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:29:56.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.196+0000 7f29e2001640 1 --2- 172.21.15.134:0/2199388685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29dc06d610 0x7f29dc0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.196+0000 7f29e0fff640 1 -- 172.21.15.134:0/2199388685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29dc06d610 msgr2=0x7f29dc0b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:56.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.196+0000 7f29e0fff640 1 --2- 172.21.15.134:0/2199388685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29dc06d610 0x7f29dc0b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.196+0000 7f29e0fff640 1 -- 172.21.15.134:0/2199388685 >> v1:172.21.15.134:6789/0 conn(0x7f29dc0b5610 legacy=0x7f29dc06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.196+0000 7f29e0fff640 1 -- 172.21.15.134:0/2199388685 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc06f350 con 0x7f29dc09bd10 2024-02-17T14:29:56.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.196+0000 7f29cffff640 1 -- 172.21.15.134:0/2199388685 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662525262 0 0) 0x7f29dc06e270 con 0x7f29dc0b5610 2024-02-17T14:29:56.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.196+0000 7f29e0fff640 1 --2- 172.21.15.134:0/2199388685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29dc09bd10 0x7f29dc06e700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f29d00097a0 tx=0x7f29d002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb083fa0891d39e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:56.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.197+0000 7f29cffff640 1 -- 172.21.15.134:0/2199388685 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d002f050 con 0x7f29dc09bd10 2024-02-17T14:29:56.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.197+0000 7f29cffff640 1 -- 172.21.15.134:0/2199388685 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d0031700 con 0x7f29dc09bd10 2024-02-17T14:29:56.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.197+0000 7f29cffff640 1 -- 172.21.15.134:0/2199388685 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0031a90 con 0x7f29dc09bd10 2024-02-17T14:29:56.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.197+0000 7f29e3a64640 1 -- 172.21.15.134:0/2199388685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29dc09bd10 msgr2=0x7f29dc06e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.197+0000 7f29e3a64640 1 --2- 172.21.15.134:0/2199388685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29dc09bd10 0x7f29dc06e700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f29d00097a0 tx=0x7f29d002b7a0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.197+0000 7f29e3a64640 1 -- 172.21.15.134:0/2199388685 shutdown_connections 2024-02-17T14:29:56.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.197+0000 7f29e3a64640 1 --2- 172.21.15.134:0/2199388685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29dc06d610 0x7f29dc0b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.197+0000 7f29e3a64640 1 --2- 172.21.15.134:0/2199388685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29dc09bd10 0x7f29dc06e700 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.197+0000 7f29e3a64640 1 -- 172.21.15.134:0/2199388685 >> 172.21.15.134:0/2199388685 conn(0x7f29dc0ba430 msgr2=0x7f29dc0ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:56.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.197+0000 7f29e3a64640 1 -- 172.21.15.134:0/2199388685 shutdown_connections 2024-02-17T14:29:56.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.197+0000 7f29e3a64640 1 -- 172.21.15.134:0/2199388685 wait complete. 2024-02-17T14:29:56.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.198+0000 7f29e3a64640 1 Processor -- start 2024-02-17T14:29:56.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.198+0000 7f29e3a64640 1 -- start start 2024-02-17T14:29:56.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e3a64640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29dc06d610 0x7f29dc09fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e3a64640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29dc09bd10 0x7f29dc0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e3a64640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29dc0b5610 0x7f29dc0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e3a64640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0a0590 con 0x7f29dc09bd10 2024-02-17T14:29:56.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e3a64640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0b0fe0 con 0x7f29dc06d610 2024-02-17T14:29:56.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e3a64640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc1d6850 con 0x7f29dc0b5610 2024-02-17T14:29:56.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e0fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29dc09bd10 0x7f29dc0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e0fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29dc09bd10 0x7f29dc0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42776/0 (socket says 172.21.15.134:42776) 2024-02-17T14:29:56.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e0fff640 1 -- 172.21.15.134:0/1443749370 learned_addr learned my addr 172.21.15.134:0/1443749370 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:56.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e1800640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29dc06d610 0x7f29dc09fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e2001640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29dc0b5610 0x7f29dc0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e0fff640 1 -- 172.21.15.134:0/1443749370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29dc0b5610 msgr2=0x7f29dc0b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e0fff640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29dc0b5610 0x7f29dc0b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e0fff640 1 -- 172.21.15.134:0/1443749370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29dc06d610 msgr2=0x7f29dc09fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e0fff640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29dc06d610 0x7f29dc09fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e0fff640 1 -- 172.21.15.134:0/1443749370 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d0009400 con 0x7f29dc09bd10 2024-02-17T14:29:56.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.199+0000 7f29e0fff640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29dc09bd10 0x7f29dc0b3c30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29d0036040 tx=0x7f29d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:56.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.200+0000 7f29cdffb640 1 -- 172.21.15.134:0/1443749370 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00339b0 con 0x7f29dc09bd10 2024-02-17T14:29:56.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.200+0000 7f29cdffb640 1 -- 172.21.15.134:0/1443749370 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d0033b30 con 0x7f29dc09bd10 2024-02-17T14:29:56.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.200+0000 7f29cdffb640 1 -- 172.21.15.134:0/1443749370 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d003c400 con 0x7f29dc09bd10 2024-02-17T14:29:56.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.200+0000 7f29e3a64640 1 -- 172.21.15.134:0/1443749370 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc0a0320 con 0x7f29dc09bd10 2024-02-17T14:29:56.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.200+0000 7f29e3a64640 1 -- 172.21.15.134:0/1443749370 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc09ed20 con 0x7f29dc09bd10 2024-02-17T14:29:56.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.201+0000 7f29e3a64640 1 -- 172.21.15.134:0/1443749370 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29dc067b70 con 0x7f29dc09bd10 2024-02-17T14:29:56.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.201+0000 7f29cdffb640 1 -- 172.21.15.134:0/1443749370 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f29d003a040 con 0x7f29dc09bd10 2024-02-17T14:29:56.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.202+0000 7f29cdffb640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f29c006b810 0x7f29c006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.202+0000 7f29e1800640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f29c006b810 0x7f29c006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.202+0000 7f29cdffb640 1 -- 172.21.15.134:0/1443749370 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f29d00ab790 con 0x7f29dc09bd10 2024-02-17T14:29:56.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.202+0000 7f29e1800640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f29c006b810 0x7f29c006dcd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f29d8007fd0 tx=0x7f29d8007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:56.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.206+0000 7f29cdffb640 1 -- 172.21.15.134:0/1443749370 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f29d0076010 con 0x7f29dc09bd10 2024-02-17T14:29:56.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.375+0000 7f29e3a64640 1 -- 172.21.15.134:0/1443749370 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f29dc146410 con 0x7f29dc09bd10 2024-02-17T14:29:56.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.376+0000 7f29cdffb640 1 -- 172.21.15.134:0/1443749370 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f29d0040020 con 0x7f29dc09bd10 2024-02-17T14:29:56.376 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-17T14:29:56.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.377+0000 7f29e3a64640 1 -- 172.21.15.134:0/1443749370 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f29c006b810 msgr2=0x7f29c006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.377+0000 7f29e3a64640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f29c006b810 0x7f29c006dcd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f29d8007fd0 tx=0x7f29d8007de0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.377+0000 7f29e3a64640 1 -- 172.21.15.134:0/1443749370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29dc09bd10 msgr2=0x7f29dc0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.377+0000 7f29e3a64640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29dc09bd10 0x7f29dc0b3c30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29d0036040 tx=0x7f29d00046c0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.378+0000 7f29e3a64640 1 -- 172.21.15.134:0/1443749370 shutdown_connections 2024-02-17T14:29:56.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.378+0000 7f29e3a64640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29dc0b5610 0x7f29dc0b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.378+0000 7f29e3a64640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f29c006b810 0x7f29c006dcd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.378+0000 7f29e3a64640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29dc09bd10 0x7f29dc0b3c30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.378+0000 7f29e3a64640 1 --2- 172.21.15.134:0/1443749370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29dc06d610 0x7f29dc09fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.378+0000 7f29e3a64640 1 -- 172.21.15.134:0/1443749370 >> 172.21.15.134:0/1443749370 conn(0x7f29dc0ba430 msgr2=0x7f29dc0b7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:56.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.378+0000 7f29e3a64640 1 -- 172.21.15.134:0/1443749370 shutdown_connections 2024-02-17T14:29:56.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.378+0000 7f29e3a64640 1 -- 172.21.15.134:0/1443749370 wait complete. 2024-02-17T14:29:56.389 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T14:29:56.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.490+0000 7efdc7e4e640 1 Processor -- start 2024-02-17T14:29:56.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.490+0000 7efdc7e4e640 1 -- start start 2024-02-17T14:29:56.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc7e4e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc01449b0 0x7efdc009b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc7e4e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efdc00b6fa0 0x7efdc01517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc7e4e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc009ac60 con 0x7efdc014a6f0 2024-02-17T14:29:56.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc7e4e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc014aad0 con 0x7efdc00b6fa0 2024-02-17T14:29:56.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc7e4e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00b3440 con 0x7efdc01449b0 2024-02-17T14:29:56.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc63eb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efdc00b6fa0 0x7efdc01517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc5bea640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7efdc014a6f0 0x7efdc01442a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52870/0 (socket says 172.21.15.134:52870) 2024-02-17T14:29:56.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc5bea640 1 -- 172.21.15.134:0/2727086452 learned_addr learned my addr 172.21.15.134:0/2727086452 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:29:56.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc53e9640 1 --2- 172.21.15.134:0/2727086452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc01449b0 0x7efdc009b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc63eb640 1 -- 172.21.15.134:0/2727086452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc01449b0 msgr2=0x7efdc009b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:56.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc63eb640 1 --2- 172.21.15.134:0/2727086452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc01449b0 0x7efdc009b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc63eb640 1 -- 172.21.15.134:0/2727086452 >> v1:172.21.15.134:6789/0 conn(0x7efdc014a6f0 legacy=0x7efdc01442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc4be8640 1 -- 172.21.15.134:0/2727086452 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976074862 0 0) 0x7efdc009ac60 con 0x7efdc014a6f0 2024-02-17T14:29:56.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc63eb640 1 -- 172.21.15.134:0/2727086452 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc009a610 con 0x7efdc00b6fa0 2024-02-17T14:29:56.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.491+0000 7efdc53e9640 1 --2- 172.21.15.134:0/2727086452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc01449b0 0x7efdc009b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:29:56.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.492+0000 7efdc63eb640 1 --2- 172.21.15.134:0/2727086452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc00b6fa0 0x7efdc01517b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efdb80097d0 tx=0x7efdb802b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f31adf45062c49a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:56.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.492+0000 7efdc4be8640 1 -- 172.21.15.134:0/2727086452 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8031770 con 0x7efdc00b6fa0 2024-02-17T14:29:56.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.492+0000 7efdc4be8640 1 -- 172.21.15.134:0/2727086452 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb80318d0 con 0x7efdc00b6fa0 2024-02-17T14:29:56.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.492+0000 7efdc4be8640 1 -- 172.21.15.134:0/2727086452 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8031c60 con 0x7efdc00b6fa0 2024-02-17T14:29:56.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.493+0000 7efdc7e4e640 1 -- 172.21.15.134:0/2727086452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc00b6fa0 msgr2=0x7efdc01517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.493+0000 7efdc7e4e640 1 --2- 172.21.15.134:0/2727086452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc00b6fa0 0x7efdc01517b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efdb80097d0 tx=0x7efdb802b810 comp rx=0 tx=0).stop 2024-02-17T14:29:56.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.493+0000 7efdc7e4e640 1 -- 172.21.15.134:0/2727086452 shutdown_connections 2024-02-17T14:29:56.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.493+0000 7efdc7e4e640 1 --2- 172.21.15.134:0/2727086452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc00b6fa0 0x7efdc01517b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.493+0000 7efdc7e4e640 1 --2- 172.21.15.134:0/2727086452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc01449b0 0x7efdc009b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.493+0000 7efdc7e4e640 1 -- 172.21.15.134:0/2727086452 >> 172.21.15.134:0/2727086452 conn(0x7efdc00b90a0 msgr2=0x7efdc00b94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:56.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.493+0000 7efdc7e4e640 1 -- 172.21.15.134:0/2727086452 shutdown_connections 2024-02-17T14:29:56.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.493+0000 7efdc7e4e640 1 -- 172.21.15.134:0/2727086452 wait complete. 2024-02-17T14:29:56.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.494+0000 7efdc7e4e640 1 Processor -- start 2024-02-17T14:29:56.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.494+0000 7efdc7e4e640 1 -- start start 2024-02-17T14:29:56.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.494+0000 7efdc7e4e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdc00b6fa0 0x7efdc00b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc7e4e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc01449b0 0x7efdc01dcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc7e4e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc014a6f0 0x7efdc01dd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc7e4e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00b0360 con 0x7efdc014a6f0 2024-02-17T14:29:56.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc7e4e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00b42c0 con 0x7efdc00b6fa0 2024-02-17T14:29:56.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc7e4e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00b0840 con 0x7efdc01449b0 2024-02-17T14:29:56.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc63eb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc014a6f0 0x7efdc01dd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc63eb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc014a6f0 0x7efdc01dd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42796/0 (socket says 172.21.15.134:42796) 2024-02-17T14:29:56.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc63eb640 1 -- 172.21.15.134:0/1516036208 learned_addr learned my addr 172.21.15.134:0/1516036208 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:56.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc53e9640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc01449b0 0x7efdc01dcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc5bea640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdc00b6fa0 0x7efdc00b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc63eb640 1 -- 172.21.15.134:0/1516036208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc01449b0 msgr2=0x7efdc01dcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc63eb640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc01449b0 0x7efdc01dcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc63eb640 1 -- 172.21.15.134:0/1516036208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdc00b6fa0 msgr2=0x7efdc00b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc63eb640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdc00b6fa0 0x7efdc00b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc63eb640 1 -- 172.21.15.134:0/1516036208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb8009400 con 0x7efdc014a6f0 2024-02-17T14:29:56.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc5bea640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdc00b6fa0 0x7efdc00b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:29:56.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc53e9640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc01449b0 0x7efdc01dcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:29:56.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc63eb640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc014a6f0 0x7efdc01dd4f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efdb80098f0 tx=0x7efdb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:56.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdb67fc640 1 -- 172.21.15.134:0/1516036208 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8032810 con 0x7efdc014a6f0 2024-02-17T14:29:56.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdb67fc640 1 -- 172.21.15.134:0/1516036208 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb8032970 con 0x7efdc014a6f0 2024-02-17T14:29:56.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc7e4e640 1 -- 172.21.15.134:0/1516036208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc00b4560 con 0x7efdc014a6f0 2024-02-17T14:29:56.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdb67fc640 1 -- 172.21.15.134:0/1516036208 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8032d00 con 0x7efdc014a6f0 2024-02-17T14:29:56.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.495+0000 7efdc7e4e640 1 -- 172.21.15.134:0/1516036208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc01dca20 con 0x7efdc014a6f0 2024-02-17T14:29:56.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.496+0000 7efdc7e4e640 1 -- 172.21.15.134:0/1516036208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc009bbf0 con 0x7efdc014a6f0 2024-02-17T14:29:56.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.497+0000 7efdb67fc640 1 -- 172.21.15.134:0/1516036208 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7efdb804e440 con 0x7efdc014a6f0 2024-02-17T14:29:56.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.497+0000 7efdb67fc640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7efda406b810 0x7efda406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.497+0000 7efdb67fc640 1 -- 172.21.15.134:0/1516036208 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efdb80ac680 con 0x7efdc014a6f0 2024-02-17T14:29:56.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.497+0000 7efdc5bea640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7efda406b810 0x7efda406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.497+0000 7efdc5bea640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7efda406b810 0x7efda406dcd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efdbc007fd0 tx=0x7efdbc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:56.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.501+0000 7efdb67fc640 1 -- 172.21.15.134:0/1516036208 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efdb8076de0 con 0x7efdc014a6f0 2024-02-17T14:29:56.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.682+0000 7efdc7e4e640 1 -- 172.21.15.134:0/1516036208 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efdc0067b70 con 0x7efdc014a6f0 2024-02-17T14:29:56.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.682+0000 7efdb67fc640 1 -- 172.21.15.134:0/1516036208 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7efdb8032e60 con 0x7efdc014a6f0 2024-02-17T14:29:56.682 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-02-17T14:29:56.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.684+0000 7efdc7e4e640 1 -- 172.21.15.134:0/1516036208 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7efda406b810 msgr2=0x7efda406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.684+0000 7efdc7e4e640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7efda406b810 0x7efda406dcd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efdbc007fd0 tx=0x7efdbc009040 comp rx=0 tx=0).stop 2024-02-17T14:29:56.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.684+0000 7efdc7e4e640 1 -- 172.21.15.134:0/1516036208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc014a6f0 msgr2=0x7efdc01dd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.684+0000 7efdc7e4e640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc014a6f0 0x7efdc01dd4f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efdb80098f0 tx=0x7efdb80046c0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.684+0000 7efdc7e4e640 1 -- 172.21.15.134:0/1516036208 shutdown_connections 2024-02-17T14:29:56.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.684+0000 7efdc7e4e640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7efda406b810 0x7efda406dcd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.684+0000 7efdc7e4e640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdc014a6f0 0x7efdc01dd4f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.684+0000 7efdc7e4e640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdc01449b0 0x7efdc01dcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.684+0000 7efdc7e4e640 1 --2- 172.21.15.134:0/1516036208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdc00b6fa0 0x7efdc00b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.684+0000 7efdc7e4e640 1 -- 172.21.15.134:0/1516036208 >> 172.21.15.134:0/1516036208 conn(0x7efdc00b90a0 msgr2=0x7efdc00babe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:56.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.684+0000 7efdc7e4e640 1 -- 172.21.15.134:0/1516036208 shutdown_connections 2024-02-17T14:29:56.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.684+0000 7efdc7e4e640 1 -- 172.21.15.134:0/1516036208 wait complete. 2024-02-17T14:29:56.695 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-02-17T14:29:56.695 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T14:29:56.710 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:29:56.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.851+0000 7f7c5f89d640 1 Processor -- start 2024-02-17T14:29:56.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.851+0000 7f7c5f89d640 1 -- start start 2024-02-17T14:29:56.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.851+0000 7f7c5f89d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c580b5020 0x7f7c58144c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.851+0000 7f7c5f89d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c58072050 0x7f7c580b0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.851+0000 7f7c5f89d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c580714b0 con 0x7f7c58145170 2024-02-17T14:29:56.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.851+0000 7f7c5f89d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c580b5eb0 con 0x7f7c580b5020 2024-02-17T14:29:56.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.851+0000 7f7c5f89d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580b5400 con 0x7f7c58072050 2024-02-17T14:29:56.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c5ce38640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7c58145170 0x7f7c58071940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52884/0 (socket says 172.21.15.134:52884) 2024-02-17T14:29:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c5ce38640 1 -- 172.21.15.134:0/2040922137 learned_addr learned my addr 172.21.15.134:0/2040922137 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:29:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c5d639640 1 --2- 172.21.15.134:0/2040922137 >> v2:172.21.15.142:3300/0 conn(0x7f7c580b5020 0x7f7c58144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c5de3a640 1 --2- 172.21.15.134:0/2040922137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c58072050 0x7f7c580b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217436525 0 0) 0x7f7c580714b0 con 0x7f7c58145170 2024-02-17T14:29:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c44003520 con 0x7f7c58145170 2024-02-17T14:29:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2749031605 0 0) 0x7f7c44003520 con 0x7f7c58145170 2024-02-17T14:29:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c58072050 msgr2=0x7f7c580b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 --2- 172.21.15.134:0/2040922137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c58072050 0x7f7c580b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 >> v2:172.21.15.142:3300/0 conn(0x7f7c580b5020 msgr2=0x7f7c58144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:56.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 --2- 172.21.15.134:0/2040922137 >> v2:172.21.15.142:3300/0 conn(0x7f7c580b5020 0x7f7c58144c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c581456e0 con 0x7f7c58145170 2024-02-17T14:29:56.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f7c4c001670 con 0x7f7c58145170 2024-02-17T14:29:56.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 >> v1:172.21.15.134:6789/0 conn(0x7f7c58145170 legacy=0x7f7c58071940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 --2- 172.21.15.134:0/2040922137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c44003970 0x7f7c44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 --2- 172.21.15.134:0/2040922137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c58072050 0x7f7c440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 --2- 172.21.15.134:0/2040922137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c44004d00 0x7f7c44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580b5eb0 con 0x7f7c44003970 2024-02-17T14:29:56.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580b5400 con 0x7f7c44004d00 2024-02-17T14:29:56.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4400ba00 con 0x7f7c58072050 2024-02-17T14:29:56.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c5d639640 1 --2- 172.21.15.134:0/2040922137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c44003970 0x7f7c44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c5ce38640 1 --2- 172.21.15.134:0/2040922137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c58072050 0x7f7c440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.852+0000 7f7c5de3a640 1 --2- 172.21.15.134:0/2040922137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c44004d00 0x7f7c44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.853+0000 7f7c5d639640 1 -- 172.21.15.134:0/2040922137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c58072050 msgr2=0x7f7c440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:56.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.853+0000 7f7c5d639640 1 --2- 172.21.15.134:0/2040922137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c58072050 0x7f7c440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.853+0000 7f7c5d639640 1 -- 172.21.15.134:0/2040922137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c44004d00 msgr2=0x7f7c44005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:56.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.853+0000 7f7c5d639640 1 --2- 172.21.15.134:0/2040922137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c44004d00 0x7f7c44005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.853+0000 7f7c5d639640 1 -- 172.21.15.134:0/2040922137 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c44003520 con 0x7f7c44003970 2024-02-17T14:29:56.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.853+0000 7f7c5d639640 1 --2- 172.21.15.134:0/2040922137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c44003970 0x7f7c44003d90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009ac0 tx=0x7f7c440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c080241f39397c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:56.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.853+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5402c710 con 0x7f7c44003970 2024-02-17T14:29:56.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.853+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5402c870 con 0x7f7c44003970 2024-02-17T14:29:56.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.853+0000 7f7c4bfff640 1 -- 172.21.15.134:0/2040922137 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5402cc00 con 0x7f7c44003970 2024-02-17T14:29:56.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.854+0000 7f7c5f89d640 1 -- 172.21.15.134:0/2040922137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c44003970 msgr2=0x7f7c44003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.854+0000 7f7c5f89d640 1 --2- 172.21.15.134:0/2040922137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c44003970 0x7f7c44003d90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009ac0 tx=0x7f7c440057f0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.854+0000 7f7c5de3a640 1 -- 172.21.15.134:0/2040922137 reap_dead start 2024-02-17T14:29:56.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.854+0000 7f7c5f89d640 1 -- 172.21.15.134:0/2040922137 shutdown_connections 2024-02-17T14:29:56.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.854+0000 7f7c5f89d640 1 -- 172.21.15.134:0/2040922137 >> 172.21.15.134:0/2040922137 conn(0x7f7c580ba430 msgr2=0x7f7c580ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:56.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.854+0000 7f7c5f89d640 1 -- 172.21.15.134:0/2040922137 shutdown_connections 2024-02-17T14:29:56.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.854+0000 7f7c5f89d640 1 -- 172.21.15.134:0/2040922137 wait complete. 2024-02-17T14:29:56.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.855+0000 7f7c5f89d640 1 Processor -- start 2024-02-17T14:29:56.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.855+0000 7f7c5f89d640 1 -- start start 2024-02-17T14:29:56.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5f89d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c44003970 0x7f7c5813f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5f89d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813ffd0 0x7f7c58141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5f89d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c5813b650 0x7f7c5813bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5f89d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5813c010 con 0x7f7c5813ffd0 2024-02-17T14:29:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5f89d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c581412e0 con 0x7f7c44003970 2024-02-17T14:29:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5f89d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c581483b0 con 0x7f7c5813b650 2024-02-17T14:29:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5ce38640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813ffd0 0x7f7c58141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5ce38640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813ffd0 0x7f7c58141f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42810/0 (socket says 172.21.15.134:42810) 2024-02-17T14:29:56.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5ce38640 1 -- 172.21.15.134:0/3513379410 learned_addr learned my addr 172.21.15.134:0/3513379410 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:56.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5d639640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c44003970 0x7f7c5813f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5de3a640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c5813b650 0x7f7c5813bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5ce38640 1 -- 172.21.15.134:0/3513379410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c5813b650 msgr2=0x7f7c5813bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5ce38640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c5813b650 0x7f7c5813bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5ce38640 1 -- 172.21.15.134:0/3513379410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c44003970 msgr2=0x7f7c5813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:56.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5ce38640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c44003970 0x7f7c5813f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:56.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5ce38640 1 -- 172.21.15.134:0/3513379410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58148690 con 0x7f7c5813ffd0 2024-02-17T14:29:56.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5ce38640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813ffd0 0x7f7c58141f70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c000fb0 tx=0x7f7c4c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:56.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c49ffb640 1 -- 172.21.15.134:0/3513379410 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c00f7b0 con 0x7f7c5813ffd0 2024-02-17T14:29:56.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c49ffb640 1 -- 172.21.15.134:0/3513379410 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c00f970 con 0x7f7c5813ffd0 2024-02-17T14:29:56.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c5f89d640 1 -- 172.21.15.134:0/3513379410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c58141a50 con 0x7f7c5813ffd0 2024-02-17T14:29:56.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.856+0000 7f7c49ffb640 1 -- 172.21.15.134:0/3513379410 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c00fd20 con 0x7f7c5813ffd0 2024-02-17T14:29:56.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.857+0000 7f7c5f89d640 1 -- 172.21.15.134:0/3513379410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c58140450 con 0x7f7c5813ffd0 2024-02-17T14:29:56.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.857+0000 7f7c5f89d640 1 -- 172.21.15.134:0/3513379410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5806ffb0 con 0x7f7c5813ffd0 2024-02-17T14:29:56.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.858+0000 7f7c49ffb640 1 -- 172.21.15.134:0/3513379410 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7c4c01d460 con 0x7f7c5813ffd0 2024-02-17T14:29:56.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.858+0000 7f7c49ffb640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7c3c06b840 0x7f7c3c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:56.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.858+0000 7f7c49ffb640 1 -- 172.21.15.134:0/3513379410 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7c4c08a580 con 0x7f7c5813ffd0 2024-02-17T14:29:56.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.858+0000 7f7c5d639640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7c3c06b840 0x7f7c3c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:56.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.859+0000 7f7c5d639640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7c3c06b840 0x7f7c3c06dd00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7c54036000 tx=0x7f7c54030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:56.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:56.862+0000 7f7c49ffb640 1 -- 172.21.15.134:0/3513379410 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c4c054ce0 con 0x7f7c5813ffd0 2024-02-17T14:29:57.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.035+0000 7f7c5f89d640 1 -- 172.21.15.134:0/3513379410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c580724c0 con 0x7f7c5813ffd0 2024-02-17T14:29:57.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.036+0000 7f7c49ffb640 1 -- 172.21.15.134:0/3513379410 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f7c4c007af0 con 0x7f7c5813ffd0 2024-02-17T14:29:57.036 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:29:57.036 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":27,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:51.760520+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:29:57.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.038+0000 7f7c5f89d640 1 -- 172.21.15.134:0/3513379410 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7c3c06b840 msgr2=0x7f7c3c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.038+0000 7f7c5f89d640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7c3c06b840 0x7f7c3c06dd00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7c54036000 tx=0x7f7c54030000 comp rx=0 tx=0).stop 2024-02-17T14:29:57.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.038+0000 7f7c5f89d640 1 -- 172.21.15.134:0/3513379410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813ffd0 msgr2=0x7f7c58141f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.038+0000 7f7c5f89d640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813ffd0 0x7f7c58141f70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c000fb0 tx=0x7f7c4c007430 comp rx=0 tx=0).stop 2024-02-17T14:29:57.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.038+0000 7f7c5f89d640 1 -- 172.21.15.134:0/3513379410 shutdown_connections 2024-02-17T14:29:57.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.038+0000 7f7c5f89d640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c5813b650 0x7f7c5813bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.038+0000 7f7c5f89d640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7c3c06b840 0x7f7c3c06dd00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.038+0000 7f7c5f89d640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813ffd0 0x7f7c58141f70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.038+0000 7f7c5f89d640 1 --2- 172.21.15.134:0/3513379410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c44003970 0x7f7c5813f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.038+0000 7f7c5f89d640 1 -- 172.21.15.134:0/3513379410 >> 172.21.15.134:0/3513379410 conn(0x7f7c580ba430 msgr2=0x7f7c58142ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:57.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.038+0000 7f7c5f89d640 1 -- 172.21.15.134:0/3513379410 shutdown_connections 2024-02-17T14:29:57.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.038+0000 7f7c5f89d640 1 -- 172.21.15.134:0/3513379410 wait complete. 2024-02-17T14:29:57.049 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T14:27:58.602268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T14:28:01.178917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T14:28:02.371936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-17T14:28:05.647194+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-17T14:29:57.050 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T14:29:57.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.153+0000 7f9883c47640 1 Processor -- start 2024-02-17T14:29:57.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.153+0000 7f9883c47640 1 -- start start 2024-02-17T14:29:57.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.154+0000 7f9883c47640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f987c0b31f0 0x7f987c0b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.154+0000 7f9883c47640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987c0b1ff0 con 0x7f987c072870 2024-02-17T14:29:57.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.154+0000 7f9883c47640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987c0b1bd0 con 0x7f987c13e7a0 2024-02-17T14:29:57.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.154+0000 7f9883c47640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987c0b37d0 con 0x7f987c0b31f0 2024-02-17T14:29:57.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.154+0000 7f98819e3640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f987c072870 0x7f987c148300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52886/0 (socket says 172.21.15.134:52886) 2024-02-17T14:29:57.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.154+0000 7f98819e3640 1 -- 172.21.15.134:0/475420309 learned_addr learned my addr 172.21.15.134:0/475420309 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:29:57.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.154+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011629654 0 0) 0x7f987c0b1ff0 con 0x7f987c072870 2024-02-17T14:29:57.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.154+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9868003520 con 0x7f987c072870 2024-02-17T14:29:57.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.154+0000 7f98811e2640 1 --2- 172.21.15.134:0/475420309 >> v2:172.21.15.142:3300/0 conn(0x7f987c0b31f0 0x7f987c0b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2714443243 0 0) 0x7f9868003520 con 0x7f987c072870 2024-02-17T14:29:57.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 >> v2:172.21.15.142:3300/0 conn(0x7f987c0b31f0 msgr2=0x7f987c0b57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:57.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98809e1640 1 --2- 172.21.15.134:0/475420309 >> v2:172.21.15.142:3300/0 conn(0x7f987c0b31f0 0x7f987c0b57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 >> v1:172.21.15.142:6789/0 conn(0x7f987c13e7a0 legacy=0x7f987c13ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c072c50 con 0x7f987c072870 2024-02-17T14:29:57.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f9878001670 con 0x7f987c072870 2024-02-17T14:29:57.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 >> v1:172.21.15.134:6789/0 conn(0x7f987c072870 legacy=0x7f987c148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98809e1640 1 --2- 172.21.15.134:0/475420309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9868003970 0x7f9868003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98809e1640 1 --2- 172.21.15.134:0/475420309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98680047c0 0x7f9868004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98809e1640 1 --2- 172.21.15.134:0/475420309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9868005180 0x7f986800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c0b37d0 con 0x7f98680047c0 2024-02-17T14:29:57.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986800c120 con 0x7f9868003970 2024-02-17T14:29:57.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986800c2e0 con 0x7f9868005180 2024-02-17T14:29:57.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98811e2640 1 --2- 172.21.15.134:0/475420309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98680047c0 0x7f9868004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98819e3640 1 --2- 172.21.15.134:0/475420309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9868003970 0x7f9868003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98821e4640 1 --2- 172.21.15.134:0/475420309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9868005180 0x7f986800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98811e2640 1 -- 172.21.15.134:0/475420309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9868005180 msgr2=0x7f986800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:57.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98811e2640 1 --2- 172.21.15.134:0/475420309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9868005180 0x7f986800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98811e2640 1 -- 172.21.15.134:0/475420309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9868003970 msgr2=0x7f9868003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:57.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98811e2640 1 --2- 172.21.15.134:0/475420309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9868003970 0x7f9868003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98811e2640 1 -- 172.21.15.134:0/475420309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9868003520 con 0x7f98680047c0 2024-02-17T14:29:57.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98821e4640 1 --2- 172.21.15.134:0/475420309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9868005180 0x7f986800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:29:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.155+0000 7f98821e4640 1 -- 172.21.15.134:0/475420309 reap_dead start 2024-02-17T14:29:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.156+0000 7f98811e2640 1 --2- 172.21.15.134:0/475420309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98680047c0 0x7f9868004c40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f986c00fc50 tx=0x7f98680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6b564ad8331960 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.156+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c0309b0 con 0x7f98680047c0 2024-02-17T14:29:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.156+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c034070 con 0x7f98680047c0 2024-02-17T14:29:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.156+0000 7f98809e1640 1 -- 172.21.15.134:0/475420309 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c030d50 con 0x7f98680047c0 2024-02-17T14:29:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.157+0000 7f9883c47640 1 -- 172.21.15.134:0/475420309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98680047c0 msgr2=0x7f9868004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.157+0000 7f9883c47640 1 --2- 172.21.15.134:0/475420309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98680047c0 0x7f9868004c40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f986c00fc50 tx=0x7f98680057f0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.157+0000 7f9883c47640 1 -- 172.21.15.134:0/475420309 shutdown_connections 2024-02-17T14:29:57.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.157+0000 7f9883c47640 1 --2- 172.21.15.134:0/475420309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98680047c0 0x7f9868004c40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.157+0000 7f9883c47640 1 -- 172.21.15.134:0/475420309 >> 172.21.15.134:0/475420309 conn(0x7f987c0b9310 msgr2=0x7f987c0b9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.157+0000 7f9883c47640 1 -- 172.21.15.134:0/475420309 shutdown_connections 2024-02-17T14:29:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.157+0000 7f9883c47640 1 -- 172.21.15.134:0/475420309 wait complete. 2024-02-17T14:29:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.158+0000 7f9883c47640 1 Processor -- start 2024-02-17T14:29:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.158+0000 7f9883c47640 1 -- start start 2024-02-17T14:29:57.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.158+0000 7f9883c47640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98680047c0 0x7f987c13b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.158+0000 7f9883c47640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f987c147530 0x7f987c1479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.158+0000 7f9883c47640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c137830 0x7f987c137cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.158+0000 7f9883c47640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c0b8030 con 0x7f987c147530 2024-02-17T14:29:57.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.158+0000 7f9883c47640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c0b8fd0 con 0x7f98680047c0 2024-02-17T14:29:57.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.158+0000 7f9883c47640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c147ef0 con 0x7f987c137830 2024-02-17T14:29:57.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.158+0000 7f98811e2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f987c147530 0x7f987c1479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.158+0000 7f98811e2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f987c147530 0x7f987c1479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42820/0 (socket says 172.21.15.134:42820) 2024-02-17T14:29:57.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.158+0000 7f98811e2640 1 -- 172.21.15.134:0/1059120230 learned_addr learned my addr 172.21.15.134:0/1059120230 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:57.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.158+0000 7f98819e3640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98680047c0 0x7f987c13b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.158+0000 7f98821e4640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c137830 0x7f987c137cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.159+0000 7f98811e2640 1 -- 172.21.15.134:0/1059120230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c137830 msgr2=0x7f987c137cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.159+0000 7f98811e2640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c137830 0x7f987c137cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.159+0000 7f98811e2640 1 -- 172.21.15.134:0/1059120230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98680047c0 msgr2=0x7f987c13b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.159+0000 7f98811e2640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98680047c0 0x7f987c13b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.159+0000 7f98811e2640 1 -- 172.21.15.134:0/1059120230 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c0b76d0 con 0x7f987c147530 2024-02-17T14:29:57.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.159+0000 7f98811e2640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f987c147530 0x7f987c1479b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f986c030420 tx=0x7f986c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:57.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.159+0000 7f98727fc640 1 -- 172.21.15.134:0/1059120230 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c030bc0 con 0x7f987c147530 2024-02-17T14:29:57.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.159+0000 7f98727fc640 1 -- 172.21.15.134:0/1059120230 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c030d20 con 0x7f987c147530 2024-02-17T14:29:57.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.159+0000 7f9883c47640 1 -- 172.21.15.134:0/1059120230 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987c0b7970 con 0x7f987c147530 2024-02-17T14:29:57.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.159+0000 7f98727fc640 1 -- 172.21.15.134:0/1059120230 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c003830 con 0x7f987c147530 2024-02-17T14:29:57.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.159+0000 7f9883c47640 1 -- 172.21.15.134:0/1059120230 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987c1381f0 con 0x7f987c147530 2024-02-17T14:29:57.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.160+0000 7f9883c47640 1 -- 172.21.15.134:0/1059120230 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987c067b70 con 0x7f987c147530 2024-02-17T14:29:57.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.160+0000 7f98727fc640 1 -- 172.21.15.134:0/1059120230 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f986c003990 con 0x7f987c147530 2024-02-17T14:29:57.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.161+0000 7f98727fc640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f986006b810 0x7f986006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.161+0000 7f98819e3640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f986006b810 0x7f986006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.161+0000 7f98727fc640 1 -- 172.21.15.134:0/1059120230 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f986c0b0530 con 0x7f987c147530 2024-02-17T14:29:57.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.161+0000 7f98819e3640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f986006b810 0x7f986006dcd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f987c1489e0 tx=0x7f9878009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:57.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.165+0000 7f98727fc640 1 -- 172.21.15.134:0/1059120230 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f986c07e710 con 0x7f987c147530 2024-02-17T14:29:57.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.335+0000 7f9883c47640 1 -- 172.21.15.134:0/1059120230 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f987c143000 con 0x7f987c147530 2024-02-17T14:29:57.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.335+0000 7f98727fc640 1 -- 172.21.15.134:0/1059120230 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f986c07e2a0 con 0x7f987c147530 2024-02-17T14:29:57.336 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-02-17T14:29:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.337+0000 7f9883c47640 1 -- 172.21.15.134:0/1059120230 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f986006b810 msgr2=0x7f986006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.337+0000 7f9883c47640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f986006b810 0x7f986006dcd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f987c1489e0 tx=0x7f9878009040 comp rx=0 tx=0).stop 2024-02-17T14:29:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.337+0000 7f9883c47640 1 -- 172.21.15.134:0/1059120230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f987c147530 msgr2=0x7f987c1479b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.337+0000 7f9883c47640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f987c147530 0x7f987c1479b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f986c030420 tx=0x7f986c009190 comp rx=0 tx=0).stop 2024-02-17T14:29:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.337+0000 7f9883c47640 1 -- 172.21.15.134:0/1059120230 shutdown_connections 2024-02-17T14:29:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.337+0000 7f9883c47640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987c137830 0x7f987c137cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.337+0000 7f9883c47640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f986006b810 0x7f986006dcd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.337+0000 7f9883c47640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f987c147530 0x7f987c1479b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.337+0000 7f9883c47640 1 --2- 172.21.15.134:0/1059120230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98680047c0 0x7f987c13b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.337+0000 7f9883c47640 1 -- 172.21.15.134:0/1059120230 >> 172.21.15.134:0/1059120230 conn(0x7f987c0b9310 msgr2=0x7f987c0b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.338+0000 7f9883c47640 1 -- 172.21.15.134:0/1059120230 shutdown_connections 2024-02-17T14:29:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.338+0000 7f9883c47640 1 -- 172.21.15.134:0/1059120230 wait complete. 2024-02-17T14:29:57.349 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T14:29:57.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.451+0000 7f03343c7640 1 Processor -- start 2024-02-17T14:29:57.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.451+0000 7f03343c7640 1 -- start start 2024-02-17T14:29:57.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.451+0000 7f03343c7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f032c066b20 0x7f032c072060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.451+0000 7f03343c7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032c14d690 0x7f032c14fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.451+0000 7f03343c7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032c066f00 con 0x7f032c0725a0 2024-02-17T14:29:57.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.451+0000 7f03343c7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032c0b18d0 con 0x7f032c066b20 2024-02-17T14:29:57.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.452+0000 7f03343c7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032c0b0130 con 0x7f032c14d690 2024-02-17T14:29:57.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.452+0000 7f0332163640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f032c066b20 0x7f032c072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.452+0000 7f0332163640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f032c066b20 0x7f032c072060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42830/0 (socket says 172.21.15.134:42830) 2024-02-17T14:29:57.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.452+0000 7f0332163640 1 -- 172.21.15.134:0/2545814285 learned_addr learned my addr 172.21.15.134:0/2545814285 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:57.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.452+0000 7f0332964640 1 --2- 172.21.15.134:0/2545814285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032c14d690 0x7f032c14fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.452+0000 7f0332163640 1 -- 172.21.15.134:0/2545814285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032c14d690 msgr2=0x7f032c14fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:57.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.452+0000 7f0332163640 1 --2- 172.21.15.134:0/2545814285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032c14d690 0x7f032c14fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.452+0000 7f0332163640 1 -- 172.21.15.134:0/2545814285 >> v1:172.21.15.142:6789/0 conn(0x7f032c0725a0 legacy=0x7f032c141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.452+0000 7f0332163640 1 -- 172.21.15.134:0/2545814285 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c0af8c0 con 0x7f032c066b20 2024-02-17T14:29:57.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.452+0000 7f0332964640 1 --2- 172.21.15.134:0/2545814285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032c14d690 0x7f032c14fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:29:57.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.453+0000 7f0332163640 1 --2- 172.21.15.134:0/2545814285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f032c066b20 0x7f032c072060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0328009870 tx=0x7f032802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f6644c3a8d2e47 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:57.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.453+0000 7f0331161640 1 -- 172.21.15.134:0/2545814285 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328031640 con 0x7f032c066b20 2024-02-17T14:29:57.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.453+0000 7f0331161640 1 -- 172.21.15.134:0/2545814285 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03280317a0 con 0x7f032c066b20 2024-02-17T14:29:57.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.453+0000 7f0331161640 1 -- 172.21.15.134:0/2545814285 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328031b30 con 0x7f032c066b20 2024-02-17T14:29:57.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.453+0000 7f03343c7640 1 -- 172.21.15.134:0/2545814285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f032c066b20 msgr2=0x7f032c072060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.453+0000 7f03343c7640 1 --2- 172.21.15.134:0/2545814285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f032c066b20 0x7f032c072060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0328009870 tx=0x7f032802b8f0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.453+0000 7f03343c7640 1 -- 172.21.15.134:0/2545814285 shutdown_connections 2024-02-17T14:29:57.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.453+0000 7f03343c7640 1 --2- 172.21.15.134:0/2545814285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032c14d690 0x7f032c14fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.453+0000 7f03343c7640 1 --2- 172.21.15.134:0/2545814285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f032c066b20 0x7f032c072060 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.453+0000 7f03343c7640 1 -- 172.21.15.134:0/2545814285 >> 172.21.15.134:0/2545814285 conn(0x7f032c0b5fe0 msgr2=0x7f032c0b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:57.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.453+0000 7f03343c7640 1 -- 172.21.15.134:0/2545814285 shutdown_connections 2024-02-17T14:29:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.453+0000 7f03343c7640 1 -- 172.21.15.134:0/2545814285 wait complete. 2024-02-17T14:29:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.454+0000 7f03343c7640 1 Processor -- start 2024-02-17T14:29:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.454+0000 7f03343c7640 1 -- start start 2024-02-17T14:29:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f03343c7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032c066b20 0x7f032c13d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f03343c7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f032c0725a0 0x7f032c13c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f03343c7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f032c14d690 0x7f032c13b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f03343c7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c138d50 con 0x7f032c14d690 2024-02-17T14:29:57.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f03343c7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c13dcc0 con 0x7f032c0725a0 2024-02-17T14:29:57.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f03343c7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032c13cb30 con 0x7f032c066b20 2024-02-17T14:29:57.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f0332964640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f032c14d690 0x7f032c13b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f0332964640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f032c14d690 0x7f032c13b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42838/0 (socket says 172.21.15.134:42838) 2024-02-17T14:29:57.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f0332964640 1 -- 172.21.15.134:0/1668392702 learned_addr learned my addr 172.21.15.134:0/1668392702 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:57.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f0332163640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032c066b20 0x7f032c13d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f0331962640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f032c0725a0 0x7f032c13c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f0332964640 1 -- 172.21.15.134:0/1668392702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032c066b20 msgr2=0x7f032c13d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f0332964640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032c066b20 0x7f032c13d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f0332964640 1 -- 172.21.15.134:0/1668392702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f032c0725a0 msgr2=0x7f032c13c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f0332964640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f032c0725a0 0x7f032c13c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f0332964640 1 -- 172.21.15.134:0/1668392702 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03280094d0 con 0x7f032c14d690 2024-02-17T14:29:57.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.455+0000 7f0332964640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f032c14d690 0x7f032c13b040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0324007d90 tx=0x7f032400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:57.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.456+0000 7f0322ffd640 1 -- 172.21.15.134:0/1668392702 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324003990 con 0x7f032c14d690 2024-02-17T14:29:57.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.456+0000 7f0322ffd640 1 -- 172.21.15.134:0/1668392702 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032400f040 con 0x7f032c14d690 2024-02-17T14:29:57.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.456+0000 7f03343c7640 1 -- 172.21.15.134:0/1668392702 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032c1457c0 con 0x7f032c14d690 2024-02-17T14:29:57.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.456+0000 7f0322ffd640 1 -- 172.21.15.134:0/1668392702 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324003d30 con 0x7f032c14d690 2024-02-17T14:29:57.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.456+0000 7f03343c7640 1 -- 172.21.15.134:0/1668392702 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032c145b50 con 0x7f032c14d690 2024-02-17T14:29:57.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.457+0000 7f03343c7640 1 -- 172.21.15.134:0/1668392702 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032c145ce0 con 0x7f032c14d690 2024-02-17T14:29:57.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.457+0000 7f0322ffd640 1 -- 172.21.15.134:0/1668392702 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f0324004030 con 0x7f032c14d690 2024-02-17T14:29:57.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.457+0000 7f0322ffd640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f031006b810 0x7f031006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.458+0000 7f0332163640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f031006b810 0x7f031006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.458+0000 7f0322ffd640 1 -- 172.21.15.134:0/1668392702 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f032408a770 con 0x7f032c14d690 2024-02-17T14:29:57.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.458+0000 7f0332163640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f031006b810 0x7f031006dcd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0328036000 tx=0x7f032803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:57.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.462+0000 7f0322ffd640 1 -- 172.21.15.134:0/1668392702 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f032c145ce0 con 0x7f032c14d690 2024-02-17T14:29:57.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.632+0000 7f03343c7640 1 -- 172.21.15.134:0/1668392702 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f032c145ce0 con 0x7f032c14d690 2024-02-17T14:29:57.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.633+0000 7f0322ffd640 1 -- 172.21.15.134:0/1668392702 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f032c145ce0 con 0x7f032c14d690 2024-02-17T14:29:57.633 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-17T14:29:57.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.635+0000 7f03343c7640 1 -- 172.21.15.134:0/1668392702 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f031006b810 msgr2=0x7f031006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.635+0000 7f03343c7640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f031006b810 0x7f031006dcd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0328036000 tx=0x7f032803c040 comp rx=0 tx=0).stop 2024-02-17T14:29:57.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.635+0000 7f03343c7640 1 -- 172.21.15.134:0/1668392702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f032c14d690 msgr2=0x7f032c13b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.635+0000 7f03343c7640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f032c14d690 0x7f032c13b040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0324007d90 tx=0x7f032400d4a0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.635+0000 7f03343c7640 1 -- 172.21.15.134:0/1668392702 shutdown_connections 2024-02-17T14:29:57.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.635+0000 7f03343c7640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f031006b810 0x7f031006dcd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.635+0000 7f03343c7640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f032c14d690 0x7f032c13b040 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.635+0000 7f03343c7640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f032c0725a0 0x7f032c13c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.635+0000 7f03343c7640 1 --2- 172.21.15.134:0/1668392702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032c066b20 0x7f032c13d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.635+0000 7f03343c7640 1 -- 172.21.15.134:0/1668392702 >> 172.21.15.134:0/1668392702 conn(0x7f032c0b5fe0 msgr2=0x7f032c141dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:57.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.635+0000 7f03343c7640 1 -- 172.21.15.134:0/1668392702 shutdown_connections 2024-02-17T14:29:57.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.635+0000 7f03343c7640 1 -- 172.21.15.134:0/1668392702 wait complete. 2024-02-17T14:29:57.646 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T14:29:57.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.749+0000 7f11c3ac0640 1 Processor -- start 2024-02-17T14:29:57.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.749+0000 7f11c3ac0640 1 -- start start 2024-02-17T14:29:57.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c3ac0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc0b36f0 0x7f11bc13d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c3ac0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11bc13d5c0 0x7f11bc1432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c3ac0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11bc0b0e10 con 0x7f11bc143800 2024-02-17T14:29:57.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c3ac0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11bc0b1c70 con 0x7f11bc13d5c0 2024-02-17T14:29:57.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c3ac0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc06f830 con 0x7f11bc0b36f0 2024-02-17T14:29:57.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c205d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f11bc143800 0x7f11bc1468b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52890/0 (socket says 172.21.15.134:52890) 2024-02-17T14:29:57.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c205d640 1 -- 172.21.15.134:0/428615410 learned_addr learned my addr 172.21.15.134:0/428615410 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:29:57.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c105b640 1 --2- 172.21.15.134:0/428615410 >> v2:172.21.15.142:3300/0 conn(0x7f11bc13d5c0 0x7f11bc1432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486981636 0 0) 0x7f11bc0b0e10 con 0x7f11bc143800 2024-02-17T14:29:57.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c185c640 1 --2- 172.21.15.134:0/428615410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc0b36f0 0x7f11bc13d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11a8003520 con 0x7f11bc143800 2024-02-17T14:29:57.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2099542692 0 0) 0x7f11a8003520 con 0x7f11bc143800 2024-02-17T14:29:57.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc0b36f0 msgr2=0x7f11bc13d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:57.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 --2- 172.21.15.134:0/428615410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc0b36f0 0x7f11bc13d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 >> v2:172.21.15.142:3300/0 conn(0x7f11bc13d5c0 msgr2=0x7f11bc1432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:57.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 --2- 172.21.15.134:0/428615410 >> v2:172.21.15.142:3300/0 conn(0x7f11bc13d5c0 0x7f11bc1432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc0b3ad0 con 0x7f11bc143800 2024-02-17T14:29:57.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f11b40019f0 con 0x7f11bc143800 2024-02-17T14:29:57.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 >> v1:172.21.15.134:6789/0 conn(0x7f11bc143800 legacy=0x7f11bc1468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 --2- 172.21.15.134:0/428615410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc0b36f0 0x7f11a8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 --2- 172.21.15.134:0/428615410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11a8003ef0 0x7f11a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 --2- 172.21.15.134:0/428615410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11a8004d00 0x7f11a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0b1c70 con 0x7f11a8004d00 2024-02-17T14:29:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc06f830 con 0x7f11a8003ef0 2024-02-17T14:29:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.750+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a800ba60 con 0x7f11bc0b36f0 2024-02-17T14:29:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.751+0000 7f11c205d640 1 --2- 172.21.15.134:0/428615410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11a8004d00 0x7f11a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.751+0000 7f11c185c640 1 --2- 172.21.15.134:0/428615410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc0b36f0 0x7f11a8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.751+0000 7f11c105b640 1 --2- 172.21.15.134:0/428615410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11a8003ef0 0x7f11a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.751+0000 7f11c205d640 1 -- 172.21.15.134:0/428615410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc0b36f0 msgr2=0x7f11a8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.751+0000 7f11c205d640 1 --2- 172.21.15.134:0/428615410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc0b36f0 0x7f11a8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.751+0000 7f11c205d640 1 -- 172.21.15.134:0/428615410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11a8003ef0 msgr2=0x7f11a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.751+0000 7f11c205d640 1 --2- 172.21.15.134:0/428615410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11a8003ef0 0x7f11a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.751+0000 7f11c205d640 1 -- 172.21.15.134:0/428615410 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a8003520 con 0x7f11a8004d00 2024-02-17T14:29:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.751+0000 7f11c205d640 1 --2- 172.21.15.134:0/428615410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11a8004d00 0x7f11a8005180 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f11b400a840 tx=0x7f11a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d119871883dc44 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.752+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4034630 con 0x7f11a8004d00 2024-02-17T14:29:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.752+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b402f070 con 0x7f11a8004d00 2024-02-17T14:29:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.752+0000 7f11c085a640 1 -- 172.21.15.134:0/428615410 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b40349f0 con 0x7f11a8004d00 2024-02-17T14:29:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.752+0000 7f11c3ac0640 1 -- 172.21.15.134:0/428615410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11a8004d00 msgr2=0x7f11a8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.752+0000 7f11c3ac0640 1 --2- 172.21.15.134:0/428615410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11a8004d00 0x7f11a8005180 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f11b400a840 tx=0x7f11a80057f0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.752+0000 7f11c205d640 1 -- 172.21.15.134:0/428615410 reap_dead start 2024-02-17T14:29:57.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.752+0000 7f11c3ac0640 1 -- 172.21.15.134:0/428615410 shutdown_connections 2024-02-17T14:29:57.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.752+0000 7f11c3ac0640 1 -- 172.21.15.134:0/428615410 >> 172.21.15.134:0/428615410 conn(0x7f11bc0b8270 msgr2=0x7f11bc0b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:57.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.752+0000 7f11c3ac0640 1 -- 172.21.15.134:0/428615410 shutdown_connections 2024-02-17T14:29:57.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.752+0000 7f11c3ac0640 1 -- 172.21.15.134:0/428615410 wait complete. 2024-02-17T14:29:57.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.753+0000 7f11c3ac0640 1 Processor -- start 2024-02-17T14:29:57.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.753+0000 7f11c3ac0640 1 -- start start 2024-02-17T14:29:57.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c3ac0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11bc146ce0 0x7f11bc13fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c3ac0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc140250 0x7f11bc0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c3ac0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc1dfad0 0x7f11bc0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c3ac0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc1e0ac0 con 0x7f11bc140250 2024-02-17T14:29:57.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c3ac0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc1400b0 con 0x7f11bc146ce0 2024-02-17T14:29:57.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c3ac0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0acf70 con 0x7f11bc1dfad0 2024-02-17T14:29:57.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c105b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc140250 0x7f11bc0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c105b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc140250 0x7f11bc0af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42848/0 (socket says 172.21.15.134:42848) 2024-02-17T14:29:57.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c105b640 1 -- 172.21.15.134:0/3514843266 learned_addr learned my addr 172.21.15.134:0/3514843266 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:57.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c205d640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc1dfad0 0x7f11bc0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c185c640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11bc146ce0 0x7f11bc13fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c105b640 1 -- 172.21.15.134:0/3514843266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc1dfad0 msgr2=0x7f11bc0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c105b640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc1dfad0 0x7f11bc0afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c105b640 1 -- 172.21.15.134:0/3514843266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11bc146ce0 msgr2=0x7f11bc13fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c105b640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11bc146ce0 0x7f11bc13fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c105b640 1 -- 172.21.15.134:0/3514843266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc0b08e0 con 0x7f11bc140250 2024-02-17T14:29:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c205d640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc1dfad0 0x7f11bc0afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:29:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c185c640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11bc146ce0 0x7f11bc13fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:29:57.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.754+0000 7f11c105b640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc140250 0x7f11bc0af6e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f11ac011990 tx=0x7f11ac011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:57.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.755+0000 7f11b27fc640 1 -- 172.21.15.134:0/3514843266 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00fa70 con 0x7f11bc140250 2024-02-17T14:29:57.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.755+0000 7f11b27fc640 1 -- 172.21.15.134:0/3514843266 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac00fbd0 con 0x7f11bc140250 2024-02-17T14:29:57.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.755+0000 7f11c3ac0640 1 -- 172.21.15.134:0/3514843266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc1470c0 con 0x7f11bc140250 2024-02-17T14:29:57.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.755+0000 7f11b27fc640 1 -- 172.21.15.134:0/3514843266 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac014440 con 0x7f11bc140250 2024-02-17T14:29:57.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.755+0000 7f11c3ac0640 1 -- 172.21.15.134:0/3514843266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc0acb90 con 0x7f11bc140250 2024-02-17T14:29:57.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.756+0000 7f11c3ac0640 1 -- 172.21.15.134:0/3514843266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11bc067b70 con 0x7f11bc140250 2024-02-17T14:29:57.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.756+0000 7f11b27fc640 1 -- 172.21.15.134:0/3514843266 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f11ac0145a0 con 0x7f11bc140250 2024-02-17T14:29:57.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.756+0000 7f11b27fc640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f11a006b7b0 0x7f11a006dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:57.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.757+0000 7f11c185c640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f11a006b7b0 0x7f11a006dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:57.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.757+0000 7f11b27fc640 1 -- 172.21.15.134:0/3514843266 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f11ac08ae30 con 0x7f11bc140250 2024-02-17T14:29:57.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.757+0000 7f11c185c640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f11a006b7b0 0x7f11a006dc70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009bc0 tx=0x7f11b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:57.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.761+0000 7f11b27fc640 1 -- 172.21.15.134:0/3514843266 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f11ac0554e0 con 0x7f11bc140250 2024-02-17T14:29:57.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.934+0000 7f11c3ac0640 1 -- 172.21.15.134:0/3514843266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11bc072d10 con 0x7f11bc140250 2024-02-17T14:29:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.935+0000 7f11b27fc640 1 -- 172.21.15.134:0/3514843266 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11ac058ba0 con 0x7f11bc140250 2024-02-17T14:29:57.935 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 64 2024-02-17T14:29:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.937+0000 7f11c3ac0640 1 -- 172.21.15.134:0/3514843266 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f11a006b7b0 msgr2=0x7f11a006dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.937+0000 7f11c3ac0640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f11a006b7b0 0x7f11a006dc70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009bc0 tx=0x7f11b8008040 comp rx=0 tx=0).stop 2024-02-17T14:29:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.937+0000 7f11c3ac0640 1 -- 172.21.15.134:0/3514843266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc140250 msgr2=0x7f11bc0af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.937+0000 7f11c3ac0640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc140250 0x7f11bc0af6e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f11ac011990 tx=0x7f11ac011e50 comp rx=0 tx=0).stop 2024-02-17T14:29:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.937+0000 7f11c3ac0640 1 -- 172.21.15.134:0/3514843266 shutdown_connections 2024-02-17T14:29:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.937+0000 7f11c3ac0640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11bc1dfad0 0x7f11bc0afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.937+0000 7f11c3ac0640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f11a006b7b0 0x7f11a006dc70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.937+0000 7f11c3ac0640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11bc140250 0x7f11bc0af6e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.937+0000 7f11c3ac0640 1 --2- 172.21.15.134:0/3514843266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11bc146ce0 0x7f11bc13fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:57.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.937+0000 7f11c3ac0640 1 -- 172.21.15.134:0/3514843266 >> 172.21.15.134:0/3514843266 conn(0x7f11bc0b8270 msgr2=0x7f11bc070030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:57.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.937+0000 7f11c3ac0640 1 -- 172.21.15.134:0/3514843266 shutdown_connections 2024-02-17T14:29:57.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:57.937+0000 7f11c3ac0640 1 -- 172.21.15.134:0/3514843266 wait complete. 2024-02-17T14:29:57.948 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-17T14:29:58.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.052+0000 7fc41e32c640 1 Processor -- start 2024-02-17T14:29:58.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.052+0000 7fc41e32c640 1 -- start start 2024-02-17T14:29:58.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.052+0000 7fc41e32c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc418071940 0x7fc418071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.052+0000 7fc41e32c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4180714b0 con 0x7fc4180b0600 2024-02-17T14:29:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.052+0000 7fc41e32c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4180722e0 con 0x7fc4180b5020 2024-02-17T14:29:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.052+0000 7fc41e32c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4180b5eb0 con 0x7fc418071940 2024-02-17T14:29:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.053+0000 7fc41c8c9640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc4180b0600 0x7fc4180b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52902/0 (socket says 172.21.15.134:52902) 2024-02-17T14:29:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.053+0000 7fc41c8c9640 1 -- 172.21.15.134:0/3692318854 learned_addr learned my addr 172.21.15.134:0/3692318854 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:29:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.053+0000 7fc4177fe640 1 --2- 172.21.15.134:0/3692318854 >> v2:172.21.15.142:3300/0 conn(0x7fc418071940 0x7fc418071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:58.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.053+0000 7fc416ffd640 1 -- 172.21.15.134:0/3692318854 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144690735 0 0) 0x7fc4180714b0 con 0x7fc4180b0600 2024-02-17T14:29:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.053+0000 7fc416ffd640 1 -- 172.21.15.134:0/3692318854 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc400003520 con 0x7fc4180b0600 2024-02-17T14:29:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.053+0000 7fc4177fe640 1 -- 172.21.15.134:0/3692318854 >> v1:172.21.15.142:6789/0 conn(0x7fc4180b5020 legacy=0x7fc418144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.053+0000 7fc4177fe640 1 -- 172.21.15.134:0/3692318854 >> v1:172.21.15.134:6789/0 conn(0x7fc4180b0600 legacy=0x7fc4180b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:58.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.053+0000 7fc4177fe640 1 -- 172.21.15.134:0/3692318854 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4180b5400 con 0x7fc418071940 2024-02-17T14:29:58.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.054+0000 7fc4177fe640 1 --2- 172.21.15.134:0/3692318854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc418071940 0x7fc418071da0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0097a0 tx=0x7fc40c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a8343e275af35e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:58.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.054+0000 7fc416ffd640 1 -- 172.21.15.134:0/3692318854 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c02e070 con 0x7fc418071940 2024-02-17T14:29:58.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.054+0000 7fc416ffd640 1 -- 172.21.15.134:0/3692318854 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40c0315a0 con 0x7fc418071940 2024-02-17T14:29:58.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.054+0000 7fc416ffd640 1 -- 172.21.15.134:0/3692318854 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c031910 con 0x7fc418071940 2024-02-17T14:29:58.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.054+0000 7fc41e32c640 1 -- 172.21.15.134:0/3692318854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc418071940 msgr2=0x7fc418071da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:58.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.054+0000 7fc41e32c640 1 --2- 172.21.15.134:0/3692318854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc418071940 0x7fc418071da0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0097a0 tx=0x7fc40c02b840 comp rx=0 tx=0).stop 2024-02-17T14:29:58.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.055+0000 7fc41e32c640 1 -- 172.21.15.134:0/3692318854 shutdown_connections 2024-02-17T14:29:58.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.055+0000 7fc41e32c640 1 --2- 172.21.15.134:0/3692318854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc418071940 0x7fc418071da0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.055+0000 7fc41e32c640 1 -- 172.21.15.134:0/3692318854 >> 172.21.15.134:0/3692318854 conn(0x7fc4180ba430 msgr2=0x7fc4180ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:58.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.055+0000 7fc41e32c640 1 -- 172.21.15.134:0/3692318854 shutdown_connections 2024-02-17T14:29:58.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.055+0000 7fc41e32c640 1 -- 172.21.15.134:0/3692318854 wait complete. 2024-02-17T14:29:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.056+0000 7fc41e32c640 1 Processor -- start 2024-02-17T14:29:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.056+0000 7fc41e32c640 1 -- start start 2024-02-17T14:29:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.056+0000 7fc41e32c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc418071940 0x7fc41809fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.056+0000 7fc41e32c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4180b0600 0x7fc4181da5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.056+0000 7fc41e32c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4180b5020 0x7fc4181dab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.056+0000 7fc41e32c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4181d9e90 con 0x7fc418071940 2024-02-17T14:29:58.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.056+0000 7fc41e32c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4181da130 con 0x7fc4180b0600 2024-02-17T14:29:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.056+0000 7fc41e32c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41809f160 con 0x7fc4180b5020 2024-02-17T14:29:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.056+0000 7fc417fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc418071940 0x7fc41809fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.056+0000 7fc417fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc418071940 0x7fc41809fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42850/0 (socket says 172.21.15.134:42850) 2024-02-17T14:29:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.056+0000 7fc417fff640 1 -- 172.21.15.134:0/2793971933 learned_addr learned my addr 172.21.15.134:0/2793971933 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.057+0000 7fc4177fe640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4180b0600 0x7fc4181da5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.057+0000 7fc41c8c9640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4180b5020 0x7fc4181dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:58.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.057+0000 7fc417fff640 1 -- 172.21.15.134:0/2793971933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4180b5020 msgr2=0x7fc4181dab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.057+0000 7fc417fff640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4180b5020 0x7fc4181dab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.057+0000 7fc417fff640 1 -- 172.21.15.134:0/2793971933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4180b0600 msgr2=0x7fc4181da5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.057+0000 7fc417fff640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4180b0600 0x7fc4181da5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.057+0000 7fc417fff640 1 -- 172.21.15.134:0/2793971933 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c009400 con 0x7fc418071940 2024-02-17T14:29:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.057+0000 7fc417fff640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc418071940 0x7fc41809fbd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc40800c3c0 tx=0x7fc40800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.057+0000 7fc414ff9640 1 -- 172.21.15.134:0/2793971933 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4080052d0 con 0x7fc418071940 2024-02-17T14:29:58.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.057+0000 7fc414ff9640 1 -- 172.21.15.134:0/2793971933 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc408005450 con 0x7fc418071940 2024-02-17T14:29:58.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.057+0000 7fc41e32c640 1 -- 172.21.15.134:0/2793971933 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4180b4220 con 0x7fc418071940 2024-02-17T14:29:58.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.057+0000 7fc414ff9640 1 -- 172.21.15.134:0/2793971933 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc408007260 con 0x7fc418071940 2024-02-17T14:29:58.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.057+0000 7fc41e32c640 1 -- 172.21.15.134:0/2793971933 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41809ecf0 con 0x7fc418071940 2024-02-17T14:29:58.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.058+0000 7fc41e32c640 1 -- 172.21.15.134:0/2793971933 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41809eee0 con 0x7fc418071940 2024-02-17T14:29:58.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.059+0000 7fc414ff9640 1 -- 172.21.15.134:0/2793971933 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc4080073c0 con 0x7fc418071940 2024-02-17T14:29:58.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.059+0000 7fc414ff9640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc40406b810 0x7fc40406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:58.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.059+0000 7fc414ff9640 1 -- 172.21.15.134:0/2793971933 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc408089840 con 0x7fc418071940 2024-02-17T14:29:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.059+0000 7fc4177fe640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc40406b810 0x7fc40406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.059+0000 7fc4177fe640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc40406b810 0x7fc40406dcd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc40c036000 tx=0x7fc40c03e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:58.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.063+0000 7fc414ff9640 1 -- 172.21.15.134:0/2793971933 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc408053fa0 con 0x7fc418071940 2024-02-17T14:29:58.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.234+0000 7fc41e32c640 1 -- 172.21.15.134:0/2793971933 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc4180b4410 con 0x7fc418071940 2024-02-17T14:29:58.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.234+0000 7fc414ff9640 1 -- 172.21.15.134:0/2793971933 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc408057660 con 0x7fc418071940 2024-02-17T14:29:58.234 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-02-17T14:29:58.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.236+0000 7fc41e32c640 1 -- 172.21.15.134:0/2793971933 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc40406b810 msgr2=0x7fc40406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:58.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.236+0000 7fc41e32c640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc40406b810 0x7fc40406dcd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc40c036000 tx=0x7fc40c03e040 comp rx=0 tx=0).stop 2024-02-17T14:29:58.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.236+0000 7fc41e32c640 1 -- 172.21.15.134:0/2793971933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc418071940 msgr2=0x7fc41809fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:58.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.236+0000 7fc41e32c640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc418071940 0x7fc41809fbd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc40800c3c0 tx=0x7fc40800c880 comp rx=0 tx=0).stop 2024-02-17T14:29:58.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.236+0000 7fc41e32c640 1 -- 172.21.15.134:0/2793971933 shutdown_connections 2024-02-17T14:29:58.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.236+0000 7fc41e32c640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4180b5020 0x7fc4181dab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.236+0000 7fc41e32c640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4180b0600 0x7fc4181da5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.236+0000 7fc41e32c640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc40406b810 0x7fc40406dcd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.236+0000 7fc41e32c640 1 --2- 172.21.15.134:0/2793971933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc418071940 0x7fc41809fbd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.236+0000 7fc41e32c640 1 -- 172.21.15.134:0/2793971933 >> 172.21.15.134:0/2793971933 conn(0x7fc4180ba430 msgr2=0x7fc41806e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:58.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.236+0000 7fc41e32c640 1 -- 172.21.15.134:0/2793971933 shutdown_connections 2024-02-17T14:29:58.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.236+0000 7fc41e32c640 1 -- 172.21.15.134:0/2793971933 wait complete. 2024-02-17T14:29:58.247 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T14:29:58.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.348+0000 7f178f223640 1 Processor -- start 2024-02-17T14:29:58.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.348+0000 7f178f223640 1 -- start start 2024-02-17T14:29:58.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f178f223640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1788141ff0 0x7f1788142470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:58.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f178f223640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178814d690 0x7f178814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:58.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f178f223640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1788066f00 con 0x7f1788066b20 2024-02-17T14:29:58.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f178f223640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17880b18d0 con 0x7f1788141ff0 2024-02-17T14:29:58.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f178f223640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17880b0130 con 0x7f178814d690 2024-02-17T14:29:58.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f178d7c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178814d690 0x7f178814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:58.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f1787fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1788141ff0 0x7f1788142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:58.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f178cfbf640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1788066b20 0x7f1788072060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:59944/0 (socket says 172.21.15.134:59944) 2024-02-17T14:29:58.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f178cfbf640 1 -- 172.21.15.134:0/1991317140 learned_addr learned my addr 172.21.15.134:0/1991317140 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:29:58.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f17877fe640 1 -- 172.21.15.134:0/1991317140 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216213911 0 0) 0x7f1788066f00 con 0x7f1788066b20 2024-02-17T14:29:58.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f17877fe640 1 -- 172.21.15.134:0/1991317140 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1778003520 con 0x7f1788066b20 2024-02-17T14:29:58.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f1787fff640 1 -- 172.21.15.134:0/1991317140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178814d690 msgr2=0x7f178814fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:58.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f1787fff640 1 --2- 172.21.15.134:0/1991317140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178814d690 0x7f178814fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.349+0000 7f1787fff640 1 -- 172.21.15.134:0/1991317140 >> v1:172.21.15.142:6789/0 conn(0x7f1788066b20 legacy=0x7f1788072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:58.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.350+0000 7f1787fff640 1 -- 172.21.15.134:0/1991317140 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17880af8c0 con 0x7f1788141ff0 2024-02-17T14:29:58.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.350+0000 7f178d7c0640 1 --2- 172.21.15.134:0/1991317140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178814d690 0x7f178814fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:29:58.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.350+0000 7f1787fff640 1 --2- 172.21.15.134:0/1991317140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1788141ff0 0x7f1788142470 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f17740097a0 tx=0x7f177402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aef6dd0f667d95a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:58.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.350+0000 7f17877fe640 1 -- 172.21.15.134:0/1991317140 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177402e070 con 0x7f1788141ff0 2024-02-17T14:29:58.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.350+0000 7f17877fe640 1 -- 172.21.15.134:0/1991317140 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17740315a0 con 0x7f1788141ff0 2024-02-17T14:29:58.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.350+0000 7f17877fe640 1 -- 172.21.15.134:0/1991317140 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774031910 con 0x7f1788141ff0 2024-02-17T14:29:58.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.351+0000 7f178f223640 1 -- 172.21.15.134:0/1991317140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1788141ff0 msgr2=0x7f1788142470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:58.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.351+0000 7f178f223640 1 --2- 172.21.15.134:0/1991317140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1788141ff0 0x7f1788142470 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f17740097a0 tx=0x7f177402b840 comp rx=0 tx=0).stop 2024-02-17T14:29:58.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.351+0000 7f178f223640 1 -- 172.21.15.134:0/1991317140 shutdown_connections 2024-02-17T14:29:58.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.351+0000 7f178f223640 1 --2- 172.21.15.134:0/1991317140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178814d690 0x7f178814fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.351+0000 7f178f223640 1 --2- 172.21.15.134:0/1991317140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1788141ff0 0x7f1788142470 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.351+0000 7f178f223640 1 -- 172.21.15.134:0/1991317140 >> 172.21.15.134:0/1991317140 conn(0x7f17880b5fe0 msgr2=0x7f17880b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:58.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.351+0000 7f178f223640 1 -- 172.21.15.134:0/1991317140 shutdown_connections 2024-02-17T14:29:58.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.351+0000 7f178f223640 1 -- 172.21.15.134:0/1991317140 wait complete. 2024-02-17T14:29:58.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.352+0000 7f178f223640 1 Processor -- start 2024-02-17T14:29:58.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.352+0000 7f178f223640 1 -- start start 2024-02-17T14:29:58.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f178f223640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1788066b20 0x7f17880b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:58.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f178f223640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1788141ff0 0x7f178814b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:58.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f178f223640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178814d690 0x7f178814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:58.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f178f223640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178814c0b0 con 0x7f1788141ff0 2024-02-17T14:29:58.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f178f223640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1788071600 con 0x7f1788066b20 2024-02-17T14:29:58.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f178f223640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178814aec0 con 0x7f178814d690 2024-02-17T14:29:58.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f1787fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1788141ff0 0x7f178814b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:58.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f1787fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1788141ff0 0x7f178814b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42856/0 (socket says 172.21.15.134:42856) 2024-02-17T14:29:58.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f1787fff640 1 -- 172.21.15.134:0/1350471298 learned_addr learned my addr 172.21.15.134:0/1350471298 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:58.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f178cfbf640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1788066b20 0x7f17880b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:58.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f178d7c0640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178814d690 0x7f178814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:58.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f1787fff640 1 -- 172.21.15.134:0/1350471298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178814d690 msgr2=0x7f178814bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:58.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f1787fff640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178814d690 0x7f178814bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f1787fff640 1 -- 172.21.15.134:0/1350471298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1788066b20 msgr2=0x7f17880b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:58.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f1787fff640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1788066b20 0x7f17880b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f1787fff640 1 -- 172.21.15.134:0/1350471298 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1780009a70 con 0x7f1788141ff0 2024-02-17T14:29:58.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f1787fff640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1788141ff0 0x7f178814b630 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f17740098c0 tx=0x7f17740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:58.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.353+0000 7f17857fa640 1 -- 172.21.15.134:0/1350471298 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774032630 con 0x7f1788141ff0 2024-02-17T14:29:58.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.354+0000 7f17857fa640 1 -- 172.21.15.134:0/1350471298 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1774032790 con 0x7f1788141ff0 2024-02-17T14:29:58.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.354+0000 7f17857fa640 1 -- 172.21.15.134:0/1350471298 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774032b20 con 0x7f1788141ff0 2024-02-17T14:29:58.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.354+0000 7f178f223640 1 -- 172.21.15.134:0/1350471298 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1774009400 con 0x7f1788141ff0 2024-02-17T14:29:58.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.354+0000 7f178f223640 1 -- 172.21.15.134:0/1350471298 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1788070fb0 con 0x7f1788141ff0 2024-02-17T14:29:58.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.355+0000 7f178f223640 1 -- 172.21.15.134:0/1350471298 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17880717b0 con 0x7f1788141ff0 2024-02-17T14:29:58.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.355+0000 7f17857fa640 1 -- 172.21.15.134:0/1350471298 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f1774032c80 con 0x7f1788141ff0 2024-02-17T14:29:58.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.355+0000 7f17857fa640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f176c06b810 0x7f176c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:58.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.356+0000 7f17857fa640 1 -- 172.21.15.134:0/1350471298 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f17740ac2f0 con 0x7f1788141ff0 2024-02-17T14:29:58.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.356+0000 7f178cfbf640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f176c06b810 0x7f176c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:58.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.356+0000 7f178cfbf640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f176c06b810 0x7f176c06dcd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f177c005880 tx=0x7f177c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:58.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.360+0000 7f17857fa640 1 -- 172.21.15.134:0/1350471298 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f17880717b0 con 0x7f1788141ff0 2024-02-17T14:29:58.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.542+0000 7f178f223640 1 -- 172.21.15.134:0/1350471298 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f17880717b0 con 0x7f1788141ff0 2024-02-17T14:29:58.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.543+0000 7f17857fa640 1 -- 172.21.15.134:0/1350471298 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f17880717b0 con 0x7f1788141ff0 2024-02-17T14:29:58.543 INFO:teuthology.orchestra.run.smithi134.stderr:listed 0 entries 2024-02-17T14:29:58.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.545+0000 7f178f223640 1 -- 172.21.15.134:0/1350471298 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f176c06b810 msgr2=0x7f176c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:58.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.545+0000 7f178f223640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f176c06b810 0x7f176c06dcd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f177c005880 tx=0x7f177c009040 comp rx=0 tx=0).stop 2024-02-17T14:29:58.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.545+0000 7f178f223640 1 -- 172.21.15.134:0/1350471298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1788141ff0 msgr2=0x7f178814b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:58.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.545+0000 7f178f223640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1788141ff0 0x7f178814b630 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f17740098c0 tx=0x7f17740046c0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.545+0000 7f178f223640 1 -- 172.21.15.134:0/1350471298 shutdown_connections 2024-02-17T14:29:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.545+0000 7f178f223640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178814d690 0x7f178814bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.545+0000 7f178f223640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f176c06b810 0x7f176c06dcd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.545+0000 7f178f223640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1788141ff0 0x7f178814b630 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.545+0000 7f178f223640 1 --2- 172.21.15.134:0/1350471298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1788066b20 0x7f17880b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.545+0000 7f178f223640 1 -- 172.21.15.134:0/1350471298 >> 172.21.15.134:0/1350471298 conn(0x7f17880b5fe0 msgr2=0x7f178813f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.545+0000 7f178f223640 1 -- 172.21.15.134:0/1350471298 shutdown_connections 2024-02-17T14:29:58.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:58.545+0000 7f178f223640 1 -- 172.21.15.134:0/1350471298 wait complete. 2024-02-17T14:29:58.556 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi134.front.sepia.ceph.com... 2024-02-17T14:29:58.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:29:58.556 DEBUG:teuthology.orchestra.run.smithi134:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-02-17T14:29:58.582 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi134.stderr:ceph-fuse[46552]: fuse finished with error 0 and tester_r 0 2024-02-17T14:29:58.583 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:29:58.662 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-02-17T14:29:58.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:29:58.663 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-17T14:29:58.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:29:58.679 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-02-17T14:29:58.733 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-17T14:29:58.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:29:58.734 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T14:29:58.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T14:29:58.801 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-02-17T14:29:58.899 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-17T14:29:58.909 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-17T14:29:58.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T14:29:59.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.011+0000 7fb6155ac640 1 Processor -- start 2024-02-17T14:29:59.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.011+0000 7fb6155ac640 1 -- start start 2024-02-17T14:29:59.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.011+0000 7fb6155ac640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb6100b1640 0x7fb61013d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.011+0000 7fb6155ac640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb610073040 con 0x7fb6100b2e60 2024-02-17T14:29:59.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.011+0000 7fb6155ac640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6100b3240 con 0x7fb6100b0ba0 2024-02-17T14:29:59.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.011+0000 7fb6155ac640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6100b1ad0 con 0x7fb6100b1640 2024-02-17T14:29:59.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60effd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb6100b2e60 0x7fb6100b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52908/0 (socket says 172.21.15.134:52908) 2024-02-17T14:29:59.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60effd640 1 -- 172.21.15.134:0/1285539720 learned_addr learned my addr 172.21.15.134:0/1285539720 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:29:59.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552486204 0 0) 0x7fb610073040 con 0x7fb6100b2e60 2024-02-17T14:29:59.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb6067fc640 1 --2- 172.21.15.134:0/1285539720 >> v2:172.21.15.142:3300/0 conn(0x7fb6100b1640 0x7fb61013d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5fc003520 con 0x7fb6100b2e60 2024-02-17T14:29:59.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3359321040 0 0) 0x7fb5fc003520 con 0x7fb6100b2e60 2024-02-17T14:29:59.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 >> v2:172.21.15.142:3300/0 conn(0x7fb6100b1640 msgr2=0x7fb61013d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:59.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 --2- 172.21.15.134:0/1285539720 >> v2:172.21.15.142:3300/0 conn(0x7fb6100b1640 0x7fb61013d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 >> v1:172.21.15.142:6789/0 conn(0x7fb6100b0ba0 legacy=0x7fb61013da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610072b20 con 0x7fb6100b2e60 2024-02-17T14:29:59.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7fb600001670 con 0x7fb6100b2e60 2024-02-17T14:29:59.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 >> v1:172.21.15.134:6789/0 conn(0x7fb6100b2e60 legacy=0x7fb6100b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 --2- 172.21.15.134:0/1285539720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5fc0039a0 0x7fb5fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 --2- 172.21.15.134:0/1285539720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5fc0047c0 0x7fb5fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 --2- 172.21.15.134:0/1285539720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5fc0052a0 0x7fb5fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100b1ad0 con 0x7fb5fc0039a0 2024-02-17T14:29:59.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc00c1a0 con 0x7fb5fc0047c0 2024-02-17T14:29:59.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc00c360 con 0x7fb5fc0052a0 2024-02-17T14:29:59.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.012+0000 7fb60effd640 1 --2- 172.21.15.134:0/1285539720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5fc0039a0 0x7fb5fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.013+0000 7fb6067fc640 1 --2- 172.21.15.134:0/1285539720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5fc0047c0 0x7fb5fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.013+0000 7fb60f7fe640 1 --2- 172.21.15.134:0/1285539720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5fc0052a0 0x7fb5fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.013+0000 7fb60effd640 1 -- 172.21.15.134:0/1285539720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5fc0052a0 msgr2=0x7fb5fc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:59.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.013+0000 7fb60effd640 1 --2- 172.21.15.134:0/1285539720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5fc0052a0 0x7fb5fc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.013+0000 7fb60effd640 1 -- 172.21.15.134:0/1285539720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5fc0047c0 msgr2=0x7fb5fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:59.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.013+0000 7fb60effd640 1 --2- 172.21.15.134:0/1285539720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5fc0047c0 0x7fb5fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.013+0000 7fb60effd640 1 -- 172.21.15.134:0/1285539720 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc003520 con 0x7fb5fc0039a0 2024-02-17T14:29:59.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.013+0000 7fb60f7fe640 1 -- 172.21.15.134:0/1285539720 reap_dead start 2024-02-17T14:29:59.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.013+0000 7fb60effd640 1 --2- 172.21.15.134:0/1285539720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5fc0039a0 0x7fb5fc003dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb60000c210 tx=0x7fb5fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27168badd5fed40b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:59.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.014+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600005ad0 con 0x7fb5fc0039a0 2024-02-17T14:29:59.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.014+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb600005c30 con 0x7fb5fc0039a0 2024-02-17T14:29:59.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.014+0000 7fb60e7fc640 1 -- 172.21.15.134:0/1285539720 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60002cab0 con 0x7fb5fc0039a0 2024-02-17T14:29:59.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.014+0000 7fb6155ac640 1 -- 172.21.15.134:0/1285539720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5fc0039a0 msgr2=0x7fb5fc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.014+0000 7fb6155ac640 1 --2- 172.21.15.134:0/1285539720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5fc0039a0 0x7fb5fc003dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb60000c210 tx=0x7fb5fc0057f0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.014+0000 7fb6155ac640 1 -- 172.21.15.134:0/1285539720 shutdown_connections 2024-02-17T14:29:59.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.014+0000 7fb6155ac640 1 --2- 172.21.15.134:0/1285539720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5fc0039a0 0x7fb5fc003dc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.014+0000 7fb6155ac640 1 -- 172.21.15.134:0/1285539720 >> 172.21.15.134:0/1285539720 conn(0x7fb6100b8270 msgr2=0x7fb6100b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:59.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.014+0000 7fb6155ac640 1 -- 172.21.15.134:0/1285539720 shutdown_connections 2024-02-17T14:29:59.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.014+0000 7fb6155ac640 1 -- 172.21.15.134:0/1285539720 wait complete. 2024-02-17T14:29:59.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.015+0000 7fb6155ac640 1 Processor -- start 2024-02-17T14:29:59.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.015+0000 7fb6155ac640 1 -- start start 2024-02-17T14:29:59.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6155ac640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5fc0039a0 0x7fb610137d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6155ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6101dd2e0 0x7fb6101dd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6155ac640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6101333c0 0x7fb610133840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6155ac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6101dce50 con 0x7fb6101dd2e0 2024-02-17T14:29:59.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6155ac640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61013e600 con 0x7fb6101333c0 2024-02-17T14:29:59.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6155ac640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb610139330 con 0x7fb5fc0039a0 2024-02-17T14:29:59.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6067fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6101dd2e0 0x7fb6101dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6067fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6101dd2e0 0x7fb6101dd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42872/0 (socket says 172.21.15.134:42872) 2024-02-17T14:29:59.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6067fc640 1 -- 172.21.15.134:0/2176376453 learned_addr learned my addr 172.21.15.134:0/2176376453 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:59.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb60f7fe640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6101333c0 0x7fb610133840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb60effd640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5fc0039a0 0x7fb610137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6067fc640 1 -- 172.21.15.134:0/2176376453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5fc0039a0 msgr2=0x7fb610137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6067fc640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5fc0039a0 0x7fb610137d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6067fc640 1 -- 172.21.15.134:0/2176376453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6101333c0 msgr2=0x7fb610133840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6067fc640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6101333c0 0x7fb610133840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6067fc640 1 -- 172.21.15.134:0/2176376453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610139610 con 0x7fb6101dd2e0 2024-02-17T14:29:59.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb60effd640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5fc0039a0 0x7fb610137d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:29:59.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.016+0000 7fb6067fc640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6101dd2e0 0x7fb6101dd760 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8011a50 tx=0x7fb5f8011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:59.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.017+0000 7fb607fff640 1 -- 172.21.15.134:0/2176376453 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8016070 con 0x7fb6101dd2e0 2024-02-17T14:29:59.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.017+0000 7fb607fff640 1 -- 172.21.15.134:0/2176376453 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f8004240 con 0x7fb6101dd2e0 2024-02-17T14:29:59.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.017+0000 7fb607fff640 1 -- 172.21.15.134:0/2176376453 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80043d0 con 0x7fb6101dd2e0 2024-02-17T14:29:59.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.017+0000 7fb6155ac640 1 -- 172.21.15.134:0/2176376453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61013e870 con 0x7fb6101dd2e0 2024-02-17T14:29:59.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.017+0000 7fb6155ac640 1 -- 172.21.15.134:0/2176376453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb610138c90 con 0x7fb6101dd2e0 2024-02-17T14:29:59.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.018+0000 7fb6155ac640 1 -- 172.21.15.134:0/2176376453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb610074650 con 0x7fb6101dd2e0 2024-02-17T14:29:59.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.018+0000 7fb607fff640 1 -- 172.21.15.134:0/2176376453 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fb5f800e8f0 con 0x7fb6101dd2e0 2024-02-17T14:29:59.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.018+0000 7fb607fff640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb5f006b810 0x7fb5f006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.018+0000 7fb60effd640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb5f006b810 0x7fb5f006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.018+0000 7fb607fff640 1 -- 172.21.15.134:0/2176376453 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb5f808c110 con 0x7fb6101dd2e0 2024-02-17T14:29:59.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.019+0000 7fb60effd640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb5f006b810 0x7fb5f006dcd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb600034000 tx=0x7fb600009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:59.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.023+0000 7fb607fff640 1 -- 172.21.15.134:0/2176376453 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb5f80567c0 con 0x7fb6101dd2e0 2024-02-17T14:29:59.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.189+0000 7fb6155ac640 1 -- 172.21.15.134:0/2176376453 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb61013d160 con 0x7fb5f006b810 2024-02-17T14:29:59.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.199+0000 7fb607fff640 1 -- 172.21.15.134:0/2176376453 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370994 (secure 0 0 0) 0x7fb61013d160 con 0x7fb5f006b810 2024-02-17T14:29:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:29:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-02-17T14:29:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.202+0000 7fb6155ac640 1 -- 172.21.15.134:0/2176376453 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb5f006b810 msgr2=0x7fb5f006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.202+0000 7fb6155ac640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb5f006b810 0x7fb5f006dcd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb600034000 tx=0x7fb600009030 comp rx=0 tx=0).stop 2024-02-17T14:29:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.202+0000 7fb6155ac640 1 -- 172.21.15.134:0/2176376453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6101dd2e0 msgr2=0x7fb6101dd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.202+0000 7fb6155ac640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6101dd2e0 0x7fb6101dd760 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8011a50 tx=0x7fb5f8011f10 comp rx=0 tx=0).stop 2024-02-17T14:29:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.202+0000 7fb6155ac640 1 -- 172.21.15.134:0/2176376453 shutdown_connections 2024-02-17T14:29:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.202+0000 7fb6155ac640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6101333c0 0x7fb610133840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.202+0000 7fb6155ac640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fb5f006b810 0x7fb5f006dcd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.202+0000 7fb6155ac640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6101dd2e0 0x7fb6101dd760 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.202+0000 7fb6155ac640 1 --2- 172.21.15.134:0/2176376453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5fc0039a0 0x7fb610137d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.202+0000 7fb6155ac640 1 -- 172.21.15.134:0/2176376453 >> 172.21.15.134:0/2176376453 conn(0x7fb6100b8270 msgr2=0x7fb610071050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:59.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.203+0000 7fb6155ac640 1 -- 172.21.15.134:0/2176376453 shutdown_connections 2024-02-17T14:29:59.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.203+0000 7fb6155ac640 1 -- 172.21.15.134:0/2176376453 wait complete. 2024-02-17T14:29:59.214 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-02-17T14:29:58.593078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599134,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":215,"num_write_kb":2442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":2531328,"data_stored":2150588,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002946"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877225+0000","last_change":"2024-02-17T14:28:03.069069+0000","last_active":"2024-02-17T14:28:51.877225+0000","last_peered":"2024-02-17T14:28:51.877225+0000","last_clean":"2024-02-17T14:28:51.877225+0000","last_became_active":"2024-02-17T14:28:03.068714+0000","last_became_peered":"2024-02-17T14:28:03.068714+0000","last_unstale":"2024-02-17T14:28:51.877225+0000","last_undegraded":"2024-02-17T14:28:51.877225+0000","last_fullsized":"2024-02-17T14:28:51.877225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:49:37.606508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766915+0000","last_change":"2024-02-17T14:28:03.633277+0000","last_active":"2024-02-17T14:28:51.766915+0000","last_peered":"2024-02-17T14:28:51.766915+0000","last_clean":"2024-02-17T14:28:51.766915+0000","last_became_active":"2024-02-17T14:28:03.631462+0000","last_became_peered":"2024-02-17T14:28:03.631462+0000","last_unstale":"2024-02-17T14:28:51.766915+0000","last_undegraded":"2024-02-17T14:28:51.766915+0000","last_fullsized":"2024-02-17T14:28:51.766915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766084+0000","last_change":"2024-02-17T14:28:07.850214+0000","last_active":"2024-02-17T14:28:51.766084+0000","last_peered":"2024-02-17T14:28:51.766084+0000","last_clean":"2024-02-17T14:28:51.766084+0000","last_became_active":"2024-02-17T14:28:07.849871+0000","last_became_peered":"2024-02-17T14:28:07.849871+0000","last_unstale":"2024-02-17T14:28:51.766084+0000","last_undegraded":"2024-02-17T14:28:51.766084+0000","last_fullsized":"2024-02-17T14:28:51.766084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:46:12.614434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767115+0000","last_change":"2024-02-17T14:28:03.069234+0000","last_active":"2024-02-17T14:28:51.767115+0000","last_peered":"2024-02-17T14:28:51.767115+0000","last_clean":"2024-02-17T14:28:51.767115+0000","last_became_active":"2024-02-17T14:28:03.068978+0000","last_became_peered":"2024-02-17T14:28:03.068978+0000","last_unstale":"2024-02-17T14:28:51.767115+0000","last_undegraded":"2024-02-17T14:28:51.767115+0000","last_fullsized":"2024-02-17T14:28:51.767115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877045+0000","last_change":"2024-02-17T14:28:03.630763+0000","last_active":"2024-02-17T14:28:51.877045+0000","last_peered":"2024-02-17T14:28:51.877045+0000","last_clean":"2024-02-17T14:28:51.877045+0000","last_became_active":"2024-02-17T14:28:03.630517+0000","last_became_peered":"2024-02-17T14:28:03.630517+0000","last_unstale":"2024-02-17T14:28:51.877045+0000","last_undegraded":"2024-02-17T14:28:51.877045+0000","last_fullsized":"2024-02-17T14:28:51.877045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767213+0000","last_change":"2024-02-17T14:28:07.644982+0000","last_active":"2024-02-17T14:28:51.767213+0000","last_peered":"2024-02-17T14:28:51.767213+0000","last_clean":"2024-02-17T14:28:51.767213+0000","last_became_active":"2024-02-17T14:28:07.644458+0000","last_became_peered":"2024-02-17T14:28:07.644458+0000","last_unstale":"2024-02-17T14:28:51.767213+0000","last_undegraded":"2024-02-17T14:28:51.767213+0000","last_fullsized":"2024-02-17T14:28:51.767213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:42.133618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061064+0000","last_change":"2024-02-17T14:28:03.071236+0000","last_active":"2024-02-17T14:28:52.061064+0000","last_peered":"2024-02-17T14:28:52.061064+0000","last_clean":"2024-02-17T14:28:52.061064+0000","last_became_active":"2024-02-17T14:28:03.070955+0000","last_became_peered":"2024-02-17T14:28:03.070955+0000","last_unstale":"2024-02-17T14:28:52.061064+0000","last_undegraded":"2024-02-17T14:28:52.061064+0000","last_fullsized":"2024-02-17T14:28:52.061064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768896+0000","last_change":"2024-02-17T14:28:03.628182+0000","last_active":"2024-02-17T14:28:51.768896+0000","last_peered":"2024-02-17T14:28:51.768896+0000","last_clean":"2024-02-17T14:28:51.768896+0000","last_became_active":"2024-02-17T14:28:03.627865+0000","last_became_peered":"2024-02-17T14:28:03.627865+0000","last_unstale":"2024-02-17T14:28:51.768896+0000","last_undegraded":"2024-02-17T14:28:51.768896+0000","last_fullsized":"2024-02-17T14:28:51.768896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767499+0000","last_change":"2024-02-17T14:28:07.649384+0000","last_active":"2024-02-17T14:28:51.767499+0000","last_peered":"2024-02-17T14:28:51.767499+0000","last_clean":"2024-02-17T14:28:51.767499+0000","last_became_active":"2024-02-17T14:28:07.648936+0000","last_became_peered":"2024-02-17T14:28:07.648936+0000","last_unstale":"2024-02-17T14:28:51.767499+0000","last_undegraded":"2024-02-17T14:28:51.767499+0000","last_fullsized":"2024-02-17T14:28:51.767499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:13.199365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060828+0000","last_change":"2024-02-17T14:28:03.074776+0000","last_active":"2024-02-17T14:28:52.060828+0000","last_peered":"2024-02-17T14:28:52.060828+0000","last_clean":"2024-02-17T14:28:52.060828+0000","last_became_active":"2024-02-17T14:28:03.074490+0000","last_became_peered":"2024-02-17T14:28:03.074490+0000","last_unstale":"2024-02-17T14:28:52.060828+0000","last_undegraded":"2024-02-17T14:28:52.060828+0000","last_fullsized":"2024-02-17T14:28:52.060828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769046+0000","last_change":"2024-02-17T14:28:03.627957+0000","last_active":"2024-02-17T14:28:51.769046+0000","last_peered":"2024-02-17T14:28:51.769046+0000","last_clean":"2024-02-17T14:28:51.769046+0000","last_became_active":"2024-02-17T14:28:03.627675+0000","last_became_peered":"2024-02-17T14:28:03.627675+0000","last_unstale":"2024-02-17T14:28:51.769046+0000","last_undegraded":"2024-02-17T14:28:51.769046+0000","last_fullsized":"2024-02-17T14:28:51.769046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767195+0000","last_change":"2024-02-17T14:28:07.652422+0000","last_active":"2024-02-17T14:28:51.767195+0000","last_peered":"2024-02-17T14:28:51.767195+0000","last_clean":"2024-02-17T14:28:51.767195+0000","last_became_active":"2024-02-17T14:28:07.651946+0000","last_became_peered":"2024-02-17T14:28:07.651946+0000","last_unstale":"2024-02-17T14:28:51.767195+0000","last_undegraded":"2024-02-17T14:28:51.767195+0000","last_fullsized":"2024-02-17T14:28:51.767195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:21.967845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764800+0000","last_change":"2024-02-17T14:28:03.635059+0000","last_active":"2024-02-17T14:28:51.764800+0000","last_peered":"2024-02-17T14:28:51.764800+0000","last_clean":"2024-02-17T14:28:51.764800+0000","last_became_active":"2024-02-17T14:28:03.634759+0000","last_became_peered":"2024-02-17T14:28:03.634759+0000","last_unstale":"2024-02-17T14:28:51.764800+0000","last_undegraded":"2024-02-17T14:28:51.764800+0000","last_fullsized":"2024-02-17T14:28:51.764800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060724+0000","last_change":"2024-02-17T14:28:03.075604+0000","last_active":"2024-02-17T14:28:52.060724+0000","last_peered":"2024-02-17T14:28:52.060724+0000","last_clean":"2024-02-17T14:28:52.060724+0000","last_became_active":"2024-02-17T14:28:03.075329+0000","last_became_peered":"2024-02-17T14:28:03.075329+0000","last_unstale":"2024-02-17T14:28:52.060724+0000","last_undegraded":"2024-02-17T14:28:52.060724+0000","last_fullsized":"2024-02-17T14:28:52.060724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767399+0000","last_change":"2024-02-17T14:28:07.645791+0000","last_active":"2024-02-17T14:28:51.767399+0000","last_peered":"2024-02-17T14:28:51.767399+0000","last_clean":"2024-02-17T14:28:51.767399+0000","last_became_active":"2024-02-17T14:28:07.645418+0000","last_became_peered":"2024-02-17T14:28:07.645418+0000","last_unstale":"2024-02-17T14:28:51.767399+0000","last_undegraded":"2024-02-17T14:28:51.767399+0000","last_fullsized":"2024-02-17T14:28:51.767399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:26.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766726+0000","last_change":"2024-02-17T14:28:03.629378+0000","last_active":"2024-02-17T14:28:51.766726+0000","last_peered":"2024-02-17T14:28:51.766726+0000","last_clean":"2024-02-17T14:28:51.766726+0000","last_became_active":"2024-02-17T14:28:03.629097+0000","last_became_peered":"2024-02-17T14:28:03.629097+0000","last_unstale":"2024-02-17T14:28:51.766726+0000","last_undegraded":"2024-02-17T14:28:51.766726+0000","last_fullsized":"2024-02-17T14:28:51.766726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764993+0000","last_change":"2024-02-17T14:28:03.073579+0000","last_active":"2024-02-17T14:28:51.764993+0000","last_peered":"2024-02-17T14:28:51.764993+0000","last_clean":"2024-02-17T14:28:51.764993+0000","last_became_active":"2024-02-17T14:28:03.073167+0000","last_became_peered":"2024-02-17T14:28:03.073167+0000","last_unstale":"2024-02-17T14:28:51.764993+0000","last_undegraded":"2024-02-17T14:28:51.764993+0000","last_fullsized":"2024-02-17T14:28:51.764993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.773726+0000","last_change":"2024-02-17T14:28:51.773726+0000","last_active":"2024-02-17T14:28:51.773726+0000","last_peered":"2024-02-17T14:28:51.773726+0000","last_clean":"2024-02-17T14:28:51.773726+0000","last_became_active":"2024-02-17T14:28:51.773241+0000","last_became_peered":"2024-02-17T14:28:51.773241+0000","last_unstale":"2024-02-17T14:28:51.773726+0000","last_undegraded":"2024-02-17T14:28:51.773726+0000","last_fullsized":"2024-02-17T14:28:51.773726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:52.959315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766643+0000","last_change":"2024-02-17T14:28:03.628527+0000","last_active":"2024-02-17T14:28:51.766643+0000","last_peered":"2024-02-17T14:28:51.766643+0000","last_clean":"2024-02-17T14:28:51.766643+0000","last_became_active":"2024-02-17T14:28:03.628274+0000","last_became_peered":"2024-02-17T14:28:03.628274+0000","last_unstale":"2024-02-17T14:28:51.766643+0000","last_undegraded":"2024-02-17T14:28:51.766643+0000","last_fullsized":"2024-02-17T14:28:51.766643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765165+0000","last_change":"2024-02-17T14:28:03.072317+0000","last_active":"2024-02-17T14:28:51.765165+0000","last_peered":"2024-02-17T14:28:51.765165+0000","last_clean":"2024-02-17T14:28:51.765165+0000","last_became_active":"2024-02-17T14:28:03.072016+0000","last_became_peered":"2024-02-17T14:28:03.072016+0000","last_unstale":"2024-02-17T14:28:51.765165+0000","last_undegraded":"2024-02-17T14:28:51.765165+0000","last_fullsized":"2024-02-17T14:28:51.765165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764228+0000","last_change":"2024-02-17T14:28:07.851022+0000","last_active":"2024-02-17T14:28:51.764228+0000","last_peered":"2024-02-17T14:28:51.764228+0000","last_clean":"2024-02-17T14:28:51.764228+0000","last_became_active":"2024-02-17T14:28:07.850379+0000","last_became_peered":"2024-02-17T14:28:07.850379+0000","last_unstale":"2024-02-17T14:28:51.764228+0000","last_undegraded":"2024-02-17T14:28:51.764228+0000","last_fullsized":"2024-02-17T14:28:51.764228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768008+0000","last_change":"2024-02-17T14:28:03.624798+0000","last_active":"2024-02-17T14:28:51.768008+0000","last_peered":"2024-02-17T14:28:51.768008+0000","last_clean":"2024-02-17T14:28:51.768008+0000","last_became_active":"2024-02-17T14:28:03.624517+0000","last_became_peered":"2024-02-17T14:28:03.624517+0000","last_unstale":"2024-02-17T14:28:51.768008+0000","last_undegraded":"2024-02-17T14:28:51.768008+0000","last_fullsized":"2024-02-17T14:28:51.768008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:40.637145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060517+0000","last_change":"2024-02-17T14:28:03.072806+0000","last_active":"2024-02-17T14:28:52.060517+0000","last_peered":"2024-02-17T14:28:52.060517+0000","last_clean":"2024-02-17T14:28:52.060517+0000","last_became_active":"2024-02-17T14:28:03.072490+0000","last_became_peered":"2024-02-17T14:28:03.072490+0000","last_unstale":"2024-02-17T14:28:52.060517+0000","last_undegraded":"2024-02-17T14:28:52.060517+0000","last_fullsized":"2024-02-17T14:28:52.060517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.774116+0000","last_change":"2024-02-17T14:28:51.774116+0000","last_active":"2024-02-17T14:28:51.774116+0000","last_peered":"2024-02-17T14:28:51.774116+0000","last_clean":"2024-02-17T14:28:51.774116+0000","last_became_active":"2024-02-17T14:28:51.773478+0000","last_became_peered":"2024-02-17T14:28:51.773478+0000","last_unstale":"2024-02-17T14:28:51.774116+0000","last_undegraded":"2024-02-17T14:28:51.774116+0000","last_fullsized":"2024-02-17T14:28:51.774116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:00.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877331+0000","last_change":"2024-02-17T14:28:03.629190+0000","last_active":"2024-02-17T14:28:51.877331+0000","last_peered":"2024-02-17T14:28:51.877331+0000","last_clean":"2024-02-17T14:28:51.877331+0000","last_became_active":"2024-02-17T14:28:03.628777+0000","last_became_peered":"2024-02-17T14:28:03.628777+0000","last_unstale":"2024-02-17T14:28:51.877331+0000","last_undegraded":"2024-02-17T14:28:51.877331+0000","last_fullsized":"2024-02-17T14:28:51.877331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766033+0000","last_change":"2024-02-17T14:28:03.071097+0000","last_active":"2024-02-17T14:28:51.766033+0000","last_peered":"2024-02-17T14:28:51.766033+0000","last_clean":"2024-02-17T14:28:51.766033+0000","last_became_active":"2024-02-17T14:28:03.070790+0000","last_became_peered":"2024-02-17T14:28:03.070790+0000","last_unstale":"2024-02-17T14:28:51.766033+0000","last_undegraded":"2024-02-17T14:28:51.766033+0000","last_fullsized":"2024-02-17T14:28:51.766033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767459+0000","last_change":"2024-02-17T14:28:07.849764+0000","last_active":"2024-02-17T14:28:51.767459+0000","last_peered":"2024-02-17T14:28:51.767459+0000","last_clean":"2024-02-17T14:28:51.767459+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:51.767459+0000","last_undegraded":"2024-02-17T14:28:51.767459+0000","last_fullsized":"2024-02-17T14:28:51.767459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767308+0000","last_change":"2024-02-17T14:28:03.641818+0000","last_active":"2024-02-17T14:28:51.767308+0000","last_peered":"2024-02-17T14:28:51.767308+0000","last_clean":"2024-02-17T14:28:51.767308+0000","last_became_active":"2024-02-17T14:28:03.641577+0000","last_became_peered":"2024-02-17T14:28:03.641577+0000","last_unstale":"2024-02-17T14:28:51.767308+0000","last_undegraded":"2024-02-17T14:28:51.767308+0000","last_fullsized":"2024-02-17T14:28:51.767308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765366+0000","last_change":"2024-02-17T14:28:03.072074+0000","last_active":"2024-02-17T14:28:51.765366+0000","last_peered":"2024-02-17T14:28:51.765366+0000","last_clean":"2024-02-17T14:28:51.765366+0000","last_became_active":"2024-02-17T14:28:03.071850+0000","last_became_peered":"2024-02-17T14:28:03.071850+0000","last_unstale":"2024-02-17T14:28:51.765366+0000","last_undegraded":"2024-02-17T14:28:51.765366+0000","last_fullsized":"2024-02-17T14:28:51.765366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.062350+0000","last_change":"2024-02-17T14:28:52.062350+0000","last_active":"2024-02-17T14:28:52.062350+0000","last_peered":"2024-02-17T14:28:52.062350+0000","last_clean":"2024-02-17T14:28:52.062350+0000","last_became_active":"2024-02-17T14:28:52.061827+0000","last_became_peered":"2024-02-17T14:28:52.061827+0000","last_unstale":"2024-02-17T14:28:52.062350+0000","last_undegraded":"2024-02-17T14:28:52.062350+0000","last_fullsized":"2024-02-17T14:28:52.062350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:55:43.813329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764924+0000","last_change":"2024-02-17T14:28:03.632265+0000","last_active":"2024-02-17T14:28:51.764924+0000","last_peered":"2024-02-17T14:28:51.764924+0000","last_clean":"2024-02-17T14:28:51.764924+0000","last_became_active":"2024-02-17T14:28:03.632020+0000","last_became_peered":"2024-02-17T14:28:03.632020+0000","last_unstale":"2024-02-17T14:28:51.764924+0000","last_undegraded":"2024-02-17T14:28:51.764924+0000","last_fullsized":"2024-02-17T14:28:51.764924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061173+0000","last_change":"2024-02-17T14:28:03.072252+0000","last_active":"2024-02-17T14:28:52.061173+0000","last_peered":"2024-02-17T14:28:52.061173+0000","last_clean":"2024-02-17T14:28:52.061173+0000","last_became_active":"2024-02-17T14:28:03.071830+0000","last_became_peered":"2024-02-17T14:28:03.071830+0000","last_unstale":"2024-02-17T14:28:52.061173+0000","last_undegraded":"2024-02-17T14:28:52.061173+0000","last_fullsized":"2024-02-17T14:28:52.061173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:24.870956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876708+0000","last_change":"2024-02-17T14:28:07.849579+0000","last_active":"2024-02-17T14:28:51.876708+0000","last_peered":"2024-02-17T14:28:51.876708+0000","last_clean":"2024-02-17T14:28:51.876708+0000","last_became_active":"2024-02-17T14:28:07.849212+0000","last_became_peered":"2024-02-17T14:28:07.849212+0000","last_unstale":"2024-02-17T14:28:51.876708+0000","last_undegraded":"2024-02-17T14:28:51.876708+0000","last_fullsized":"2024-02-17T14:28:51.876708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769189+0000","last_change":"2024-02-17T14:28:03.626429+0000","last_active":"2024-02-17T14:28:51.769189+0000","last_peered":"2024-02-17T14:28:51.769189+0000","last_clean":"2024-02-17T14:28:51.769189+0000","last_became_active":"2024-02-17T14:28:03.626174+0000","last_became_peered":"2024-02-17T14:28:03.626174+0000","last_unstale":"2024-02-17T14:28:51.769189+0000","last_undegraded":"2024-02-17T14:28:51.769189+0000","last_fullsized":"2024-02-17T14:28:51.769189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765010+0000","last_change":"2024-02-17T14:28:03.068443+0000","last_active":"2024-02-17T14:28:51.765010+0000","last_peered":"2024-02-17T14:28:51.765010+0000","last_clean":"2024-02-17T14:28:51.765010+0000","last_became_active":"2024-02-17T14:28:03.068179+0000","last_became_peered":"2024-02-17T14:28:03.068179+0000","last_unstale":"2024-02-17T14:28:51.765010+0000","last_undegraded":"2024-02-17T14:28:51.765010+0000","last_fullsized":"2024-02-17T14:28:51.765010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764207+0000","last_change":"2024-02-17T14:28:07.650015+0000","last_active":"2024-02-17T14:28:51.764207+0000","last_peered":"2024-02-17T14:28:51.764207+0000","last_clean":"2024-02-17T14:28:51.764207+0000","last_became_active":"2024-02-17T14:28:07.647918+0000","last_became_peered":"2024-02-17T14:28:07.647918+0000","last_unstale":"2024-02-17T14:28:51.764207+0000","last_undegraded":"2024-02-17T14:28:51.764207+0000","last_fullsized":"2024-02-17T14:28:51.764207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767904+0000","last_change":"2024-02-17T14:28:03.629343+0000","last_active":"2024-02-17T14:28:51.767904+0000","last_peered":"2024-02-17T14:28:51.767904+0000","last_clean":"2024-02-17T14:28:51.767904+0000","last_became_active":"2024-02-17T14:28:03.629077+0000","last_became_peered":"2024-02-17T14:28:03.629077+0000","last_unstale":"2024-02-17T14:28:51.767904+0000","last_undegraded":"2024-02-17T14:28:51.767904+0000","last_fullsized":"2024-02-17T14:28:51.767904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:36.441335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769239+0000","last_change":"2024-02-17T14:28:03.069178+0000","last_active":"2024-02-17T14:28:51.769239+0000","last_peered":"2024-02-17T14:28:51.769239+0000","last_clean":"2024-02-17T14:28:51.769239+0000","last_became_active":"2024-02-17T14:28:03.068923+0000","last_became_peered":"2024-02-17T14:28:03.068923+0000","last_unstale":"2024-02-17T14:28:51.769239+0000","last_undegraded":"2024-02-17T14:28:51.769239+0000","last_fullsized":"2024-02-17T14:28:51.769239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764806+0000","last_change":"2024-02-17T14:28:07.648757+0000","last_active":"2024-02-17T14:28:51.764806+0000","last_peered":"2024-02-17T14:28:51.764806+0000","last_clean":"2024-02-17T14:28:51.764806+0000","last_became_active":"2024-02-17T14:28:07.645156+0000","last_became_peered":"2024-02-17T14:28:07.645156+0000","last_unstale":"2024-02-17T14:28:51.764806+0000","last_undegraded":"2024-02-17T14:28:51.764806+0000","last_fullsized":"2024-02-17T14:28:51.764806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764279+0000","last_change":"2024-02-17T14:28:03.627479+0000","last_active":"2024-02-17T14:28:51.764279+0000","last_peered":"2024-02-17T14:28:51.764279+0000","last_clean":"2024-02-17T14:28:51.764279+0000","last_became_active":"2024-02-17T14:28:03.627165+0000","last_became_peered":"2024-02-17T14:28:03.627165+0000","last_unstale":"2024-02-17T14:28:51.764279+0000","last_undegraded":"2024-02-17T14:28:51.764279+0000","last_fullsized":"2024-02-17T14:28:51.764279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.763758+0000","last_change":"2024-02-17T14:28:03.066452+0000","last_active":"2024-02-17T14:28:51.763758+0000","last_peered":"2024-02-17T14:28:51.763758+0000","last_clean":"2024-02-17T14:28:51.763758+0000","last_became_active":"2024-02-17T14:28:03.066156+0000","last_became_peered":"2024-02-17T14:28:03.066156+0000","last_unstale":"2024-02-17T14:28:51.763758+0000","last_undegraded":"2024-02-17T14:28:51.763758+0000","last_fullsized":"2024-02-17T14:28:51.763758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764316+0000","last_change":"2024-02-17T14:28:07.649765+0000","last_active":"2024-02-17T14:28:51.764316+0000","last_peered":"2024-02-17T14:28:51.764316+0000","last_clean":"2024-02-17T14:28:51.764316+0000","last_became_active":"2024-02-17T14:28:07.649403+0000","last_became_peered":"2024-02-17T14:28:07.649403+0000","last_unstale":"2024-02-17T14:28:51.764316+0000","last_undegraded":"2024-02-17T14:28:51.764316+0000","last_fullsized":"2024-02-17T14:28:51.764316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876601+0000","last_change":"2024-02-17T14:28:03.629628+0000","last_active":"2024-02-17T14:28:51.876601+0000","last_peered":"2024-02-17T14:28:51.876601+0000","last_clean":"2024-02-17T14:28:51.876601+0000","last_became_active":"2024-02-17T14:28:03.629247+0000","last_became_peered":"2024-02-17T14:28:03.629247+0000","last_unstale":"2024-02-17T14:28:51.876601+0000","last_undegraded":"2024-02-17T14:28:51.876601+0000","last_fullsized":"2024-02-17T14:28:51.876601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:00:51.336643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060538+0000","last_change":"2024-02-17T14:28:03.072090+0000","last_active":"2024-02-17T14:28:52.060538+0000","last_peered":"2024-02-17T14:28:52.060538+0000","last_clean":"2024-02-17T14:28:52.060538+0000","last_became_active":"2024-02-17T14:28:03.071778+0000","last_became_peered":"2024-02-17T14:28:03.071778+0000","last_unstale":"2024-02-17T14:28:52.060538+0000","last_undegraded":"2024-02-17T14:28:52.060538+0000","last_fullsized":"2024-02-17T14:28:52.060538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877170+0000","last_change":"2024-02-17T14:28:07.850472+0000","last_active":"2024-02-17T14:28:51.877170+0000","last_peered":"2024-02-17T14:28:51.877170+0000","last_clean":"2024-02-17T14:28:51.877170+0000","last_became_active":"2024-02-17T14:28:07.850106+0000","last_became_peered":"2024-02-17T14:28:07.850106+0000","last_unstale":"2024-02-17T14:28:51.877170+0000","last_undegraded":"2024-02-17T14:28:51.877170+0000","last_fullsized":"2024-02-17T14:28:51.877170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766517+0000","last_change":"2024-02-17T14:28:03.635109+0000","last_active":"2024-02-17T14:28:51.766517+0000","last_peered":"2024-02-17T14:28:51.766517+0000","last_clean":"2024-02-17T14:28:51.766517+0000","last_became_active":"2024-02-17T14:28:03.634570+0000","last_became_peered":"2024-02-17T14:28:03.634570+0000","last_unstale":"2024-02-17T14:28:51.766517+0000","last_undegraded":"2024-02-17T14:28:51.766517+0000","last_fullsized":"2024-02-17T14:28:51.766517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768818+0000","last_change":"2024-02-17T14:28:03.061647+0000","last_active":"2024-02-17T14:28:51.768818+0000","last_peered":"2024-02-17T14:28:51.768818+0000","last_clean":"2024-02-17T14:28:51.768818+0000","last_became_active":"2024-02-17T14:28:03.061026+0000","last_became_peered":"2024-02-17T14:28:03.061026+0000","last_unstale":"2024-02-17T14:28:51.768818+0000","last_undegraded":"2024-02-17T14:28:51.768818+0000","last_fullsized":"2024-02-17T14:28:51.768818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060684+0000","last_change":"2024-02-17T14:28:00.253131+0000","last_active":"2024-02-17T14:28:52.060684+0000","last_peered":"2024-02-17T14:28:52.060684+0000","last_clean":"2024-02-17T14:28:52.060684+0000","last_became_active":"2024-02-17T14:28:00.252180+0000","last_became_peered":"2024-02-17T14:28:00.252180+0000","last_unstale":"2024-02-17T14:28:52.060684+0000","last_undegraded":"2024-02-17T14:28:52.060684+0000","last_fullsized":"2024-02-17T14:28:52.060684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_clean_scrub_stamp":"2024-02-17T14:27:59.037303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:48.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764838+0000","last_change":"2024-02-17T14:28:07.849676+0000","last_active":"2024-02-17T14:28:51.764838+0000","last_peered":"2024-02-17T14:28:51.764838+0000","last_clean":"2024-02-17T14:28:51.764838+0000","last_became_active":"2024-02-17T14:28:07.849264+0000","last_became_peered":"2024-02-17T14:28:07.849264+0000","last_unstale":"2024-02-17T14:28:51.764838+0000","last_undegraded":"2024-02-17T14:28:51.764838+0000","last_fullsized":"2024-02-17T14:28:51.764838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060912+0000","last_change":"2024-02-17T14:28:03.642433+0000","last_active":"2024-02-17T14:28:52.060912+0000","last_peered":"2024-02-17T14:28:52.060912+0000","last_clean":"2024-02-17T14:28:52.060912+0000","last_became_active":"2024-02-17T14:28:03.641815+0000","last_became_peered":"2024-02-17T14:28:03.641815+0000","last_unstale":"2024-02-17T14:28:52.060912+0000","last_undegraded":"2024-02-17T14:28:52.060912+0000","last_fullsized":"2024-02-17T14:28:52.060912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:38.398272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764481+0000","last_change":"2024-02-17T14:28:03.066483+0000","last_active":"2024-02-17T14:28:51.764481+0000","last_peered":"2024-02-17T14:28:51.764481+0000","last_clean":"2024-02-17T14:28:51.764481+0000","last_became_active":"2024-02-17T14:28:03.066169+0000","last_became_peered":"2024-02-17T14:28:03.066169+0000","last_unstale":"2024-02-17T14:28:51.764481+0000","last_undegraded":"2024-02-17T14:28:51.764481+0000","last_fullsized":"2024-02-17T14:28:51.764481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764767+0000","last_change":"2024-02-17T14:28:07.846685+0000","last_active":"2024-02-17T14:28:51.764767+0000","last_peered":"2024-02-17T14:28:51.764767+0000","last_clean":"2024-02-17T14:28:51.764767+0000","last_became_active":"2024-02-17T14:28:07.846265+0000","last_became_peered":"2024-02-17T14:28:07.846265+0000","last_unstale":"2024-02-17T14:28:51.764767+0000","last_undegraded":"2024-02-17T14:28:51.764767+0000","last_fullsized":"2024-02-17T14:28:51.764767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769117+0000","last_change":"2024-02-17T14:28:03.634574+0000","last_active":"2024-02-17T14:28:51.769117+0000","last_peered":"2024-02-17T14:28:51.769117+0000","last_clean":"2024-02-17T14:28:51.769117+0000","last_became_active":"2024-02-17T14:28:03.634290+0000","last_became_peered":"2024-02-17T14:28:03.634290+0000","last_unstale":"2024-02-17T14:28:51.769117+0000","last_undegraded":"2024-02-17T14:28:51.769117+0000","last_fullsized":"2024-02-17T14:28:51.769117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765080+0000","last_change":"2024-02-17T14:28:03.072793+0000","last_active":"2024-02-17T14:28:51.765080+0000","last_peered":"2024-02-17T14:28:51.765080+0000","last_clean":"2024-02-17T14:28:51.765080+0000","last_became_active":"2024-02-17T14:28:03.072497+0000","last_became_peered":"2024-02-17T14:28:03.072497+0000","last_unstale":"2024-02-17T14:28:51.765080+0000","last_undegraded":"2024-02-17T14:28:51.765080+0000","last_fullsized":"2024-02-17T14:28:51.765080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876966+0000","last_change":"2024-02-17T14:28:07.651730+0000","last_active":"2024-02-17T14:28:51.876966+0000","last_peered":"2024-02-17T14:28:51.876966+0000","last_clean":"2024-02-17T14:28:51.876966+0000","last_became_active":"2024-02-17T14:28:07.651144+0000","last_became_peered":"2024-02-17T14:28:07.651144+0000","last_unstale":"2024-02-17T14:28:51.876966+0000","last_undegraded":"2024-02-17T14:28:51.876966+0000","last_fullsized":"2024-02-17T14:28:51.876966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061174+0000","last_change":"2024-02-17T14:28:03.643461+0000","last_active":"2024-02-17T14:28:52.061174+0000","last_peered":"2024-02-17T14:28:52.061174+0000","last_clean":"2024-02-17T14:28:52.061174+0000","last_became_active":"2024-02-17T14:28:03.643033+0000","last_became_peered":"2024-02-17T14:28:03.643033+0000","last_unstale":"2024-02-17T14:28:52.061174+0000","last_undegraded":"2024-02-17T14:28:52.061174+0000","last_fullsized":"2024-02-17T14:28:52.061174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:01.946139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764369+0000","last_change":"2024-02-17T14:28:03.067046+0000","last_active":"2024-02-17T14:28:51.764369+0000","last_peered":"2024-02-17T14:28:51.764369+0000","last_clean":"2024-02-17T14:28:51.764369+0000","last_became_active":"2024-02-17T14:28:03.066797+0000","last_became_peered":"2024-02-17T14:28:03.066797+0000","last_unstale":"2024-02-17T14:28:51.764369+0000","last_undegraded":"2024-02-17T14:28:51.764369+0000","last_fullsized":"2024-02-17T14:28:51.764369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768577+0000","last_change":"2024-02-17T14:28:07.850145+0000","last_active":"2024-02-17T14:28:51.768577+0000","last_peered":"2024-02-17T14:28:51.768577+0000","last_clean":"2024-02-17T14:28:51.768577+0000","last_became_active":"2024-02-17T14:28:07.849280+0000","last_became_peered":"2024-02-17T14:28:07.849280+0000","last_unstale":"2024-02-17T14:28:51.768577+0000","last_undegraded":"2024-02-17T14:28:51.768577+0000","last_fullsized":"2024-02-17T14:28:51.768577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061064+0000","last_change":"2024-02-17T14:28:03.641357+0000","last_active":"2024-02-17T14:28:52.061064+0000","last_peered":"2024-02-17T14:28:52.061064+0000","last_clean":"2024-02-17T14:28:52.061064+0000","last_became_active":"2024-02-17T14:28:03.640945+0000","last_became_peered":"2024-02-17T14:28:03.640945+0000","last_unstale":"2024-02-17T14:28:52.061064+0000","last_undegraded":"2024-02-17T14:28:52.061064+0000","last_fullsized":"2024-02-17T14:28:52.061064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767772+0000","last_change":"2024-02-17T14:28:03.066640+0000","last_active":"2024-02-17T14:28:51.767772+0000","last_peered":"2024-02-17T14:28:51.767772+0000","last_clean":"2024-02-17T14:28:51.767772+0000","last_became_active":"2024-02-17T14:28:03.066350+0000","last_became_peered":"2024-02-17T14:28:03.066350+0000","last_unstale":"2024-02-17T14:28:51.767772+0000","last_undegraded":"2024-02-17T14:28:51.767772+0000","last_fullsized":"2024-02-17T14:28:51.767772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:43.162911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767064+0000","last_change":"2024-02-17T14:28:07.652490+0000","last_active":"2024-02-17T14:28:51.767064+0000","last_peered":"2024-02-17T14:28:51.767064+0000","last_clean":"2024-02-17T14:28:51.767064+0000","last_became_active":"2024-02-17T14:28:07.652088+0000","last_became_peered":"2024-02-17T14:28:07.652088+0000","last_unstale":"2024-02-17T14:28:51.767064+0000","last_undegraded":"2024-02-17T14:28:51.767064+0000","last_fullsized":"2024-02-17T14:28:51.767064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:41.975941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.770874+0000","last_change":"2024-02-17T14:28:51.770495+0000","last_active":"2024-02-17T14:28:51.770874+0000","last_peered":"2024-02-17T14:28:51.770874+0000","last_clean":"2024-02-17T14:28:51.770874+0000","last_became_active":"2024-02-17T14:28:51.770241+0000","last_became_peered":"2024-02-17T14:28:51.770241+0000","last_unstale":"2024-02-17T14:28:51.770874+0000","last_undegraded":"2024-02-17T14:28:51.770874+0000","last_fullsized":"2024-02-17T14:28:51.770874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:24:37.784887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.763658+0000","last_change":"2024-02-17T14:28:03.070146+0000","last_active":"2024-02-17T14:28:51.763658+0000","last_peered":"2024-02-17T14:28:51.763658+0000","last_clean":"2024-02-17T14:28:51.763658+0000","last_became_active":"2024-02-17T14:28:03.069867+0000","last_became_peered":"2024-02-17T14:28:03.069867+0000","last_unstale":"2024-02-17T14:28:51.763658+0000","last_undegraded":"2024-02-17T14:28:51.763658+0000","last_fullsized":"2024-02-17T14:28:51.763658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877077+0000","last_change":"2024-02-17T14:28:07.644792+0000","last_active":"2024-02-17T14:28:51.877077+0000","last_peered":"2024-02-17T14:28:51.877077+0000","last_clean":"2024-02-17T14:28:51.877077+0000","last_became_active":"2024-02-17T14:28:07.644452+0000","last_became_peered":"2024-02-17T14:28:07.644452+0000","last_unstale":"2024-02-17T14:28:51.877077+0000","last_undegraded":"2024-02-17T14:28:51.877077+0000","last_fullsized":"2024-02-17T14:28:51.877077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764787+0000","last_change":"2024-02-17T14:28:03.630962+0000","last_active":"2024-02-17T14:28:51.764787+0000","last_peered":"2024-02-17T14:28:51.764787+0000","last_clean":"2024-02-17T14:28:51.764787+0000","last_became_active":"2024-02-17T14:28:03.630239+0000","last_became_peered":"2024-02-17T14:28:03.630239+0000","last_unstale":"2024-02-17T14:28:51.764787+0000","last_undegraded":"2024-02-17T14:28:51.764787+0000","last_fullsized":"2024-02-17T14:28:51.764787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764895+0000","last_change":"2024-02-17T14:28:03.073091+0000","last_active":"2024-02-17T14:28:51.764895+0000","last_peered":"2024-02-17T14:28:51.764895+0000","last_clean":"2024-02-17T14:28:51.764895+0000","last_became_active":"2024-02-17T14:28:03.072801+0000","last_became_peered":"2024-02-17T14:28:03.072801+0000","last_unstale":"2024-02-17T14:28:51.764895+0000","last_undegraded":"2024-02-17T14:28:51.764895+0000","last_fullsized":"2024-02-17T14:28:51.764895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767224+0000","last_change":"2024-02-17T14:28:07.849362+0000","last_active":"2024-02-17T14:28:51.767224+0000","last_peered":"2024-02-17T14:28:51.767224+0000","last_clean":"2024-02-17T14:28:51.767224+0000","last_became_active":"2024-02-17T14:28:07.848991+0000","last_became_peered":"2024-02-17T14:28:07.848991+0000","last_unstale":"2024-02-17T14:28:51.767224+0000","last_undegraded":"2024-02-17T14:28:51.767224+0000","last_fullsized":"2024-02-17T14:28:51.767224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:52.959315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060690+0000","last_change":"2024-02-17T14:28:03.641810+0000","last_active":"2024-02-17T14:28:52.060690+0000","last_peered":"2024-02-17T14:28:52.060690+0000","last_clean":"2024-02-17T14:28:52.060690+0000","last_became_active":"2024-02-17T14:28:03.641501+0000","last_became_peered":"2024-02-17T14:28:03.641501+0000","last_unstale":"2024-02-17T14:28:52.060690+0000","last_undegraded":"2024-02-17T14:28:52.060690+0000","last_fullsized":"2024-02-17T14:28:52.060690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769153+0000","last_change":"2024-02-17T14:28:03.066989+0000","last_active":"2024-02-17T14:28:51.769153+0000","last_peered":"2024-02-17T14:28:51.769153+0000","last_clean":"2024-02-17T14:28:51.769153+0000","last_became_active":"2024-02-17T14:28:03.066538+0000","last_became_peered":"2024-02-17T14:28:03.066538+0000","last_unstale":"2024-02-17T14:28:51.769153+0000","last_undegraded":"2024-02-17T14:28:51.769153+0000","last_fullsized":"2024-02-17T14:28:51.769153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767019+0000","last_change":"2024-02-17T14:28:07.846885+0000","last_active":"2024-02-17T14:28:51.767019+0000","last_peered":"2024-02-17T14:28:51.767019+0000","last_clean":"2024-02-17T14:28:51.767019+0000","last_became_active":"2024-02-17T14:28:07.846413+0000","last_became_peered":"2024-02-17T14:28:07.846413+0000","last_unstale":"2024-02-17T14:28:51.767019+0000","last_undegraded":"2024-02-17T14:28:51.767019+0000","last_fullsized":"2024-02-17T14:28:51.767019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:00.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876797+0000","last_change":"2024-02-17T14:28:03.638054+0000","last_active":"2024-02-17T14:28:51.876797+0000","last_peered":"2024-02-17T14:28:51.876797+0000","last_clean":"2024-02-17T14:28:51.876797+0000","last_became_active":"2024-02-17T14:28:03.637831+0000","last_became_peered":"2024-02-17T14:28:03.637831+0000","last_unstale":"2024-02-17T14:28:51.876797+0000","last_undegraded":"2024-02-17T14:28:51.876797+0000","last_fullsized":"2024-02-17T14:28:51.876797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:11:23.521059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877154+0000","last_change":"2024-02-17T14:28:03.064510+0000","last_active":"2024-02-17T14:28:51.877154+0000","last_peered":"2024-02-17T14:28:51.877154+0000","last_clean":"2024-02-17T14:28:51.877154+0000","last_became_active":"2024-02-17T14:28:03.064226+0000","last_became_peered":"2024-02-17T14:28:03.064226+0000","last_unstale":"2024-02-17T14:28:51.877154+0000","last_undegraded":"2024-02-17T14:28:51.877154+0000","last_fullsized":"2024-02-17T14:28:51.877154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:26:19.467344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769043+0000","last_change":"2024-02-17T14:28:07.849775+0000","last_active":"2024-02-17T14:28:51.769043+0000","last_peered":"2024-02-17T14:28:51.769043+0000","last_clean":"2024-02-17T14:28:51.769043+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:51.769043+0000","last_undegraded":"2024-02-17T14:28:51.769043+0000","last_fullsized":"2024-02-17T14:28:51.769043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060827+0000","last_change":"2024-02-17T14:28:03.642582+0000","last_active":"2024-02-17T14:28:52.060827+0000","last_peered":"2024-02-17T14:28:52.060827+0000","last_clean":"2024-02-17T14:28:52.060827+0000","last_became_active":"2024-02-17T14:28:03.642077+0000","last_became_peered":"2024-02-17T14:28:03.642077+0000","last_unstale":"2024-02-17T14:28:52.060827+0000","last_undegraded":"2024-02-17T14:28:52.060827+0000","last_fullsized":"2024-02-17T14:28:52.060827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'13","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765489+0000","last_change":"2024-02-17T14:28:03.071791+0000","last_active":"2024-02-17T14:28:51.765489+0000","last_peered":"2024-02-17T14:28:51.765489+0000","last_clean":"2024-02-17T14:28:51.765489+0000","last_became_active":"2024-02-17T14:28:03.071303+0000","last_became_peered":"2024-02-17T14:28:03.071303+0000","last_unstale":"2024-02-17T14:28:51.765489+0000","last_undegraded":"2024-02-17T14:28:51.765489+0000","last_fullsized":"2024-02-17T14:28:51.765489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7968,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764804+0000","last_change":"2024-02-17T14:28:07.649531+0000","last_active":"2024-02-17T14:28:51.764804+0000","last_peered":"2024-02-17T14:28:51.764804+0000","last_clean":"2024-02-17T14:28:51.764804+0000","last_became_active":"2024-02-17T14:28:07.645313+0000","last_became_peered":"2024-02-17T14:28:07.645313+0000","last_unstale":"2024-02-17T14:28:51.764804+0000","last_undegraded":"2024-02-17T14:28:51.764804+0000","last_fullsized":"2024-02-17T14:28:51.764804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768488+0000","last_change":"2024-02-17T14:28:03.638812+0000","last_active":"2024-02-17T14:28:51.768488+0000","last_peered":"2024-02-17T14:28:51.768488+0000","last_clean":"2024-02-17T14:28:51.768488+0000","last_became_active":"2024-02-17T14:28:03.637937+0000","last_became_peered":"2024-02-17T14:28:03.637937+0000","last_unstale":"2024-02-17T14:28:51.768488+0000","last_undegraded":"2024-02-17T14:28:51.768488+0000","last_fullsized":"2024-02-17T14:28:51.768488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764994+0000","last_change":"2024-02-17T14:28:03.069972+0000","last_active":"2024-02-17T14:28:51.764994+0000","last_peered":"2024-02-17T14:28:51.764994+0000","last_clean":"2024-02-17T14:28:51.764994+0000","last_became_active":"2024-02-17T14:28:03.069690+0000","last_became_peered":"2024-02-17T14:28:03.069690+0000","last_unstale":"2024-02-17T14:28:51.764994+0000","last_undegraded":"2024-02-17T14:28:51.764994+0000","last_fullsized":"2024-02-17T14:28:51.764994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767677+0000","last_change":"2024-02-17T14:28:07.647825+0000","last_active":"2024-02-17T14:28:51.767677+0000","last_peered":"2024-02-17T14:28:51.767677+0000","last_clean":"2024-02-17T14:28:51.767677+0000","last_became_active":"2024-02-17T14:28:07.647420+0000","last_became_peered":"2024-02-17T14:28:07.647420+0000","last_unstale":"2024-02-17T14:28:51.767677+0000","last_undegraded":"2024-02-17T14:28:51.767677+0000","last_fullsized":"2024-02-17T14:28:51.767677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877199+0000","last_change":"2024-02-17T14:28:03.631000+0000","last_active":"2024-02-17T14:28:51.877199+0000","last_peered":"2024-02-17T14:28:51.877199+0000","last_clean":"2024-02-17T14:28:51.877199+0000","last_became_active":"2024-02-17T14:28:03.630169+0000","last_became_peered":"2024-02-17T14:28:03.630169+0000","last_unstale":"2024-02-17T14:28:51.877199+0000","last_undegraded":"2024-02-17T14:28:51.877199+0000","last_fullsized":"2024-02-17T14:28:51.877199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768929+0000","last_change":"2024-02-17T14:28:03.069911+0000","last_active":"2024-02-17T14:28:51.768929+0000","last_peered":"2024-02-17T14:28:51.768929+0000","last_clean":"2024-02-17T14:28:51.768929+0000","last_became_active":"2024-02-17T14:28:03.069617+0000","last_became_peered":"2024-02-17T14:28:03.069617+0000","last_unstale":"2024-02-17T14:28:51.768929+0000","last_undegraded":"2024-02-17T14:28:51.768929+0000","last_fullsized":"2024-02-17T14:28:51.768929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766539+0000","last_change":"2024-02-17T14:28:07.646742+0000","last_active":"2024-02-17T14:28:51.766539+0000","last_peered":"2024-02-17T14:28:51.766539+0000","last_clean":"2024-02-17T14:28:51.766539+0000","last_became_active":"2024-02-17T14:28:07.646403+0000","last_became_peered":"2024-02-17T14:28:07.646403+0000","last_unstale":"2024-02-17T14:28:51.766539+0000","last_undegraded":"2024-02-17T14:28:51.766539+0000","last_fullsized":"2024-02-17T14:28:51.766539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768969+0000","last_change":"2024-02-17T14:28:03.638522+0000","last_active":"2024-02-17T14:28:51.768969+0000","last_peered":"2024-02-17T14:28:51.768969+0000","last_clean":"2024-02-17T14:28:51.768969+0000","last_became_active":"2024-02-17T14:28:03.638281+0000","last_became_peered":"2024-02-17T14:28:03.638281+0000","last_unstale":"2024-02-17T14:28:51.768969+0000","last_undegraded":"2024-02-17T14:28:51.768969+0000","last_fullsized":"2024-02-17T14:28:51.768969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765890+0000","last_change":"2024-02-17T14:28:03.072855+0000","last_active":"2024-02-17T14:28:51.765890+0000","last_peered":"2024-02-17T14:28:51.765890+0000","last_clean":"2024-02-17T14:28:51.765890+0000","last_became_active":"2024-02-17T14:28:03.072571+0000","last_became_peered":"2024-02-17T14:28:03.072571+0000","last_unstale":"2024-02-17T14:28:51.765890+0000","last_undegraded":"2024-02-17T14:28:51.765890+0000","last_fullsized":"2024-02-17T14:28:51.765890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766155+0000","last_change":"2024-02-17T14:28:07.849448+0000","last_active":"2024-02-17T14:28:51.766155+0000","last_peered":"2024-02-17T14:28:51.766155+0000","last_clean":"2024-02-17T14:28:51.766155+0000","last_became_active":"2024-02-17T14:28:07.849096+0000","last_became_peered":"2024-02-17T14:28:07.849096+0000","last_unstale":"2024-02-17T14:28:51.766155+0000","last_undegraded":"2024-02-17T14:28:51.766155+0000","last_fullsized":"2024-02-17T14:28:51.766155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877222+0000","last_change":"2024-02-17T14:28:07.849485+0000","last_active":"2024-02-17T14:28:51.877222+0000","last_peered":"2024-02-17T14:28:51.877222+0000","last_clean":"2024-02-17T14:28:51.877222+0000","last_became_active":"2024-02-17T14:28:07.849053+0000","last_became_peered":"2024-02-17T14:28:07.849053+0000","last_unstale":"2024-02-17T14:28:51.877222+0000","last_undegraded":"2024-02-17T14:28:51.877222+0000","last_fullsized":"2024-02-17T14:28:51.877222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764697+0000","last_change":"2024-02-17T14:28:03.632467+0000","last_active":"2024-02-17T14:28:51.764697+0000","last_peered":"2024-02-17T14:28:51.764697+0000","last_clean":"2024-02-17T14:28:51.764697+0000","last_became_active":"2024-02-17T14:28:03.632204+0000","last_became_peered":"2024-02-17T14:28:03.632204+0000","last_unstale":"2024-02-17T14:28:51.764697+0000","last_undegraded":"2024-02-17T14:28:51.764697+0000","last_fullsized":"2024-02-17T14:28:51.764697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768859+0000","last_change":"2024-02-17T14:28:03.062682+0000","last_active":"2024-02-17T14:28:51.768859+0000","last_peered":"2024-02-17T14:28:51.768859+0000","last_clean":"2024-02-17T14:28:51.768859+0000","last_became_active":"2024-02-17T14:28:03.062390+0000","last_became_peered":"2024-02-17T14:28:03.062390+0000","last_unstale":"2024-02-17T14:28:51.768859+0000","last_undegraded":"2024-02-17T14:28:51.768859+0000","last_fullsized":"2024-02-17T14:28:51.768859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765690+0000","last_change":"2024-02-17T14:28:07.651004+0000","last_active":"2024-02-17T14:28:51.765690+0000","last_peered":"2024-02-17T14:28:51.765690+0000","last_clean":"2024-02-17T14:28:51.765690+0000","last_became_active":"2024-02-17T14:28:07.650627+0000","last_became_peered":"2024-02-17T14:28:07.650627+0000","last_unstale":"2024-02-17T14:28:51.765690+0000","last_undegraded":"2024-02-17T14:28:51.765690+0000","last_fullsized":"2024-02-17T14:28:51.765690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766582+0000","last_change":"2024-02-17T14:28:03.627978+0000","last_active":"2024-02-17T14:28:51.766582+0000","last_peered":"2024-02-17T14:28:51.766582+0000","last_clean":"2024-02-17T14:28:51.766582+0000","last_became_active":"2024-02-17T14:28:03.627708+0000","last_became_peered":"2024-02-17T14:28:03.627708+0000","last_unstale":"2024-02-17T14:28:51.766582+0000","last_undegraded":"2024-02-17T14:28:51.766582+0000","last_fullsized":"2024-02-17T14:28:51.766582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766317+0000","last_change":"2024-02-17T14:28:03.071479+0000","last_active":"2024-02-17T14:28:51.766317+0000","last_peered":"2024-02-17T14:28:51.766317+0000","last_clean":"2024-02-17T14:28:51.766317+0000","last_became_active":"2024-02-17T14:28:03.071170+0000","last_became_peered":"2024-02-17T14:28:03.071170+0000","last_unstale":"2024-02-17T14:28:51.766317+0000","last_undegraded":"2024-02-17T14:28:51.766317+0000","last_fullsized":"2024-02-17T14:28:51.766317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:03:44.733125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765220+0000","last_change":"2024-02-17T14:28:03.073225+0000","last_active":"2024-02-17T14:28:51.765220+0000","last_peered":"2024-02-17T14:28:51.765220+0000","last_clean":"2024-02-17T14:28:51.765220+0000","last_became_active":"2024-02-17T14:28:03.072928+0000","last_became_peered":"2024-02-17T14:28:03.072928+0000","last_unstale":"2024-02-17T14:28:51.765220+0000","last_undegraded":"2024-02-17T14:28:51.765220+0000","last_fullsized":"2024-02-17T14:28:51.765220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877057+0000","last_change":"2024-02-17T14:28:03.635534+0000","last_active":"2024-02-17T14:28:51.877057+0000","last_peered":"2024-02-17T14:28:51.877057+0000","last_clean":"2024-02-17T14:28:51.877057+0000","last_became_active":"2024-02-17T14:28:03.635362+0000","last_became_peered":"2024-02-17T14:28:03.635362+0000","last_unstale":"2024-02-17T14:28:51.877057+0000","last_undegraded":"2024-02-17T14:28:51.877057+0000","last_fullsized":"2024-02-17T14:28:51.877057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764331+0000","last_change":"2024-02-17T14:28:07.645087+0000","last_active":"2024-02-17T14:28:51.764331+0000","last_peered":"2024-02-17T14:28:51.764331+0000","last_clean":"2024-02-17T14:28:51.764331+0000","last_became_active":"2024-02-17T14:28:07.644637+0000","last_became_peered":"2024-02-17T14:28:07.644637+0000","last_unstale":"2024-02-17T14:28:51.764331+0000","last_undegraded":"2024-02-17T14:28:51.764331+0000","last_fullsized":"2024-02-17T14:28:51.764331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:39.175950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766840+0000","last_change":"2024-02-17T14:28:03.072162+0000","last_active":"2024-02-17T14:28:51.766840+0000","last_peered":"2024-02-17T14:28:51.766840+0000","last_clean":"2024-02-17T14:28:51.766840+0000","last_became_active":"2024-02-17T14:28:03.071112+0000","last_became_peered":"2024-02-17T14:28:03.071112+0000","last_unstale":"2024-02-17T14:28:51.766840+0000","last_undegraded":"2024-02-17T14:28:51.766840+0000","last_fullsized":"2024-02-17T14:28:51.766840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767346+0000","last_change":"2024-02-17T14:28:03.628403+0000","last_active":"2024-02-17T14:28:51.767346+0000","last_peered":"2024-02-17T14:28:51.767346+0000","last_clean":"2024-02-17T14:28:51.767346+0000","last_became_active":"2024-02-17T14:28:03.628144+0000","last_became_peered":"2024-02-17T14:28:03.628144+0000","last_unstale":"2024-02-17T14:28:51.767346+0000","last_undegraded":"2024-02-17T14:28:51.767346+0000","last_fullsized":"2024-02-17T14:28:51.767346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:01.247136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766781+0000","last_change":"2024-02-17T14:28:07.648376+0000","last_active":"2024-02-17T14:28:51.766781+0000","last_peered":"2024-02-17T14:28:51.766781+0000","last_clean":"2024-02-17T14:28:51.766781+0000","last_became_active":"2024-02-17T14:28:07.647491+0000","last_became_peered":"2024-02-17T14:28:07.647491+0000","last_unstale":"2024-02-17T14:28:51.766781+0000","last_undegraded":"2024-02-17T14:28:51.766781+0000","last_fullsized":"2024-02-17T14:28:51.766781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:12.810441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764660+0000","last_change":"2024-02-17T14:28:03.631191+0000","last_active":"2024-02-17T14:28:51.764660+0000","last_peered":"2024-02-17T14:28:51.764660+0000","last_clean":"2024-02-17T14:28:51.764660+0000","last_became_active":"2024-02-17T14:28:03.630662+0000","last_became_peered":"2024-02-17T14:28:03.630662+0000","last_unstale":"2024-02-17T14:28:51.764660+0000","last_undegraded":"2024-02-17T14:28:51.764660+0000","last_fullsized":"2024-02-17T14:28:51.764660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.763722+0000","last_change":"2024-02-17T14:28:03.629028+0000","last_active":"2024-02-17T14:28:51.763722+0000","last_peered":"2024-02-17T14:28:51.763722+0000","last_clean":"2024-02-17T14:28:51.763722+0000","last_became_active":"2024-02-17T14:28:03.628781+0000","last_became_peered":"2024-02-17T14:28:03.628781+0000","last_unstale":"2024-02-17T14:28:51.763722+0000","last_undegraded":"2024-02-17T14:28:51.763722+0000","last_fullsized":"2024-02-17T14:28:51.763722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.773314+0000","last_change":"2024-02-17T14:28:51.773314+0000","last_active":"2024-02-17T14:28:51.773314+0000","last_peered":"2024-02-17T14:28:51.773314+0000","last_clean":"2024-02-17T14:28:51.773314+0000","last_became_active":"2024-02-17T14:28:51.772895+0000","last_became_peered":"2024-02-17T14:28:51.772895+0000","last_unstale":"2024-02-17T14:28:51.773314+0000","last_undegraded":"2024-02-17T14:28:51.773314+0000","last_fullsized":"2024-02-17T14:28:51.773314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:38:01.087874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877051+0000","last_change":"2024-02-17T14:28:03.627122+0000","last_active":"2024-02-17T14:28:51.877051+0000","last_peered":"2024-02-17T14:28:51.877051+0000","last_clean":"2024-02-17T14:28:51.877051+0000","last_became_active":"2024-02-17T14:28:03.626738+0000","last_became_peered":"2024-02-17T14:28:03.626738+0000","last_unstale":"2024-02-17T14:28:51.877051+0000","last_undegraded":"2024-02-17T14:28:51.877051+0000","last_fullsized":"2024-02-17T14:28:51.877051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767120+0000","last_change":"2024-02-17T14:28:03.631182+0000","last_active":"2024-02-17T14:28:51.767120+0000","last_peered":"2024-02-17T14:28:51.767120+0000","last_clean":"2024-02-17T14:28:51.767120+0000","last_became_active":"2024-02-17T14:28:03.630705+0000","last_became_peered":"2024-02-17T14:28:03.630705+0000","last_unstale":"2024-02-17T14:28:51.767120+0000","last_undegraded":"2024-02-17T14:28:51.767120+0000","last_fullsized":"2024-02-17T14:28:51.767120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764857+0000","last_change":"2024-02-17T14:28:03.631731+0000","last_active":"2024-02-17T14:28:51.764857+0000","last_peered":"2024-02-17T14:28:51.764857+0000","last_clean":"2024-02-17T14:28:51.764857+0000","last_became_active":"2024-02-17T14:28:03.631476+0000","last_became_peered":"2024-02-17T14:28:03.631476+0000","last_unstale":"2024-02-17T14:28:51.764857+0000","last_undegraded":"2024-02-17T14:28:51.764857+0000","last_fullsized":"2024-02-17T14:28:51.764857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765932+0000","last_change":"2024-02-17T14:28:03.638716+0000","last_active":"2024-02-17T14:28:51.765932+0000","last_peered":"2024-02-17T14:28:51.765932+0000","last_clean":"2024-02-17T14:28:51.765932+0000","last_became_active":"2024-02-17T14:28:03.638442+0000","last_became_peered":"2024-02-17T14:28:03.638442+0000","last_unstale":"2024-02-17T14:28:51.765932+0000","last_undegraded":"2024-02-17T14:28:51.765932+0000","last_fullsized":"2024-02-17T14:28:51.765932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767252+0000","last_change":"2024-02-17T14:28:03.630945+0000","last_active":"2024-02-17T14:28:51.767252+0000","last_peered":"2024-02-17T14:28:51.767252+0000","last_clean":"2024-02-17T14:28:51.767252+0000","last_became_active":"2024-02-17T14:28:03.630676+0000","last_became_peered":"2024-02-17T14:28:03.630676+0000","last_unstale":"2024-02-17T14:28:51.767252+0000","last_undegraded":"2024-02-17T14:28:51.767252+0000","last_fullsized":"2024-02-17T14:28:51.767252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768565+0000","last_change":"2024-02-17T14:28:03.627202+0000","last_active":"2024-02-17T14:28:51.768565+0000","last_peered":"2024-02-17T14:28:51.768565+0000","last_clean":"2024-02-17T14:28:51.768565+0000","last_became_active":"2024-02-17T14:28:03.626848+0000","last_became_peered":"2024-02-17T14:28:03.626848+0000","last_unstale":"2024-02-17T14:28:51.768565+0000","last_undegraded":"2024-02-17T14:28:51.768565+0000","last_fullsized":"2024-02-17T14:28:51.768565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766296+0000","last_change":"2024-02-17T14:28:03.627493+0000","last_active":"2024-02-17T14:28:51.766296+0000","last_peered":"2024-02-17T14:28:51.766296+0000","last_clean":"2024-02-17T14:28:51.766296+0000","last_became_active":"2024-02-17T14:28:03.626450+0000","last_became_peered":"2024-02-17T14:28:03.626450+0000","last_unstale":"2024-02-17T14:28:51.766296+0000","last_undegraded":"2024-02-17T14:28:51.766296+0000","last_fullsized":"2024-02-17T14:28:51.766296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768712+0000","last_change":"2024-02-17T14:28:03.639610+0000","last_active":"2024-02-17T14:28:51.768712+0000","last_peered":"2024-02-17T14:28:51.768712+0000","last_clean":"2024-02-17T14:28:51.768712+0000","last_became_active":"2024-02-17T14:28:03.639330+0000","last_became_peered":"2024-02-17T14:28:03.639330+0000","last_unstale":"2024-02-17T14:28:51.768712+0000","last_undegraded":"2024-02-17T14:28:51.768712+0000","last_fullsized":"2024-02-17T14:28:51.768712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876742+0000","last_change":"2024-02-17T14:28:03.641774+0000","last_active":"2024-02-17T14:28:51.876742+0000","last_peered":"2024-02-17T14:28:51.876742+0000","last_clean":"2024-02-17T14:28:51.876742+0000","last_became_active":"2024-02-17T14:28:03.641485+0000","last_became_peered":"2024-02-17T14:28:03.641485+0000","last_unstale":"2024-02-17T14:28:51.876742+0000","last_undegraded":"2024-02-17T14:28:51.876742+0000","last_fullsized":"2024-02-17T14:28:51.876742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765227+0000","last_change":"2024-02-17T14:28:03.630129+0000","last_active":"2024-02-17T14:28:51.765227+0000","last_peered":"2024-02-17T14:28:51.765227+0000","last_clean":"2024-02-17T14:28:51.765227+0000","last_became_active":"2024-02-17T14:28:03.629841+0000","last_became_peered":"2024-02-17T14:28:03.629841+0000","last_unstale":"2024-02-17T14:28:51.765227+0000","last_undegraded":"2024-02-17T14:28:51.765227+0000","last_fullsized":"2024-02-17T14:28:51.765227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061047+0000","last_change":"2024-02-17T14:28:03.642676+0000","last_active":"2024-02-17T14:28:52.061047+0000","last_peered":"2024-02-17T14:28:52.061047+0000","last_clean":"2024-02-17T14:28:52.061047+0000","last_became_active":"2024-02-17T14:28:03.642150+0000","last_became_peered":"2024-02-17T14:28:03.642150+0000","last_unstale":"2024-02-17T14:28:52.061047+0000","last_undegraded":"2024-02-17T14:28:52.061047+0000","last_fullsized":"2024-02-17T14:28:52.061047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764283+0000","last_change":"2024-02-17T14:28:03.632127+0000","last_active":"2024-02-17T14:28:51.764283+0000","last_peered":"2024-02-17T14:28:51.764283+0000","last_clean":"2024-02-17T14:28:51.764283+0000","last_became_active":"2024-02-17T14:28:03.631844+0000","last_became_peered":"2024-02-17T14:28:03.631844+0000","last_unstale":"2024-02-17T14:28:51.764283+0000","last_undegraded":"2024-02-17T14:28:51.764283+0000","last_fullsized":"2024-02-17T14:28:51.764283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:07.756422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.063081+0000","last_change":"2024-02-17T14:28:52.062031+0000","last_active":"2024-02-17T14:28:52.063081+0000","last_peered":"2024-02-17T14:28:52.063081+0000","last_clean":"2024-02-17T14:28:52.063081+0000","last_became_active":"2024-02-17T14:28:52.061682+0000","last_became_peered":"2024-02-17T14:28:52.061682+0000","last_unstale":"2024-02-17T14:28:52.063081+0000","last_undegraded":"2024-02-17T14:28:52.063081+0000","last_fullsized":"2024-02-17T14:28:52.063081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768418+0000","last_change":"2024-02-17T14:28:03.628626+0000","last_active":"2024-02-17T14:28:51.768418+0000","last_peered":"2024-02-17T14:28:51.768418+0000","last_clean":"2024-02-17T14:28:51.768418+0000","last_became_active":"2024-02-17T14:28:03.628343+0000","last_became_peered":"2024-02-17T14:28:03.628343+0000","last_unstale":"2024-02-17T14:28:51.768418+0000","last_undegraded":"2024-02-17T14:28:51.768418+0000","last_fullsized":"2024-02-17T14:28:51.768418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765084+0000","last_change":"2024-02-17T14:28:03.635610+0000","last_active":"2024-02-17T14:28:51.765084+0000","last_peered":"2024-02-17T14:28:51.765084+0000","last_clean":"2024-02-17T14:28:51.765084+0000","last_became_active":"2024-02-17T14:28:03.635340+0000","last_became_peered":"2024-02-17T14:28:03.635340+0000","last_unstale":"2024-02-17T14:28:51.765084+0000","last_undegraded":"2024-02-17T14:28:51.765084+0000","last_fullsized":"2024-02-17T14:28:51.765084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876745+0000","last_change":"2024-02-17T14:28:03.632540+0000","last_active":"2024-02-17T14:28:51.876745+0000","last_peered":"2024-02-17T14:28:51.876745+0000","last_clean":"2024-02-17T14:28:51.876745+0000","last_became_active":"2024-02-17T14:28:03.632273+0000","last_became_peered":"2024-02-17T14:28:03.632273+0000","last_unstale":"2024-02-17T14:28:51.876745+0000","last_undegraded":"2024-02-17T14:28:51.876745+0000","last_fullsized":"2024-02-17T14:28:51.876745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:35.598281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766633+0000","last_change":"2024-02-17T14:28:03.631678+0000","last_active":"2024-02-17T14:28:51.766633+0000","last_peered":"2024-02-17T14:28:51.766633+0000","last_clean":"2024-02-17T14:28:51.766633+0000","last_became_active":"2024-02-17T14:28:03.631431+0000","last_became_peered":"2024-02-17T14:28:03.631431+0000","last_unstale":"2024-02-17T14:28:51.766633+0000","last_undegraded":"2024-02-17T14:28:51.766633+0000","last_fullsized":"2024-02-17T14:28:51.766633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768398+0000","last_change":"2024-02-17T14:28:03.631661+0000","last_active":"2024-02-17T14:28:51.768398+0000","last_peered":"2024-02-17T14:28:51.768398+0000","last_clean":"2024-02-17T14:28:51.768398+0000","last_became_active":"2024-02-17T14:28:03.631379+0000","last_became_peered":"2024-02-17T14:28:03.631379+0000","last_unstale":"2024-02-17T14:28:51.768398+0000","last_undegraded":"2024-02-17T14:28:51.768398+0000","last_fullsized":"2024-02-17T14:28:51.768398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:03.242976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764990+0000","last_change":"2024-02-17T14:28:03.635522+0000","last_active":"2024-02-17T14:28:51.764990+0000","last_peered":"2024-02-17T14:28:51.764990+0000","last_clean":"2024-02-17T14:28:51.764990+0000","last_became_active":"2024-02-17T14:28:03.635254+0000","last_became_peered":"2024-02-17T14:28:03.635254+0000","last_unstale":"2024-02-17T14:28:51.764990+0000","last_undegraded":"2024-02-17T14:28:51.764990+0000","last_fullsized":"2024-02-17T14:28:51.764990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765844+0000","last_change":"2024-02-17T14:28:03.635588+0000","last_active":"2024-02-17T14:28:51.765844+0000","last_peered":"2024-02-17T14:28:51.765844+0000","last_clean":"2024-02-17T14:28:51.765844+0000","last_became_active":"2024-02-17T14:28:03.635312+0000","last_became_peered":"2024-02-17T14:28:03.635312+0000","last_unstale":"2024-02-17T14:28:51.765844+0000","last_undegraded":"2024-02-17T14:28:51.765844+0000","last_fullsized":"2024-02-17T14:28:51.765844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061122+0000","last_change":"2024-02-17T14:28:03.646624+0000","last_active":"2024-02-17T14:28:52.061122+0000","last_peered":"2024-02-17T14:28:52.061122+0000","last_clean":"2024-02-17T14:28:52.061122+0000","last_became_active":"2024-02-17T14:28:03.646337+0000","last_became_peered":"2024-02-17T14:28:03.646337+0000","last_unstale":"2024-02-17T14:28:52.061122+0000","last_undegraded":"2024-02-17T14:28:52.061122+0000","last_fullsized":"2024-02-17T14:28:52.061122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:10.836577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766486+0000","last_change":"2024-02-17T14:28:03.635018+0000","last_active":"2024-02-17T14:28:51.766486+0000","last_peered":"2024-02-17T14:28:51.766486+0000","last_clean":"2024-02-17T14:28:51.766486+0000","last_became_active":"2024-02-17T14:28:03.634751+0000","last_became_peered":"2024-02-17T14:28:03.634751+0000","last_unstale":"2024-02-17T14:28:51.766486+0000","last_undegraded":"2024-02-17T14:28:51.766486+0000","last_fullsized":"2024-02-17T14:28:51.766486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060492+0000","last_change":"2024-02-17T14:28:03.641708+0000","last_active":"2024-02-17T14:28:52.060492+0000","last_peered":"2024-02-17T14:28:52.060492+0000","last_clean":"2024-02-17T14:28:52.060492+0000","last_became_active":"2024-02-17T14:28:03.641260+0000","last_became_peered":"2024-02-17T14:28:03.641260+0000","last_unstale":"2024-02-17T14:28:52.060492+0000","last_undegraded":"2024-02-17T14:28:52.060492+0000","last_fullsized":"2024-02-17T14:28:52.060492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768705+0000","last_change":"2024-02-17T14:28:03.628239+0000","last_active":"2024-02-17T14:28:51.768705+0000","last_peered":"2024-02-17T14:28:51.768705+0000","last_clean":"2024-02-17T14:28:51.768705+0000","last_became_active":"2024-02-17T14:28:03.627918+0000","last_became_peered":"2024-02-17T14:28:03.627918+0000","last_unstale":"2024-02-17T14:28:51.768705+0000","last_undegraded":"2024-02-17T14:28:51.768705+0000","last_fullsized":"2024-02-17T14:28:51.768705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060535+0000","last_change":"2024-02-17T14:28:03.641192+0000","last_active":"2024-02-17T14:28:52.060535+0000","last_peered":"2024-02-17T14:28:52.060535+0000","last_clean":"2024-02-17T14:28:52.060535+0000","last_became_active":"2024-02-17T14:28:03.640873+0000","last_became_peered":"2024-02-17T14:28:03.640873+0000","last_unstale":"2024-02-17T14:28:52.060535+0000","last_undegraded":"2024-02-17T14:28:52.060535+0000","last_fullsized":"2024-02-17T14:28:52.060535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.772451+0000","last_change":"2024-02-17T14:28:51.768174+0000","last_active":"2024-02-17T14:28:51.772451+0000","last_peered":"2024-02-17T14:28:51.772451+0000","last_clean":"2024-02-17T14:28:51.772451+0000","last_became_active":"2024-02-17T14:28:51.767928+0000","last_became_peered":"2024-02-17T14:28:51.767928+0000","last_unstale":"2024-02-17T14:28:51.772451+0000","last_undegraded":"2024-02-17T14:28:51.772451+0000","last_fullsized":"2024-02-17T14:28:51.772451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876904+0000","last_change":"2024-02-17T14:28:03.628223+0000","last_active":"2024-02-17T14:28:51.876904+0000","last_peered":"2024-02-17T14:28:51.876904+0000","last_clean":"2024-02-17T14:28:51.876904+0000","last_became_active":"2024-02-17T14:28:03.627978+0000","last_became_peered":"2024-02-17T14:28:03.627978+0000","last_unstale":"2024-02-17T14:28:51.876904+0000","last_undegraded":"2024-02-17T14:28:51.876904+0000","last_fullsized":"2024-02-17T14:28:51.876904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765384+0000","last_change":"2024-02-17T14:28:03.631742+0000","last_active":"2024-02-17T14:28:51.765384+0000","last_peered":"2024-02-17T14:28:51.765384+0000","last_clean":"2024-02-17T14:28:51.765384+0000","last_became_active":"2024-02-17T14:28:03.631493+0000","last_became_peered":"2024-02-17T14:28:03.631493+0000","last_unstale":"2024-02-17T14:28:51.765384+0000","last_undegraded":"2024-02-17T14:28:51.765384+0000","last_fullsized":"2024-02-17T14:28:51.765384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061037+0000","last_change":"2024-02-17T14:28:03.641525+0000","last_active":"2024-02-17T14:28:52.061037+0000","last_peered":"2024-02-17T14:28:52.061037+0000","last_clean":"2024-02-17T14:28:52.061037+0000","last_became_active":"2024-02-17T14:28:03.641154+0000","last_became_peered":"2024-02-17T14:28:03.641154+0000","last_unstale":"2024-02-17T14:28:52.061037+0000","last_undegraded":"2024-02-17T14:28:52.061037+0000","last_fullsized":"2024-02-17T14:28:52.061037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8766,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":17532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":709990,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.55900000000000005}]},{"osd":1,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.501}]},{"osd":2,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.39200000000000002}]},{"osd":3,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57299999999999995}]},{"osd":4,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58899999999999997}]},{"osd":5,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.628}]},{"osd":6,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":127008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.64500000000000002}]},{"osd":1,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58999999999999997}]},{"osd":2,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.53600000000000003}]},{"osd":4,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.62}]},{"osd":5,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.495}]},{"osd":7,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.443},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.60699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.42399999999999999}]},{"osd":1,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.48399999999999999}]},{"osd":3,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.311}]},{"osd":6,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.33400000000000002}]},{"osd":7,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.45700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":119166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.52400000000000002}]},{"osd":2,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41499999999999998}]},{"osd":5,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.34499999999999997}]},{"osd":6,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.37},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.47599999999999998}]},{"osd":7,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.44700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":127008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.27700000000000002}]},{"osd":1,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.37},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.438},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.39200000000000002}]},{"osd":6,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.496}]},{"osd":7,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":119040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40699999999999997}]},{"osd":3,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32000000000000001}]},{"osd":4,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.61099999999999999}]},{"osd":6,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.629},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.57199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":119200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.375},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.316}]},{"osd":2,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.624},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54700000000000004}]},{"osd":7,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":710046,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.254}]},{"osd":2,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.28899999999999998}]},{"osd":3,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.52700000000000002}]},{"osd":6,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60599999999999998}]},{"osd":7,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":7968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":7968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T14:29:59.221 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T14:29:59.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.355+0000 7f479289d640 1 Processor -- start 2024-02-17T14:29:59.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.355+0000 7f479289d640 1 -- start start 2024-02-17T14:29:59.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.355+0000 7f479289d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f478c0afe40 0x7f478c1461a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.356+0000 7f479289d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f478c1466e0 0x7f478c146af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.356+0000 7f479289d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478c0b57b0 con 0x7f478c06ae10 2024-02-17T14:29:59.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.356+0000 7f479289d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478c0703f0 con 0x7f478c0afe40 2024-02-17T14:29:59.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.356+0000 7f479289d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478c147030 con 0x7f478c1466e0 2024-02-17T14:29:59.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.356+0000 7f478b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f478c0afe40 0x7f478c1461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.356+0000 7f478b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f478c0afe40 0x7f478c1461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42880/0 (socket says 172.21.15.134:42880) 2024-02-17T14:29:59.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.356+0000 7f478b7fe640 1 -- 172.21.15.134:0/444471433 learned_addr learned my addr 172.21.15.134:0/444471433 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:59.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.356+0000 7f4790e3a640 1 --2- 172.21.15.134:0/444471433 >> v2:172.21.15.142:3300/0 conn(0x7f478c1466e0 0x7f478c146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.356+0000 7f478b7fe640 1 -- 172.21.15.134:0/444471433 >> v2:172.21.15.142:3300/0 conn(0x7f478c1466e0 msgr2=0x7f478c146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:59.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.356+0000 7f478b7fe640 1 --2- 172.21.15.134:0/444471433 >> v2:172.21.15.142:3300/0 conn(0x7f478c1466e0 0x7f478c146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.356+0000 7f478b7fe640 1 -- 172.21.15.134:0/444471433 >> v1:172.21.15.142:6789/0 conn(0x7f478c06ae10 legacy=0x7f478c072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:59.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.356+0000 7f478b7fe640 1 -- 172.21.15.134:0/444471433 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c06b1f0 con 0x7f478c0afe40 2024-02-17T14:29:59.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.357+0000 7f478b7fe640 1 --2- 172.21.15.134:0/444471433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c0afe40 0x7f478c1461a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f478c1482c0 tx=0x7f478002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e20efa250262f80 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:59.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.357+0000 7f478affd640 1 -- 172.21.15.134:0/444471433 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47800317e0 con 0x7f478c0afe40 2024-02-17T14:29:59.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.357+0000 7f478affd640 1 -- 172.21.15.134:0/444471433 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4780031940 con 0x7f478c0afe40 2024-02-17T14:29:59.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.357+0000 7f478affd640 1 -- 172.21.15.134:0/444471433 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780031cd0 con 0x7f478c0afe40 2024-02-17T14:29:59.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.357+0000 7f479289d640 1 -- 172.21.15.134:0/444471433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c0afe40 msgr2=0x7f478c1461a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.357+0000 7f479289d640 1 --2- 172.21.15.134:0/444471433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c0afe40 0x7f478c1461a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f478c1482c0 tx=0x7f478002b880 comp rx=0 tx=0).stop 2024-02-17T14:29:59.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.357+0000 7f479289d640 1 -- 172.21.15.134:0/444471433 shutdown_connections 2024-02-17T14:29:59.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.357+0000 7f479289d640 1 --2- 172.21.15.134:0/444471433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c0afe40 0x7f478c1461a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.357+0000 7f479289d640 1 --2- 172.21.15.134:0/444471433 >> v2:172.21.15.142:3300/0 conn(0x7f478c1466e0 0x7f478c146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.357+0000 7f479289d640 1 -- 172.21.15.134:0/444471433 >> 172.21.15.134:0/444471433 conn(0x7f478c0b9310 msgr2=0x7f478c0b9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:59.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.357+0000 7f479289d640 1 -- 172.21.15.134:0/444471433 shutdown_connections 2024-02-17T14:29:59.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.357+0000 7f479289d640 1 -- 172.21.15.134:0/444471433 wait complete. 2024-02-17T14:29:59.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.358+0000 7f479289d640 1 Processor -- start 2024-02-17T14:29:59.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f479289d640 1 -- start start 2024-02-17T14:29:59.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f479289d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f478c06ae10 0x7f478c143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f479289d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c0afe40 0x7f478c144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f479289d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f478c1466e0 0x7f478c13e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f479289d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c142b40 con 0x7f478c0afe40 2024-02-17T14:29:59.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f479289d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c1cd3b0 con 0x7f478c06ae10 2024-02-17T14:29:59.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f479289d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0af3d0 con 0x7f478c1466e0 2024-02-17T14:29:59.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f478b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c0afe40 0x7f478c144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f478b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c0afe40 0x7f478c144620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42882/0 (socket says 172.21.15.134:42882) 2024-02-17T14:29:59.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f478b7fe640 1 -- 172.21.15.134:0/9391572 learned_addr learned my addr 172.21.15.134:0/9391572 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:59.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f478bfff640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f478c06ae10 0x7f478c143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f4790e3a640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f478c1466e0 0x7f478c13e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f478b7fe640 1 -- 172.21.15.134:0/9391572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f478c1466e0 msgr2=0x7f478c13e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f478b7fe640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f478c1466e0 0x7f478c13e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f478b7fe640 1 -- 172.21.15.134:0/9391572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f478c06ae10 msgr2=0x7f478c143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f478b7fe640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f478c06ae10 0x7f478c143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f478b7fe640 1 -- 172.21.15.134:0/9391572 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47800094d0 con 0x7f478c0afe40 2024-02-17T14:29:59.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f478bfff640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f478c06ae10 0x7f478c143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:29:59.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.359+0000 7f4790e3a640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f478c1466e0 0x7f478c13e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:29:59.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.360+0000 7f478b7fe640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c0afe40 0x7f478c144620 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4780000c00 tx=0x7f47800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:59.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.360+0000 7f4788ff9640 1 -- 172.21.15.134:0/9391572 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780032880 con 0x7f478c0afe40 2024-02-17T14:29:59.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.360+0000 7f4788ff9640 1 -- 172.21.15.134:0/9391572 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47800329e0 con 0x7f478c0afe40 2024-02-17T14:29:59.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.360+0000 7f479289d640 1 -- 172.21.15.134:0/9391572 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478c13f1c0 con 0x7f478c0afe40 2024-02-17T14:29:59.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.360+0000 7f4788ff9640 1 -- 172.21.15.134:0/9391572 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780032d90 con 0x7f478c0afe40 2024-02-17T14:29:59.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.360+0000 7f479289d640 1 -- 172.21.15.134:0/9391572 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478c144f70 con 0x7f478c0afe40 2024-02-17T14:29:59.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.361+0000 7f479289d640 1 -- 172.21.15.134:0/9391572 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478c144340 con 0x7f478c0afe40 2024-02-17T14:29:59.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.361+0000 7f4788ff9640 1 -- 172.21.15.134:0/9391572 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f478004d3f0 con 0x7f478c0afe40 2024-02-17T14:29:59.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.362+0000 7f4788ff9640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f477806b810 0x7f477806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.362+0000 7f478bfff640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f477806b810 0x7f477806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.362+0000 7f4788ff9640 1 -- 172.21.15.134:0/9391572 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f47800ac3f0 con 0x7f478c0afe40 2024-02-17T14:29:59.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.362+0000 7f478bfff640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f477806b810 0x7f477806dcd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f477c003e10 tx=0x7f477c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:59.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.366+0000 7f4788ff9640 1 -- 172.21.15.134:0/9391572 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f478c144340 con 0x7f478c0afe40 2024-02-17T14:29:59.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.533+0000 7f479289d640 1 -- 172.21.15.134:0/9391572 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f478c0b5a00 con 0x7f477806b810 2024-02-17T14:29:59.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.542+0000 7f4788ff9640 1 -- 172.21.15.134:0/9391572 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370994 (secure 0 0 0) 0x7f477c003ab0 con 0x7f477806b810 2024-02-17T14:29:59.546 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:29:59.548 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-02-17T14:29:59.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.545+0000 7f479289d640 1 -- 172.21.15.134:0/9391572 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f477806b810 msgr2=0x7f477806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.545+0000 7f479289d640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f477806b810 0x7f477806dcd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f477c003e10 tx=0x7f477c009040 comp rx=0 tx=0).stop 2024-02-17T14:29:59.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.545+0000 7f479289d640 1 -- 172.21.15.134:0/9391572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c0afe40 msgr2=0x7f478c144620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.545+0000 7f479289d640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c0afe40 0x7f478c144620 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4780000c00 tx=0x7f47800046c0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.545+0000 7f479289d640 1 -- 172.21.15.134:0/9391572 shutdown_connections 2024-02-17T14:29:59.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.545+0000 7f479289d640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f478c1466e0 0x7f478c13e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.545+0000 7f479289d640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f477806b810 0x7f477806dcd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.545+0000 7f479289d640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f478c0afe40 0x7f478c144620 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.545+0000 7f479289d640 1 --2- 172.21.15.134:0/9391572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f478c06ae10 0x7f478c143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.545+0000 7f479289d640 1 -- 172.21.15.134:0/9391572 >> 172.21.15.134:0/9391572 conn(0x7f478c0b9310 msgr2=0x7f478c147390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:59.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.545+0000 7f479289d640 1 -- 172.21.15.134:0/9391572 shutdown_connections 2024-02-17T14:29:59.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.545+0000 7f479289d640 1 -- 172.21.15.134:0/9391572 wait complete. 2024-02-17T14:29:59.556 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-02-17T14:29:58.593078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599134,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":215,"num_write_kb":2442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":2531328,"data_stored":2150588,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002946"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877225+0000","last_change":"2024-02-17T14:28:03.069069+0000","last_active":"2024-02-17T14:28:51.877225+0000","last_peered":"2024-02-17T14:28:51.877225+0000","last_clean":"2024-02-17T14:28:51.877225+0000","last_became_active":"2024-02-17T14:28:03.068714+0000","last_became_peered":"2024-02-17T14:28:03.068714+0000","last_unstale":"2024-02-17T14:28:51.877225+0000","last_undegraded":"2024-02-17T14:28:51.877225+0000","last_fullsized":"2024-02-17T14:28:51.877225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:49:37.606508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766915+0000","last_change":"2024-02-17T14:28:03.633277+0000","last_active":"2024-02-17T14:28:51.766915+0000","last_peered":"2024-02-17T14:28:51.766915+0000","last_clean":"2024-02-17T14:28:51.766915+0000","last_became_active":"2024-02-17T14:28:03.631462+0000","last_became_peered":"2024-02-17T14:28:03.631462+0000","last_unstale":"2024-02-17T14:28:51.766915+0000","last_undegraded":"2024-02-17T14:28:51.766915+0000","last_fullsized":"2024-02-17T14:28:51.766915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766084+0000","last_change":"2024-02-17T14:28:07.850214+0000","last_active":"2024-02-17T14:28:51.766084+0000","last_peered":"2024-02-17T14:28:51.766084+0000","last_clean":"2024-02-17T14:28:51.766084+0000","last_became_active":"2024-02-17T14:28:07.849871+0000","last_became_peered":"2024-02-17T14:28:07.849871+0000","last_unstale":"2024-02-17T14:28:51.766084+0000","last_undegraded":"2024-02-17T14:28:51.766084+0000","last_fullsized":"2024-02-17T14:28:51.766084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:46:12.614434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767115+0000","last_change":"2024-02-17T14:28:03.069234+0000","last_active":"2024-02-17T14:28:51.767115+0000","last_peered":"2024-02-17T14:28:51.767115+0000","last_clean":"2024-02-17T14:28:51.767115+0000","last_became_active":"2024-02-17T14:28:03.068978+0000","last_became_peered":"2024-02-17T14:28:03.068978+0000","last_unstale":"2024-02-17T14:28:51.767115+0000","last_undegraded":"2024-02-17T14:28:51.767115+0000","last_fullsized":"2024-02-17T14:28:51.767115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877045+0000","last_change":"2024-02-17T14:28:03.630763+0000","last_active":"2024-02-17T14:28:51.877045+0000","last_peered":"2024-02-17T14:28:51.877045+0000","last_clean":"2024-02-17T14:28:51.877045+0000","last_became_active":"2024-02-17T14:28:03.630517+0000","last_became_peered":"2024-02-17T14:28:03.630517+0000","last_unstale":"2024-02-17T14:28:51.877045+0000","last_undegraded":"2024-02-17T14:28:51.877045+0000","last_fullsized":"2024-02-17T14:28:51.877045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767213+0000","last_change":"2024-02-17T14:28:07.644982+0000","last_active":"2024-02-17T14:28:51.767213+0000","last_peered":"2024-02-17T14:28:51.767213+0000","last_clean":"2024-02-17T14:28:51.767213+0000","last_became_active":"2024-02-17T14:28:07.644458+0000","last_became_peered":"2024-02-17T14:28:07.644458+0000","last_unstale":"2024-02-17T14:28:51.767213+0000","last_undegraded":"2024-02-17T14:28:51.767213+0000","last_fullsized":"2024-02-17T14:28:51.767213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:42.133618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061064+0000","last_change":"2024-02-17T14:28:03.071236+0000","last_active":"2024-02-17T14:28:52.061064+0000","last_peered":"2024-02-17T14:28:52.061064+0000","last_clean":"2024-02-17T14:28:52.061064+0000","last_became_active":"2024-02-17T14:28:03.070955+0000","last_became_peered":"2024-02-17T14:28:03.070955+0000","last_unstale":"2024-02-17T14:28:52.061064+0000","last_undegraded":"2024-02-17T14:28:52.061064+0000","last_fullsized":"2024-02-17T14:28:52.061064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768896+0000","last_change":"2024-02-17T14:28:03.628182+0000","last_active":"2024-02-17T14:28:51.768896+0000","last_peered":"2024-02-17T14:28:51.768896+0000","last_clean":"2024-02-17T14:28:51.768896+0000","last_became_active":"2024-02-17T14:28:03.627865+0000","last_became_peered":"2024-02-17T14:28:03.627865+0000","last_unstale":"2024-02-17T14:28:51.768896+0000","last_undegraded":"2024-02-17T14:28:51.768896+0000","last_fullsized":"2024-02-17T14:28:51.768896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767499+0000","last_change":"2024-02-17T14:28:07.649384+0000","last_active":"2024-02-17T14:28:51.767499+0000","last_peered":"2024-02-17T14:28:51.767499+0000","last_clean":"2024-02-17T14:28:51.767499+0000","last_became_active":"2024-02-17T14:28:07.648936+0000","last_became_peered":"2024-02-17T14:28:07.648936+0000","last_unstale":"2024-02-17T14:28:51.767499+0000","last_undegraded":"2024-02-17T14:28:51.767499+0000","last_fullsized":"2024-02-17T14:28:51.767499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:13.199365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060828+0000","last_change":"2024-02-17T14:28:03.074776+0000","last_active":"2024-02-17T14:28:52.060828+0000","last_peered":"2024-02-17T14:28:52.060828+0000","last_clean":"2024-02-17T14:28:52.060828+0000","last_became_active":"2024-02-17T14:28:03.074490+0000","last_became_peered":"2024-02-17T14:28:03.074490+0000","last_unstale":"2024-02-17T14:28:52.060828+0000","last_undegraded":"2024-02-17T14:28:52.060828+0000","last_fullsized":"2024-02-17T14:28:52.060828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769046+0000","last_change":"2024-02-17T14:28:03.627957+0000","last_active":"2024-02-17T14:28:51.769046+0000","last_peered":"2024-02-17T14:28:51.769046+0000","last_clean":"2024-02-17T14:28:51.769046+0000","last_became_active":"2024-02-17T14:28:03.627675+0000","last_became_peered":"2024-02-17T14:28:03.627675+0000","last_unstale":"2024-02-17T14:28:51.769046+0000","last_undegraded":"2024-02-17T14:28:51.769046+0000","last_fullsized":"2024-02-17T14:28:51.769046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767195+0000","last_change":"2024-02-17T14:28:07.652422+0000","last_active":"2024-02-17T14:28:51.767195+0000","last_peered":"2024-02-17T14:28:51.767195+0000","last_clean":"2024-02-17T14:28:51.767195+0000","last_became_active":"2024-02-17T14:28:07.651946+0000","last_became_peered":"2024-02-17T14:28:07.651946+0000","last_unstale":"2024-02-17T14:28:51.767195+0000","last_undegraded":"2024-02-17T14:28:51.767195+0000","last_fullsized":"2024-02-17T14:28:51.767195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:21.967845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764800+0000","last_change":"2024-02-17T14:28:03.635059+0000","last_active":"2024-02-17T14:28:51.764800+0000","last_peered":"2024-02-17T14:28:51.764800+0000","last_clean":"2024-02-17T14:28:51.764800+0000","last_became_active":"2024-02-17T14:28:03.634759+0000","last_became_peered":"2024-02-17T14:28:03.634759+0000","last_unstale":"2024-02-17T14:28:51.764800+0000","last_undegraded":"2024-02-17T14:28:51.764800+0000","last_fullsized":"2024-02-17T14:28:51.764800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060724+0000","last_change":"2024-02-17T14:28:03.075604+0000","last_active":"2024-02-17T14:28:52.060724+0000","last_peered":"2024-02-17T14:28:52.060724+0000","last_clean":"2024-02-17T14:28:52.060724+0000","last_became_active":"2024-02-17T14:28:03.075329+0000","last_became_peered":"2024-02-17T14:28:03.075329+0000","last_unstale":"2024-02-17T14:28:52.060724+0000","last_undegraded":"2024-02-17T14:28:52.060724+0000","last_fullsized":"2024-02-17T14:28:52.060724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767399+0000","last_change":"2024-02-17T14:28:07.645791+0000","last_active":"2024-02-17T14:28:51.767399+0000","last_peered":"2024-02-17T14:28:51.767399+0000","last_clean":"2024-02-17T14:28:51.767399+0000","last_became_active":"2024-02-17T14:28:07.645418+0000","last_became_peered":"2024-02-17T14:28:07.645418+0000","last_unstale":"2024-02-17T14:28:51.767399+0000","last_undegraded":"2024-02-17T14:28:51.767399+0000","last_fullsized":"2024-02-17T14:28:51.767399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:26.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766726+0000","last_change":"2024-02-17T14:28:03.629378+0000","last_active":"2024-02-17T14:28:51.766726+0000","last_peered":"2024-02-17T14:28:51.766726+0000","last_clean":"2024-02-17T14:28:51.766726+0000","last_became_active":"2024-02-17T14:28:03.629097+0000","last_became_peered":"2024-02-17T14:28:03.629097+0000","last_unstale":"2024-02-17T14:28:51.766726+0000","last_undegraded":"2024-02-17T14:28:51.766726+0000","last_fullsized":"2024-02-17T14:28:51.766726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764993+0000","last_change":"2024-02-17T14:28:03.073579+0000","last_active":"2024-02-17T14:28:51.764993+0000","last_peered":"2024-02-17T14:28:51.764993+0000","last_clean":"2024-02-17T14:28:51.764993+0000","last_became_active":"2024-02-17T14:28:03.073167+0000","last_became_peered":"2024-02-17T14:28:03.073167+0000","last_unstale":"2024-02-17T14:28:51.764993+0000","last_undegraded":"2024-02-17T14:28:51.764993+0000","last_fullsized":"2024-02-17T14:28:51.764993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.773726+0000","last_change":"2024-02-17T14:28:51.773726+0000","last_active":"2024-02-17T14:28:51.773726+0000","last_peered":"2024-02-17T14:28:51.773726+0000","last_clean":"2024-02-17T14:28:51.773726+0000","last_became_active":"2024-02-17T14:28:51.773241+0000","last_became_peered":"2024-02-17T14:28:51.773241+0000","last_unstale":"2024-02-17T14:28:51.773726+0000","last_undegraded":"2024-02-17T14:28:51.773726+0000","last_fullsized":"2024-02-17T14:28:51.773726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:52.959315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766643+0000","last_change":"2024-02-17T14:28:03.628527+0000","last_active":"2024-02-17T14:28:51.766643+0000","last_peered":"2024-02-17T14:28:51.766643+0000","last_clean":"2024-02-17T14:28:51.766643+0000","last_became_active":"2024-02-17T14:28:03.628274+0000","last_became_peered":"2024-02-17T14:28:03.628274+0000","last_unstale":"2024-02-17T14:28:51.766643+0000","last_undegraded":"2024-02-17T14:28:51.766643+0000","last_fullsized":"2024-02-17T14:28:51.766643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765165+0000","last_change":"2024-02-17T14:28:03.072317+0000","last_active":"2024-02-17T14:28:51.765165+0000","last_peered":"2024-02-17T14:28:51.765165+0000","last_clean":"2024-02-17T14:28:51.765165+0000","last_became_active":"2024-02-17T14:28:03.072016+0000","last_became_peered":"2024-02-17T14:28:03.072016+0000","last_unstale":"2024-02-17T14:28:51.765165+0000","last_undegraded":"2024-02-17T14:28:51.765165+0000","last_fullsized":"2024-02-17T14:28:51.765165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764228+0000","last_change":"2024-02-17T14:28:07.851022+0000","last_active":"2024-02-17T14:28:51.764228+0000","last_peered":"2024-02-17T14:28:51.764228+0000","last_clean":"2024-02-17T14:28:51.764228+0000","last_became_active":"2024-02-17T14:28:07.850379+0000","last_became_peered":"2024-02-17T14:28:07.850379+0000","last_unstale":"2024-02-17T14:28:51.764228+0000","last_undegraded":"2024-02-17T14:28:51.764228+0000","last_fullsized":"2024-02-17T14:28:51.764228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768008+0000","last_change":"2024-02-17T14:28:03.624798+0000","last_active":"2024-02-17T14:28:51.768008+0000","last_peered":"2024-02-17T14:28:51.768008+0000","last_clean":"2024-02-17T14:28:51.768008+0000","last_became_active":"2024-02-17T14:28:03.624517+0000","last_became_peered":"2024-02-17T14:28:03.624517+0000","last_unstale":"2024-02-17T14:28:51.768008+0000","last_undegraded":"2024-02-17T14:28:51.768008+0000","last_fullsized":"2024-02-17T14:28:51.768008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:40.637145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060517+0000","last_change":"2024-02-17T14:28:03.072806+0000","last_active":"2024-02-17T14:28:52.060517+0000","last_peered":"2024-02-17T14:28:52.060517+0000","last_clean":"2024-02-17T14:28:52.060517+0000","last_became_active":"2024-02-17T14:28:03.072490+0000","last_became_peered":"2024-02-17T14:28:03.072490+0000","last_unstale":"2024-02-17T14:28:52.060517+0000","last_undegraded":"2024-02-17T14:28:52.060517+0000","last_fullsized":"2024-02-17T14:28:52.060517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.774116+0000","last_change":"2024-02-17T14:28:51.774116+0000","last_active":"2024-02-17T14:28:51.774116+0000","last_peered":"2024-02-17T14:28:51.774116+0000","last_clean":"2024-02-17T14:28:51.774116+0000","last_became_active":"2024-02-17T14:28:51.773478+0000","last_became_peered":"2024-02-17T14:28:51.773478+0000","last_unstale":"2024-02-17T14:28:51.774116+0000","last_undegraded":"2024-02-17T14:28:51.774116+0000","last_fullsized":"2024-02-17T14:28:51.774116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:00.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877331+0000","last_change":"2024-02-17T14:28:03.629190+0000","last_active":"2024-02-17T14:28:51.877331+0000","last_peered":"2024-02-17T14:28:51.877331+0000","last_clean":"2024-02-17T14:28:51.877331+0000","last_became_active":"2024-02-17T14:28:03.628777+0000","last_became_peered":"2024-02-17T14:28:03.628777+0000","last_unstale":"2024-02-17T14:28:51.877331+0000","last_undegraded":"2024-02-17T14:28:51.877331+0000","last_fullsized":"2024-02-17T14:28:51.877331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766033+0000","last_change":"2024-02-17T14:28:03.071097+0000","last_active":"2024-02-17T14:28:51.766033+0000","last_peered":"2024-02-17T14:28:51.766033+0000","last_clean":"2024-02-17T14:28:51.766033+0000","last_became_active":"2024-02-17T14:28:03.070790+0000","last_became_peered":"2024-02-17T14:28:03.070790+0000","last_unstale":"2024-02-17T14:28:51.766033+0000","last_undegraded":"2024-02-17T14:28:51.766033+0000","last_fullsized":"2024-02-17T14:28:51.766033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767459+0000","last_change":"2024-02-17T14:28:07.849764+0000","last_active":"2024-02-17T14:28:51.767459+0000","last_peered":"2024-02-17T14:28:51.767459+0000","last_clean":"2024-02-17T14:28:51.767459+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:51.767459+0000","last_undegraded":"2024-02-17T14:28:51.767459+0000","last_fullsized":"2024-02-17T14:28:51.767459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767308+0000","last_change":"2024-02-17T14:28:03.641818+0000","last_active":"2024-02-17T14:28:51.767308+0000","last_peered":"2024-02-17T14:28:51.767308+0000","last_clean":"2024-02-17T14:28:51.767308+0000","last_became_active":"2024-02-17T14:28:03.641577+0000","last_became_peered":"2024-02-17T14:28:03.641577+0000","last_unstale":"2024-02-17T14:28:51.767308+0000","last_undegraded":"2024-02-17T14:28:51.767308+0000","last_fullsized":"2024-02-17T14:28:51.767308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765366+0000","last_change":"2024-02-17T14:28:03.072074+0000","last_active":"2024-02-17T14:28:51.765366+0000","last_peered":"2024-02-17T14:28:51.765366+0000","last_clean":"2024-02-17T14:28:51.765366+0000","last_became_active":"2024-02-17T14:28:03.071850+0000","last_became_peered":"2024-02-17T14:28:03.071850+0000","last_unstale":"2024-02-17T14:28:51.765366+0000","last_undegraded":"2024-02-17T14:28:51.765366+0000","last_fullsized":"2024-02-17T14:28:51.765366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.062350+0000","last_change":"2024-02-17T14:28:52.062350+0000","last_active":"2024-02-17T14:28:52.062350+0000","last_peered":"2024-02-17T14:28:52.062350+0000","last_clean":"2024-02-17T14:28:52.062350+0000","last_became_active":"2024-02-17T14:28:52.061827+0000","last_became_peered":"2024-02-17T14:28:52.061827+0000","last_unstale":"2024-02-17T14:28:52.062350+0000","last_undegraded":"2024-02-17T14:28:52.062350+0000","last_fullsized":"2024-02-17T14:28:52.062350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:55:43.813329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764924+0000","last_change":"2024-02-17T14:28:03.632265+0000","last_active":"2024-02-17T14:28:51.764924+0000","last_peered":"2024-02-17T14:28:51.764924+0000","last_clean":"2024-02-17T14:28:51.764924+0000","last_became_active":"2024-02-17T14:28:03.632020+0000","last_became_peered":"2024-02-17T14:28:03.632020+0000","last_unstale":"2024-02-17T14:28:51.764924+0000","last_undegraded":"2024-02-17T14:28:51.764924+0000","last_fullsized":"2024-02-17T14:28:51.764924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061173+0000","last_change":"2024-02-17T14:28:03.072252+0000","last_active":"2024-02-17T14:28:52.061173+0000","last_peered":"2024-02-17T14:28:52.061173+0000","last_clean":"2024-02-17T14:28:52.061173+0000","last_became_active":"2024-02-17T14:28:03.071830+0000","last_became_peered":"2024-02-17T14:28:03.071830+0000","last_unstale":"2024-02-17T14:28:52.061173+0000","last_undegraded":"2024-02-17T14:28:52.061173+0000","last_fullsized":"2024-02-17T14:28:52.061173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:24.870956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876708+0000","last_change":"2024-02-17T14:28:07.849579+0000","last_active":"2024-02-17T14:28:51.876708+0000","last_peered":"2024-02-17T14:28:51.876708+0000","last_clean":"2024-02-17T14:28:51.876708+0000","last_became_active":"2024-02-17T14:28:07.849212+0000","last_became_peered":"2024-02-17T14:28:07.849212+0000","last_unstale":"2024-02-17T14:28:51.876708+0000","last_undegraded":"2024-02-17T14:28:51.876708+0000","last_fullsized":"2024-02-17T14:28:51.876708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769189+0000","last_change":"2024-02-17T14:28:03.626429+0000","last_active":"2024-02-17T14:28:51.769189+0000","last_peered":"2024-02-17T14:28:51.769189+0000","last_clean":"2024-02-17T14:28:51.769189+0000","last_became_active":"2024-02-17T14:28:03.626174+0000","last_became_peered":"2024-02-17T14:28:03.626174+0000","last_unstale":"2024-02-17T14:28:51.769189+0000","last_undegraded":"2024-02-17T14:28:51.769189+0000","last_fullsized":"2024-02-17T14:28:51.769189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765010+0000","last_change":"2024-02-17T14:28:03.068443+0000","last_active":"2024-02-17T14:28:51.765010+0000","last_peered":"2024-02-17T14:28:51.765010+0000","last_clean":"2024-02-17T14:28:51.765010+0000","last_became_active":"2024-02-17T14:28:03.068179+0000","last_became_peered":"2024-02-17T14:28:03.068179+0000","last_unstale":"2024-02-17T14:28:51.765010+0000","last_undegraded":"2024-02-17T14:28:51.765010+0000","last_fullsized":"2024-02-17T14:28:51.765010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764207+0000","last_change":"2024-02-17T14:28:07.650015+0000","last_active":"2024-02-17T14:28:51.764207+0000","last_peered":"2024-02-17T14:28:51.764207+0000","last_clean":"2024-02-17T14:28:51.764207+0000","last_became_active":"2024-02-17T14:28:07.647918+0000","last_became_peered":"2024-02-17T14:28:07.647918+0000","last_unstale":"2024-02-17T14:28:51.764207+0000","last_undegraded":"2024-02-17T14:28:51.764207+0000","last_fullsized":"2024-02-17T14:28:51.764207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767904+0000","last_change":"2024-02-17T14:28:03.629343+0000","last_active":"2024-02-17T14:28:51.767904+0000","last_peered":"2024-02-17T14:28:51.767904+0000","last_clean":"2024-02-17T14:28:51.767904+0000","last_became_active":"2024-02-17T14:28:03.629077+0000","last_became_peered":"2024-02-17T14:28:03.629077+0000","last_unstale":"2024-02-17T14:28:51.767904+0000","last_undegraded":"2024-02-17T14:28:51.767904+0000","last_fullsized":"2024-02-17T14:28:51.767904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:36.441335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769239+0000","last_change":"2024-02-17T14:28:03.069178+0000","last_active":"2024-02-17T14:28:51.769239+0000","last_peered":"2024-02-17T14:28:51.769239+0000","last_clean":"2024-02-17T14:28:51.769239+0000","last_became_active":"2024-02-17T14:28:03.068923+0000","last_became_peered":"2024-02-17T14:28:03.068923+0000","last_unstale":"2024-02-17T14:28:51.769239+0000","last_undegraded":"2024-02-17T14:28:51.769239+0000","last_fullsized":"2024-02-17T14:28:51.769239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764806+0000","last_change":"2024-02-17T14:28:07.648757+0000","last_active":"2024-02-17T14:28:51.764806+0000","last_peered":"2024-02-17T14:28:51.764806+0000","last_clean":"2024-02-17T14:28:51.764806+0000","last_became_active":"2024-02-17T14:28:07.645156+0000","last_became_peered":"2024-02-17T14:28:07.645156+0000","last_unstale":"2024-02-17T14:28:51.764806+0000","last_undegraded":"2024-02-17T14:28:51.764806+0000","last_fullsized":"2024-02-17T14:28:51.764806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764279+0000","last_change":"2024-02-17T14:28:03.627479+0000","last_active":"2024-02-17T14:28:51.764279+0000","last_peered":"2024-02-17T14:28:51.764279+0000","last_clean":"2024-02-17T14:28:51.764279+0000","last_became_active":"2024-02-17T14:28:03.627165+0000","last_became_peered":"2024-02-17T14:28:03.627165+0000","last_unstale":"2024-02-17T14:28:51.764279+0000","last_undegraded":"2024-02-17T14:28:51.764279+0000","last_fullsized":"2024-02-17T14:28:51.764279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.763758+0000","last_change":"2024-02-17T14:28:03.066452+0000","last_active":"2024-02-17T14:28:51.763758+0000","last_peered":"2024-02-17T14:28:51.763758+0000","last_clean":"2024-02-17T14:28:51.763758+0000","last_became_active":"2024-02-17T14:28:03.066156+0000","last_became_peered":"2024-02-17T14:28:03.066156+0000","last_unstale":"2024-02-17T14:28:51.763758+0000","last_undegraded":"2024-02-17T14:28:51.763758+0000","last_fullsized":"2024-02-17T14:28:51.763758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764316+0000","last_change":"2024-02-17T14:28:07.649765+0000","last_active":"2024-02-17T14:28:51.764316+0000","last_peered":"2024-02-17T14:28:51.764316+0000","last_clean":"2024-02-17T14:28:51.764316+0000","last_became_active":"2024-02-17T14:28:07.649403+0000","last_became_peered":"2024-02-17T14:28:07.649403+0000","last_unstale":"2024-02-17T14:28:51.764316+0000","last_undegraded":"2024-02-17T14:28:51.764316+0000","last_fullsized":"2024-02-17T14:28:51.764316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876601+0000","last_change":"2024-02-17T14:28:03.629628+0000","last_active":"2024-02-17T14:28:51.876601+0000","last_peered":"2024-02-17T14:28:51.876601+0000","last_clean":"2024-02-17T14:28:51.876601+0000","last_became_active":"2024-02-17T14:28:03.629247+0000","last_became_peered":"2024-02-17T14:28:03.629247+0000","last_unstale":"2024-02-17T14:28:51.876601+0000","last_undegraded":"2024-02-17T14:28:51.876601+0000","last_fullsized":"2024-02-17T14:28:51.876601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:00:51.336643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060538+0000","last_change":"2024-02-17T14:28:03.072090+0000","last_active":"2024-02-17T14:28:52.060538+0000","last_peered":"2024-02-17T14:28:52.060538+0000","last_clean":"2024-02-17T14:28:52.060538+0000","last_became_active":"2024-02-17T14:28:03.071778+0000","last_became_peered":"2024-02-17T14:28:03.071778+0000","last_unstale":"2024-02-17T14:28:52.060538+0000","last_undegraded":"2024-02-17T14:28:52.060538+0000","last_fullsized":"2024-02-17T14:28:52.060538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877170+0000","last_change":"2024-02-17T14:28:07.850472+0000","last_active":"2024-02-17T14:28:51.877170+0000","last_peered":"2024-02-17T14:28:51.877170+0000","last_clean":"2024-02-17T14:28:51.877170+0000","last_became_active":"2024-02-17T14:28:07.850106+0000","last_became_peered":"2024-02-17T14:28:07.850106+0000","last_unstale":"2024-02-17T14:28:51.877170+0000","last_undegraded":"2024-02-17T14:28:51.877170+0000","last_fullsized":"2024-02-17T14:28:51.877170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766517+0000","last_change":"2024-02-17T14:28:03.635109+0000","last_active":"2024-02-17T14:28:51.766517+0000","last_peered":"2024-02-17T14:28:51.766517+0000","last_clean":"2024-02-17T14:28:51.766517+0000","last_became_active":"2024-02-17T14:28:03.634570+0000","last_became_peered":"2024-02-17T14:28:03.634570+0000","last_unstale":"2024-02-17T14:28:51.766517+0000","last_undegraded":"2024-02-17T14:28:51.766517+0000","last_fullsized":"2024-02-17T14:28:51.766517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768818+0000","last_change":"2024-02-17T14:28:03.061647+0000","last_active":"2024-02-17T14:28:51.768818+0000","last_peered":"2024-02-17T14:28:51.768818+0000","last_clean":"2024-02-17T14:28:51.768818+0000","last_became_active":"2024-02-17T14:28:03.061026+0000","last_became_peered":"2024-02-17T14:28:03.061026+0000","last_unstale":"2024-02-17T14:28:51.768818+0000","last_undegraded":"2024-02-17T14:28:51.768818+0000","last_fullsized":"2024-02-17T14:28:51.768818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060684+0000","last_change":"2024-02-17T14:28:00.253131+0000","last_active":"2024-02-17T14:28:52.060684+0000","last_peered":"2024-02-17T14:28:52.060684+0000","last_clean":"2024-02-17T14:28:52.060684+0000","last_became_active":"2024-02-17T14:28:00.252180+0000","last_became_peered":"2024-02-17T14:28:00.252180+0000","last_unstale":"2024-02-17T14:28:52.060684+0000","last_undegraded":"2024-02-17T14:28:52.060684+0000","last_fullsized":"2024-02-17T14:28:52.060684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_clean_scrub_stamp":"2024-02-17T14:27:59.037303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:48.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764838+0000","last_change":"2024-02-17T14:28:07.849676+0000","last_active":"2024-02-17T14:28:51.764838+0000","last_peered":"2024-02-17T14:28:51.764838+0000","last_clean":"2024-02-17T14:28:51.764838+0000","last_became_active":"2024-02-17T14:28:07.849264+0000","last_became_peered":"2024-02-17T14:28:07.849264+0000","last_unstale":"2024-02-17T14:28:51.764838+0000","last_undegraded":"2024-02-17T14:28:51.764838+0000","last_fullsized":"2024-02-17T14:28:51.764838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060912+0000","last_change":"2024-02-17T14:28:03.642433+0000","last_active":"2024-02-17T14:28:52.060912+0000","last_peered":"2024-02-17T14:28:52.060912+0000","last_clean":"2024-02-17T14:28:52.060912+0000","last_became_active":"2024-02-17T14:28:03.641815+0000","last_became_peered":"2024-02-17T14:28:03.641815+0000","last_unstale":"2024-02-17T14:28:52.060912+0000","last_undegraded":"2024-02-17T14:28:52.060912+0000","last_fullsized":"2024-02-17T14:28:52.060912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:38.398272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764481+0000","last_change":"2024-02-17T14:28:03.066483+0000","last_active":"2024-02-17T14:28:51.764481+0000","last_peered":"2024-02-17T14:28:51.764481+0000","last_clean":"2024-02-17T14:28:51.764481+0000","last_became_active":"2024-02-17T14:28:03.066169+0000","last_became_peered":"2024-02-17T14:28:03.066169+0000","last_unstale":"2024-02-17T14:28:51.764481+0000","last_undegraded":"2024-02-17T14:28:51.764481+0000","last_fullsized":"2024-02-17T14:28:51.764481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764767+0000","last_change":"2024-02-17T14:28:07.846685+0000","last_active":"2024-02-17T14:28:51.764767+0000","last_peered":"2024-02-17T14:28:51.764767+0000","last_clean":"2024-02-17T14:28:51.764767+0000","last_became_active":"2024-02-17T14:28:07.846265+0000","last_became_peered":"2024-02-17T14:28:07.846265+0000","last_unstale":"2024-02-17T14:28:51.764767+0000","last_undegraded":"2024-02-17T14:28:51.764767+0000","last_fullsized":"2024-02-17T14:28:51.764767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769117+0000","last_change":"2024-02-17T14:28:03.634574+0000","last_active":"2024-02-17T14:28:51.769117+0000","last_peered":"2024-02-17T14:28:51.769117+0000","last_clean":"2024-02-17T14:28:51.769117+0000","last_became_active":"2024-02-17T14:28:03.634290+0000","last_became_peered":"2024-02-17T14:28:03.634290+0000","last_unstale":"2024-02-17T14:28:51.769117+0000","last_undegraded":"2024-02-17T14:28:51.769117+0000","last_fullsized":"2024-02-17T14:28:51.769117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765080+0000","last_change":"2024-02-17T14:28:03.072793+0000","last_active":"2024-02-17T14:28:51.765080+0000","last_peered":"2024-02-17T14:28:51.765080+0000","last_clean":"2024-02-17T14:28:51.765080+0000","last_became_active":"2024-02-17T14:28:03.072497+0000","last_became_peered":"2024-02-17T14:28:03.072497+0000","last_unstale":"2024-02-17T14:28:51.765080+0000","last_undegraded":"2024-02-17T14:28:51.765080+0000","last_fullsized":"2024-02-17T14:28:51.765080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876966+0000","last_change":"2024-02-17T14:28:07.651730+0000","last_active":"2024-02-17T14:28:51.876966+0000","last_peered":"2024-02-17T14:28:51.876966+0000","last_clean":"2024-02-17T14:28:51.876966+0000","last_became_active":"2024-02-17T14:28:07.651144+0000","last_became_peered":"2024-02-17T14:28:07.651144+0000","last_unstale":"2024-02-17T14:28:51.876966+0000","last_undegraded":"2024-02-17T14:28:51.876966+0000","last_fullsized":"2024-02-17T14:28:51.876966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061174+0000","last_change":"2024-02-17T14:28:03.643461+0000","last_active":"2024-02-17T14:28:52.061174+0000","last_peered":"2024-02-17T14:28:52.061174+0000","last_clean":"2024-02-17T14:28:52.061174+0000","last_became_active":"2024-02-17T14:28:03.643033+0000","last_became_peered":"2024-02-17T14:28:03.643033+0000","last_unstale":"2024-02-17T14:28:52.061174+0000","last_undegraded":"2024-02-17T14:28:52.061174+0000","last_fullsized":"2024-02-17T14:28:52.061174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:01.946139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764369+0000","last_change":"2024-02-17T14:28:03.067046+0000","last_active":"2024-02-17T14:28:51.764369+0000","last_peered":"2024-02-17T14:28:51.764369+0000","last_clean":"2024-02-17T14:28:51.764369+0000","last_became_active":"2024-02-17T14:28:03.066797+0000","last_became_peered":"2024-02-17T14:28:03.066797+0000","last_unstale":"2024-02-17T14:28:51.764369+0000","last_undegraded":"2024-02-17T14:28:51.764369+0000","last_fullsized":"2024-02-17T14:28:51.764369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768577+0000","last_change":"2024-02-17T14:28:07.850145+0000","last_active":"2024-02-17T14:28:51.768577+0000","last_peered":"2024-02-17T14:28:51.768577+0000","last_clean":"2024-02-17T14:28:51.768577+0000","last_became_active":"2024-02-17T14:28:07.849280+0000","last_became_peered":"2024-02-17T14:28:07.849280+0000","last_unstale":"2024-02-17T14:28:51.768577+0000","last_undegraded":"2024-02-17T14:28:51.768577+0000","last_fullsized":"2024-02-17T14:28:51.768577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061064+0000","last_change":"2024-02-17T14:28:03.641357+0000","last_active":"2024-02-17T14:28:52.061064+0000","last_peered":"2024-02-17T14:28:52.061064+0000","last_clean":"2024-02-17T14:28:52.061064+0000","last_became_active":"2024-02-17T14:28:03.640945+0000","last_became_peered":"2024-02-17T14:28:03.640945+0000","last_unstale":"2024-02-17T14:28:52.061064+0000","last_undegraded":"2024-02-17T14:28:52.061064+0000","last_fullsized":"2024-02-17T14:28:52.061064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767772+0000","last_change":"2024-02-17T14:28:03.066640+0000","last_active":"2024-02-17T14:28:51.767772+0000","last_peered":"2024-02-17T14:28:51.767772+0000","last_clean":"2024-02-17T14:28:51.767772+0000","last_became_active":"2024-02-17T14:28:03.066350+0000","last_became_peered":"2024-02-17T14:28:03.066350+0000","last_unstale":"2024-02-17T14:28:51.767772+0000","last_undegraded":"2024-02-17T14:28:51.767772+0000","last_fullsized":"2024-02-17T14:28:51.767772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:43.162911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767064+0000","last_change":"2024-02-17T14:28:07.652490+0000","last_active":"2024-02-17T14:28:51.767064+0000","last_peered":"2024-02-17T14:28:51.767064+0000","last_clean":"2024-02-17T14:28:51.767064+0000","last_became_active":"2024-02-17T14:28:07.652088+0000","last_became_peered":"2024-02-17T14:28:07.652088+0000","last_unstale":"2024-02-17T14:28:51.767064+0000","last_undegraded":"2024-02-17T14:28:51.767064+0000","last_fullsized":"2024-02-17T14:28:51.767064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:41.975941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.770874+0000","last_change":"2024-02-17T14:28:51.770495+0000","last_active":"2024-02-17T14:28:51.770874+0000","last_peered":"2024-02-17T14:28:51.770874+0000","last_clean":"2024-02-17T14:28:51.770874+0000","last_became_active":"2024-02-17T14:28:51.770241+0000","last_became_peered":"2024-02-17T14:28:51.770241+0000","last_unstale":"2024-02-17T14:28:51.770874+0000","last_undegraded":"2024-02-17T14:28:51.770874+0000","last_fullsized":"2024-02-17T14:28:51.770874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:24:37.784887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.763658+0000","last_change":"2024-02-17T14:28:03.070146+0000","last_active":"2024-02-17T14:28:51.763658+0000","last_peered":"2024-02-17T14:28:51.763658+0000","last_clean":"2024-02-17T14:28:51.763658+0000","last_became_active":"2024-02-17T14:28:03.069867+0000","last_became_peered":"2024-02-17T14:28:03.069867+0000","last_unstale":"2024-02-17T14:28:51.763658+0000","last_undegraded":"2024-02-17T14:28:51.763658+0000","last_fullsized":"2024-02-17T14:28:51.763658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877077+0000","last_change":"2024-02-17T14:28:07.644792+0000","last_active":"2024-02-17T14:28:51.877077+0000","last_peered":"2024-02-17T14:28:51.877077+0000","last_clean":"2024-02-17T14:28:51.877077+0000","last_became_active":"2024-02-17T14:28:07.644452+0000","last_became_peered":"2024-02-17T14:28:07.644452+0000","last_unstale":"2024-02-17T14:28:51.877077+0000","last_undegraded":"2024-02-17T14:28:51.877077+0000","last_fullsized":"2024-02-17T14:28:51.877077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764787+0000","last_change":"2024-02-17T14:28:03.630962+0000","last_active":"2024-02-17T14:28:51.764787+0000","last_peered":"2024-02-17T14:28:51.764787+0000","last_clean":"2024-02-17T14:28:51.764787+0000","last_became_active":"2024-02-17T14:28:03.630239+0000","last_became_peered":"2024-02-17T14:28:03.630239+0000","last_unstale":"2024-02-17T14:28:51.764787+0000","last_undegraded":"2024-02-17T14:28:51.764787+0000","last_fullsized":"2024-02-17T14:28:51.764787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764895+0000","last_change":"2024-02-17T14:28:03.073091+0000","last_active":"2024-02-17T14:28:51.764895+0000","last_peered":"2024-02-17T14:28:51.764895+0000","last_clean":"2024-02-17T14:28:51.764895+0000","last_became_active":"2024-02-17T14:28:03.072801+0000","last_became_peered":"2024-02-17T14:28:03.072801+0000","last_unstale":"2024-02-17T14:28:51.764895+0000","last_undegraded":"2024-02-17T14:28:51.764895+0000","last_fullsized":"2024-02-17T14:28:51.764895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767224+0000","last_change":"2024-02-17T14:28:07.849362+0000","last_active":"2024-02-17T14:28:51.767224+0000","last_peered":"2024-02-17T14:28:51.767224+0000","last_clean":"2024-02-17T14:28:51.767224+0000","last_became_active":"2024-02-17T14:28:07.848991+0000","last_became_peered":"2024-02-17T14:28:07.848991+0000","last_unstale":"2024-02-17T14:28:51.767224+0000","last_undegraded":"2024-02-17T14:28:51.767224+0000","last_fullsized":"2024-02-17T14:28:51.767224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:52.959315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060690+0000","last_change":"2024-02-17T14:28:03.641810+0000","last_active":"2024-02-17T14:28:52.060690+0000","last_peered":"2024-02-17T14:28:52.060690+0000","last_clean":"2024-02-17T14:28:52.060690+0000","last_became_active":"2024-02-17T14:28:03.641501+0000","last_became_peered":"2024-02-17T14:28:03.641501+0000","last_unstale":"2024-02-17T14:28:52.060690+0000","last_undegraded":"2024-02-17T14:28:52.060690+0000","last_fullsized":"2024-02-17T14:28:52.060690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769153+0000","last_change":"2024-02-17T14:28:03.066989+0000","last_active":"2024-02-17T14:28:51.769153+0000","last_peered":"2024-02-17T14:28:51.769153+0000","last_clean":"2024-02-17T14:28:51.769153+0000","last_became_active":"2024-02-17T14:28:03.066538+0000","last_became_peered":"2024-02-17T14:28:03.066538+0000","last_unstale":"2024-02-17T14:28:51.769153+0000","last_undegraded":"2024-02-17T14:28:51.769153+0000","last_fullsized":"2024-02-17T14:28:51.769153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767019+0000","last_change":"2024-02-17T14:28:07.846885+0000","last_active":"2024-02-17T14:28:51.767019+0000","last_peered":"2024-02-17T14:28:51.767019+0000","last_clean":"2024-02-17T14:28:51.767019+0000","last_became_active":"2024-02-17T14:28:07.846413+0000","last_became_peered":"2024-02-17T14:28:07.846413+0000","last_unstale":"2024-02-17T14:28:51.767019+0000","last_undegraded":"2024-02-17T14:28:51.767019+0000","last_fullsized":"2024-02-17T14:28:51.767019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:00.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876797+0000","last_change":"2024-02-17T14:28:03.638054+0000","last_active":"2024-02-17T14:28:51.876797+0000","last_peered":"2024-02-17T14:28:51.876797+0000","last_clean":"2024-02-17T14:28:51.876797+0000","last_became_active":"2024-02-17T14:28:03.637831+0000","last_became_peered":"2024-02-17T14:28:03.637831+0000","last_unstale":"2024-02-17T14:28:51.876797+0000","last_undegraded":"2024-02-17T14:28:51.876797+0000","last_fullsized":"2024-02-17T14:28:51.876797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:11:23.521059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877154+0000","last_change":"2024-02-17T14:28:03.064510+0000","last_active":"2024-02-17T14:28:51.877154+0000","last_peered":"2024-02-17T14:28:51.877154+0000","last_clean":"2024-02-17T14:28:51.877154+0000","last_became_active":"2024-02-17T14:28:03.064226+0000","last_became_peered":"2024-02-17T14:28:03.064226+0000","last_unstale":"2024-02-17T14:28:51.877154+0000","last_undegraded":"2024-02-17T14:28:51.877154+0000","last_fullsized":"2024-02-17T14:28:51.877154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:26:19.467344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769043+0000","last_change":"2024-02-17T14:28:07.849775+0000","last_active":"2024-02-17T14:28:51.769043+0000","last_peered":"2024-02-17T14:28:51.769043+0000","last_clean":"2024-02-17T14:28:51.769043+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:51.769043+0000","last_undegraded":"2024-02-17T14:28:51.769043+0000","last_fullsized":"2024-02-17T14:28:51.769043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060827+0000","last_change":"2024-02-17T14:28:03.642582+0000","last_active":"2024-02-17T14:28:52.060827+0000","last_peered":"2024-02-17T14:28:52.060827+0000","last_clean":"2024-02-17T14:28:52.060827+0000","last_became_active":"2024-02-17T14:28:03.642077+0000","last_became_peered":"2024-02-17T14:28:03.642077+0000","last_unstale":"2024-02-17T14:28:52.060827+0000","last_undegraded":"2024-02-17T14:28:52.060827+0000","last_fullsized":"2024-02-17T14:28:52.060827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'13","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765489+0000","last_change":"2024-02-17T14:28:03.071791+0000","last_active":"2024-02-17T14:28:51.765489+0000","last_peered":"2024-02-17T14:28:51.765489+0000","last_clean":"2024-02-17T14:28:51.765489+0000","last_became_active":"2024-02-17T14:28:03.071303+0000","last_became_peered":"2024-02-17T14:28:03.071303+0000","last_unstale":"2024-02-17T14:28:51.765489+0000","last_undegraded":"2024-02-17T14:28:51.765489+0000","last_fullsized":"2024-02-17T14:28:51.765489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7968,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764804+0000","last_change":"2024-02-17T14:28:07.649531+0000","last_active":"2024-02-17T14:28:51.764804+0000","last_peered":"2024-02-17T14:28:51.764804+0000","last_clean":"2024-02-17T14:28:51.764804+0000","last_became_active":"2024-02-17T14:28:07.645313+0000","last_became_peered":"2024-02-17T14:28:07.645313+0000","last_unstale":"2024-02-17T14:28:51.764804+0000","last_undegraded":"2024-02-17T14:28:51.764804+0000","last_fullsized":"2024-02-17T14:28:51.764804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768488+0000","last_change":"2024-02-17T14:28:03.638812+0000","last_active":"2024-02-17T14:28:51.768488+0000","last_peered":"2024-02-17T14:28:51.768488+0000","last_clean":"2024-02-17T14:28:51.768488+0000","last_became_active":"2024-02-17T14:28:03.637937+0000","last_became_peered":"2024-02-17T14:28:03.637937+0000","last_unstale":"2024-02-17T14:28:51.768488+0000","last_undegraded":"2024-02-17T14:28:51.768488+0000","last_fullsized":"2024-02-17T14:28:51.768488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764994+0000","last_change":"2024-02-17T14:28:03.069972+0000","last_active":"2024-02-17T14:28:51.764994+0000","last_peered":"2024-02-17T14:28:51.764994+0000","last_clean":"2024-02-17T14:28:51.764994+0000","last_became_active":"2024-02-17T14:28:03.069690+0000","last_became_peered":"2024-02-17T14:28:03.069690+0000","last_unstale":"2024-02-17T14:28:51.764994+0000","last_undegraded":"2024-02-17T14:28:51.764994+0000","last_fullsized":"2024-02-17T14:28:51.764994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767677+0000","last_change":"2024-02-17T14:28:07.647825+0000","last_active":"2024-02-17T14:28:51.767677+0000","last_peered":"2024-02-17T14:28:51.767677+0000","last_clean":"2024-02-17T14:28:51.767677+0000","last_became_active":"2024-02-17T14:28:07.647420+0000","last_became_peered":"2024-02-17T14:28:07.647420+0000","last_unstale":"2024-02-17T14:28:51.767677+0000","last_undegraded":"2024-02-17T14:28:51.767677+0000","last_fullsized":"2024-02-17T14:28:51.767677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877199+0000","last_change":"2024-02-17T14:28:03.631000+0000","last_active":"2024-02-17T14:28:51.877199+0000","last_peered":"2024-02-17T14:28:51.877199+0000","last_clean":"2024-02-17T14:28:51.877199+0000","last_became_active":"2024-02-17T14:28:03.630169+0000","last_became_peered":"2024-02-17T14:28:03.630169+0000","last_unstale":"2024-02-17T14:28:51.877199+0000","last_undegraded":"2024-02-17T14:28:51.877199+0000","last_fullsized":"2024-02-17T14:28:51.877199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768929+0000","last_change":"2024-02-17T14:28:03.069911+0000","last_active":"2024-02-17T14:28:51.768929+0000","last_peered":"2024-02-17T14:28:51.768929+0000","last_clean":"2024-02-17T14:28:51.768929+0000","last_became_active":"2024-02-17T14:28:03.069617+0000","last_became_peered":"2024-02-17T14:28:03.069617+0000","last_unstale":"2024-02-17T14:28:51.768929+0000","last_undegraded":"2024-02-17T14:28:51.768929+0000","last_fullsized":"2024-02-17T14:28:51.768929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766539+0000","last_change":"2024-02-17T14:28:07.646742+0000","last_active":"2024-02-17T14:28:51.766539+0000","last_peered":"2024-02-17T14:28:51.766539+0000","last_clean":"2024-02-17T14:28:51.766539+0000","last_became_active":"2024-02-17T14:28:07.646403+0000","last_became_peered":"2024-02-17T14:28:07.646403+0000","last_unstale":"2024-02-17T14:28:51.766539+0000","last_undegraded":"2024-02-17T14:28:51.766539+0000","last_fullsized":"2024-02-17T14:28:51.766539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768969+0000","last_change":"2024-02-17T14:28:03.638522+0000","last_active":"2024-02-17T14:28:51.768969+0000","last_peered":"2024-02-17T14:28:51.768969+0000","last_clean":"2024-02-17T14:28:51.768969+0000","last_became_active":"2024-02-17T14:28:03.638281+0000","last_became_peered":"2024-02-17T14:28:03.638281+0000","last_unstale":"2024-02-17T14:28:51.768969+0000","last_undegraded":"2024-02-17T14:28:51.768969+0000","last_fullsized":"2024-02-17T14:28:51.768969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765890+0000","last_change":"2024-02-17T14:28:03.072855+0000","last_active":"2024-02-17T14:28:51.765890+0000","last_peered":"2024-02-17T14:28:51.765890+0000","last_clean":"2024-02-17T14:28:51.765890+0000","last_became_active":"2024-02-17T14:28:03.072571+0000","last_became_peered":"2024-02-17T14:28:03.072571+0000","last_unstale":"2024-02-17T14:28:51.765890+0000","last_undegraded":"2024-02-17T14:28:51.765890+0000","last_fullsized":"2024-02-17T14:28:51.765890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766155+0000","last_change":"2024-02-17T14:28:07.849448+0000","last_active":"2024-02-17T14:28:51.766155+0000","last_peered":"2024-02-17T14:28:51.766155+0000","last_clean":"2024-02-17T14:28:51.766155+0000","last_became_active":"2024-02-17T14:28:07.849096+0000","last_became_peered":"2024-02-17T14:28:07.849096+0000","last_unstale":"2024-02-17T14:28:51.766155+0000","last_undegraded":"2024-02-17T14:28:51.766155+0000","last_fullsized":"2024-02-17T14:28:51.766155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877222+0000","last_change":"2024-02-17T14:28:07.849485+0000","last_active":"2024-02-17T14:28:51.877222+0000","last_peered":"2024-02-17T14:28:51.877222+0000","last_clean":"2024-02-17T14:28:51.877222+0000","last_became_active":"2024-02-17T14:28:07.849053+0000","last_became_peered":"2024-02-17T14:28:07.849053+0000","last_unstale":"2024-02-17T14:28:51.877222+0000","last_undegraded":"2024-02-17T14:28:51.877222+0000","last_fullsized":"2024-02-17T14:28:51.877222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764697+0000","last_change":"2024-02-17T14:28:03.632467+0000","last_active":"2024-02-17T14:28:51.764697+0000","last_peered":"2024-02-17T14:28:51.764697+0000","last_clean":"2024-02-17T14:28:51.764697+0000","last_became_active":"2024-02-17T14:28:03.632204+0000","last_became_peered":"2024-02-17T14:28:03.632204+0000","last_unstale":"2024-02-17T14:28:51.764697+0000","last_undegraded":"2024-02-17T14:28:51.764697+0000","last_fullsized":"2024-02-17T14:28:51.764697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768859+0000","last_change":"2024-02-17T14:28:03.062682+0000","last_active":"2024-02-17T14:28:51.768859+0000","last_peered":"2024-02-17T14:28:51.768859+0000","last_clean":"2024-02-17T14:28:51.768859+0000","last_became_active":"2024-02-17T14:28:03.062390+0000","last_became_peered":"2024-02-17T14:28:03.062390+0000","last_unstale":"2024-02-17T14:28:51.768859+0000","last_undegraded":"2024-02-17T14:28:51.768859+0000","last_fullsized":"2024-02-17T14:28:51.768859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765690+0000","last_change":"2024-02-17T14:28:07.651004+0000","last_active":"2024-02-17T14:28:51.765690+0000","last_peered":"2024-02-17T14:28:51.765690+0000","last_clean":"2024-02-17T14:28:51.765690+0000","last_became_active":"2024-02-17T14:28:07.650627+0000","last_became_peered":"2024-02-17T14:28:07.650627+0000","last_unstale":"2024-02-17T14:28:51.765690+0000","last_undegraded":"2024-02-17T14:28:51.765690+0000","last_fullsized":"2024-02-17T14:28:51.765690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766582+0000","last_change":"2024-02-17T14:28:03.627978+0000","last_active":"2024-02-17T14:28:51.766582+0000","last_peered":"2024-02-17T14:28:51.766582+0000","last_clean":"2024-02-17T14:28:51.766582+0000","last_became_active":"2024-02-17T14:28:03.627708+0000","last_became_peered":"2024-02-17T14:28:03.627708+0000","last_unstale":"2024-02-17T14:28:51.766582+0000","last_undegraded":"2024-02-17T14:28:51.766582+0000","last_fullsized":"2024-02-17T14:28:51.766582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766317+0000","last_change":"2024-02-17T14:28:03.071479+0000","last_active":"2024-02-17T14:28:51.766317+0000","last_peered":"2024-02-17T14:28:51.766317+0000","last_clean":"2024-02-17T14:28:51.766317+0000","last_became_active":"2024-02-17T14:28:03.071170+0000","last_became_peered":"2024-02-17T14:28:03.071170+0000","last_unstale":"2024-02-17T14:28:51.766317+0000","last_undegraded":"2024-02-17T14:28:51.766317+0000","last_fullsized":"2024-02-17T14:28:51.766317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:03:44.733125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765220+0000","last_change":"2024-02-17T14:28:03.073225+0000","last_active":"2024-02-17T14:28:51.765220+0000","last_peered":"2024-02-17T14:28:51.765220+0000","last_clean":"2024-02-17T14:28:51.765220+0000","last_became_active":"2024-02-17T14:28:03.072928+0000","last_became_peered":"2024-02-17T14:28:03.072928+0000","last_unstale":"2024-02-17T14:28:51.765220+0000","last_undegraded":"2024-02-17T14:28:51.765220+0000","last_fullsized":"2024-02-17T14:28:51.765220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877057+0000","last_change":"2024-02-17T14:28:03.635534+0000","last_active":"2024-02-17T14:28:51.877057+0000","last_peered":"2024-02-17T14:28:51.877057+0000","last_clean":"2024-02-17T14:28:51.877057+0000","last_became_active":"2024-02-17T14:28:03.635362+0000","last_became_peered":"2024-02-17T14:28:03.635362+0000","last_unstale":"2024-02-17T14:28:51.877057+0000","last_undegraded":"2024-02-17T14:28:51.877057+0000","last_fullsized":"2024-02-17T14:28:51.877057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764331+0000","last_change":"2024-02-17T14:28:07.645087+0000","last_active":"2024-02-17T14:28:51.764331+0000","last_peered":"2024-02-17T14:28:51.764331+0000","last_clean":"2024-02-17T14:28:51.764331+0000","last_became_active":"2024-02-17T14:28:07.644637+0000","last_became_peered":"2024-02-17T14:28:07.644637+0000","last_unstale":"2024-02-17T14:28:51.764331+0000","last_undegraded":"2024-02-17T14:28:51.764331+0000","last_fullsized":"2024-02-17T14:28:51.764331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:39.175950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766840+0000","last_change":"2024-02-17T14:28:03.072162+0000","last_active":"2024-02-17T14:28:51.766840+0000","last_peered":"2024-02-17T14:28:51.766840+0000","last_clean":"2024-02-17T14:28:51.766840+0000","last_became_active":"2024-02-17T14:28:03.071112+0000","last_became_peered":"2024-02-17T14:28:03.071112+0000","last_unstale":"2024-02-17T14:28:51.766840+0000","last_undegraded":"2024-02-17T14:28:51.766840+0000","last_fullsized":"2024-02-17T14:28:51.766840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767346+0000","last_change":"2024-02-17T14:28:03.628403+0000","last_active":"2024-02-17T14:28:51.767346+0000","last_peered":"2024-02-17T14:28:51.767346+0000","last_clean":"2024-02-17T14:28:51.767346+0000","last_became_active":"2024-02-17T14:28:03.628144+0000","last_became_peered":"2024-02-17T14:28:03.628144+0000","last_unstale":"2024-02-17T14:28:51.767346+0000","last_undegraded":"2024-02-17T14:28:51.767346+0000","last_fullsized":"2024-02-17T14:28:51.767346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:01.247136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766781+0000","last_change":"2024-02-17T14:28:07.648376+0000","last_active":"2024-02-17T14:28:51.766781+0000","last_peered":"2024-02-17T14:28:51.766781+0000","last_clean":"2024-02-17T14:28:51.766781+0000","last_became_active":"2024-02-17T14:28:07.647491+0000","last_became_peered":"2024-02-17T14:28:07.647491+0000","last_unstale":"2024-02-17T14:28:51.766781+0000","last_undegraded":"2024-02-17T14:28:51.766781+0000","last_fullsized":"2024-02-17T14:28:51.766781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:12.810441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764660+0000","last_change":"2024-02-17T14:28:03.631191+0000","last_active":"2024-02-17T14:28:51.764660+0000","last_peered":"2024-02-17T14:28:51.764660+0000","last_clean":"2024-02-17T14:28:51.764660+0000","last_became_active":"2024-02-17T14:28:03.630662+0000","last_became_peered":"2024-02-17T14:28:03.630662+0000","last_unstale":"2024-02-17T14:28:51.764660+0000","last_undegraded":"2024-02-17T14:28:51.764660+0000","last_fullsized":"2024-02-17T14:28:51.764660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.763722+0000","last_change":"2024-02-17T14:28:03.629028+0000","last_active":"2024-02-17T14:28:51.763722+0000","last_peered":"2024-02-17T14:28:51.763722+0000","last_clean":"2024-02-17T14:28:51.763722+0000","last_became_active":"2024-02-17T14:28:03.628781+0000","last_became_peered":"2024-02-17T14:28:03.628781+0000","last_unstale":"2024-02-17T14:28:51.763722+0000","last_undegraded":"2024-02-17T14:28:51.763722+0000","last_fullsized":"2024-02-17T14:28:51.763722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.773314+0000","last_change":"2024-02-17T14:28:51.773314+0000","last_active":"2024-02-17T14:28:51.773314+0000","last_peered":"2024-02-17T14:28:51.773314+0000","last_clean":"2024-02-17T14:28:51.773314+0000","last_became_active":"2024-02-17T14:28:51.772895+0000","last_became_peered":"2024-02-17T14:28:51.772895+0000","last_unstale":"2024-02-17T14:28:51.773314+0000","last_undegraded":"2024-02-17T14:28:51.773314+0000","last_fullsized":"2024-02-17T14:28:51.773314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:38:01.087874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877051+0000","last_change":"2024-02-17T14:28:03.627122+0000","last_active":"2024-02-17T14:28:51.877051+0000","last_peered":"2024-02-17T14:28:51.877051+0000","last_clean":"2024-02-17T14:28:51.877051+0000","last_became_active":"2024-02-17T14:28:03.626738+0000","last_became_peered":"2024-02-17T14:28:03.626738+0000","last_unstale":"2024-02-17T14:28:51.877051+0000","last_undegraded":"2024-02-17T14:28:51.877051+0000","last_fullsized":"2024-02-17T14:28:51.877051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767120+0000","last_change":"2024-02-17T14:28:03.631182+0000","last_active":"2024-02-17T14:28:51.767120+0000","last_peered":"2024-02-17T14:28:51.767120+0000","last_clean":"2024-02-17T14:28:51.767120+0000","last_became_active":"2024-02-17T14:28:03.630705+0000","last_became_peered":"2024-02-17T14:28:03.630705+0000","last_unstale":"2024-02-17T14:28:51.767120+0000","last_undegraded":"2024-02-17T14:28:51.767120+0000","last_fullsized":"2024-02-17T14:28:51.767120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764857+0000","last_change":"2024-02-17T14:28:03.631731+0000","last_active":"2024-02-17T14:28:51.764857+0000","last_peered":"2024-02-17T14:28:51.764857+0000","last_clean":"2024-02-17T14:28:51.764857+0000","last_became_active":"2024-02-17T14:28:03.631476+0000","last_became_peered":"2024-02-17T14:28:03.631476+0000","last_unstale":"2024-02-17T14:28:51.764857+0000","last_undegraded":"2024-02-17T14:28:51.764857+0000","last_fullsized":"2024-02-17T14:28:51.764857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765932+0000","last_change":"2024-02-17T14:28:03.638716+0000","last_active":"2024-02-17T14:28:51.765932+0000","last_peered":"2024-02-17T14:28:51.765932+0000","last_clean":"2024-02-17T14:28:51.765932+0000","last_became_active":"2024-02-17T14:28:03.638442+0000","last_became_peered":"2024-02-17T14:28:03.638442+0000","last_unstale":"2024-02-17T14:28:51.765932+0000","last_undegraded":"2024-02-17T14:28:51.765932+0000","last_fullsized":"2024-02-17T14:28:51.765932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767252+0000","last_change":"2024-02-17T14:28:03.630945+0000","last_active":"2024-02-17T14:28:51.767252+0000","last_peered":"2024-02-17T14:28:51.767252+0000","last_clean":"2024-02-17T14:28:51.767252+0000","last_became_active":"2024-02-17T14:28:03.630676+0000","last_became_peered":"2024-02-17T14:28:03.630676+0000","last_unstale":"2024-02-17T14:28:51.767252+0000","last_undegraded":"2024-02-17T14:28:51.767252+0000","last_fullsized":"2024-02-17T14:28:51.767252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768565+0000","last_change":"2024-02-17T14:28:03.627202+0000","last_active":"2024-02-17T14:28:51.768565+0000","last_peered":"2024-02-17T14:28:51.768565+0000","last_clean":"2024-02-17T14:28:51.768565+0000","last_became_active":"2024-02-17T14:28:03.626848+0000","last_became_peered":"2024-02-17T14:28:03.626848+0000","last_unstale":"2024-02-17T14:28:51.768565+0000","last_undegraded":"2024-02-17T14:28:51.768565+0000","last_fullsized":"2024-02-17T14:28:51.768565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766296+0000","last_change":"2024-02-17T14:28:03.627493+0000","last_active":"2024-02-17T14:28:51.766296+0000","last_peered":"2024-02-17T14:28:51.766296+0000","last_clean":"2024-02-17T14:28:51.766296+0000","last_became_active":"2024-02-17T14:28:03.626450+0000","last_became_peered":"2024-02-17T14:28:03.626450+0000","last_unstale":"2024-02-17T14:28:51.766296+0000","last_undegraded":"2024-02-17T14:28:51.766296+0000","last_fullsized":"2024-02-17T14:28:51.766296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768712+0000","last_change":"2024-02-17T14:28:03.639610+0000","last_active":"2024-02-17T14:28:51.768712+0000","last_peered":"2024-02-17T14:28:51.768712+0000","last_clean":"2024-02-17T14:28:51.768712+0000","last_became_active":"2024-02-17T14:28:03.639330+0000","last_became_peered":"2024-02-17T14:28:03.639330+0000","last_unstale":"2024-02-17T14:28:51.768712+0000","last_undegraded":"2024-02-17T14:28:51.768712+0000","last_fullsized":"2024-02-17T14:28:51.768712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876742+0000","last_change":"2024-02-17T14:28:03.641774+0000","last_active":"2024-02-17T14:28:51.876742+0000","last_peered":"2024-02-17T14:28:51.876742+0000","last_clean":"2024-02-17T14:28:51.876742+0000","last_became_active":"2024-02-17T14:28:03.641485+0000","last_became_peered":"2024-02-17T14:28:03.641485+0000","last_unstale":"2024-02-17T14:28:51.876742+0000","last_undegraded":"2024-02-17T14:28:51.876742+0000","last_fullsized":"2024-02-17T14:28:51.876742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765227+0000","last_change":"2024-02-17T14:28:03.630129+0000","last_active":"2024-02-17T14:28:51.765227+0000","last_peered":"2024-02-17T14:28:51.765227+0000","last_clean":"2024-02-17T14:28:51.765227+0000","last_became_active":"2024-02-17T14:28:03.629841+0000","last_became_peered":"2024-02-17T14:28:03.629841+0000","last_unstale":"2024-02-17T14:28:51.765227+0000","last_undegraded":"2024-02-17T14:28:51.765227+0000","last_fullsized":"2024-02-17T14:28:51.765227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061047+0000","last_change":"2024-02-17T14:28:03.642676+0000","last_active":"2024-02-17T14:28:52.061047+0000","last_peered":"2024-02-17T14:28:52.061047+0000","last_clean":"2024-02-17T14:28:52.061047+0000","last_became_active":"2024-02-17T14:28:03.642150+0000","last_became_peered":"2024-02-17T14:28:03.642150+0000","last_unstale":"2024-02-17T14:28:52.061047+0000","last_undegraded":"2024-02-17T14:28:52.061047+0000","last_fullsized":"2024-02-17T14:28:52.061047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764283+0000","last_change":"2024-02-17T14:28:03.632127+0000","last_active":"2024-02-17T14:28:51.764283+0000","last_peered":"2024-02-17T14:28:51.764283+0000","last_clean":"2024-02-17T14:28:51.764283+0000","last_became_active":"2024-02-17T14:28:03.631844+0000","last_became_peered":"2024-02-17T14:28:03.631844+0000","last_unstale":"2024-02-17T14:28:51.764283+0000","last_undegraded":"2024-02-17T14:28:51.764283+0000","last_fullsized":"2024-02-17T14:28:51.764283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:07.756422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.063081+0000","last_change":"2024-02-17T14:28:52.062031+0000","last_active":"2024-02-17T14:28:52.063081+0000","last_peered":"2024-02-17T14:28:52.063081+0000","last_clean":"2024-02-17T14:28:52.063081+0000","last_became_active":"2024-02-17T14:28:52.061682+0000","last_became_peered":"2024-02-17T14:28:52.061682+0000","last_unstale":"2024-02-17T14:28:52.063081+0000","last_undegraded":"2024-02-17T14:28:52.063081+0000","last_fullsized":"2024-02-17T14:28:52.063081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768418+0000","last_change":"2024-02-17T14:28:03.628626+0000","last_active":"2024-02-17T14:28:51.768418+0000","last_peered":"2024-02-17T14:28:51.768418+0000","last_clean":"2024-02-17T14:28:51.768418+0000","last_became_active":"2024-02-17T14:28:03.628343+0000","last_became_peered":"2024-02-17T14:28:03.628343+0000","last_unstale":"2024-02-17T14:28:51.768418+0000","last_undegraded":"2024-02-17T14:28:51.768418+0000","last_fullsized":"2024-02-17T14:28:51.768418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765084+0000","last_change":"2024-02-17T14:28:03.635610+0000","last_active":"2024-02-17T14:28:51.765084+0000","last_peered":"2024-02-17T14:28:51.765084+0000","last_clean":"2024-02-17T14:28:51.765084+0000","last_became_active":"2024-02-17T14:28:03.635340+0000","last_became_peered":"2024-02-17T14:28:03.635340+0000","last_unstale":"2024-02-17T14:28:51.765084+0000","last_undegraded":"2024-02-17T14:28:51.765084+0000","last_fullsized":"2024-02-17T14:28:51.765084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876745+0000","last_change":"2024-02-17T14:28:03.632540+0000","last_active":"2024-02-17T14:28:51.876745+0000","last_peered":"2024-02-17T14:28:51.876745+0000","last_clean":"2024-02-17T14:28:51.876745+0000","last_became_active":"2024-02-17T14:28:03.632273+0000","last_became_peered":"2024-02-17T14:28:03.632273+0000","last_unstale":"2024-02-17T14:28:51.876745+0000","last_undegraded":"2024-02-17T14:28:51.876745+0000","last_fullsized":"2024-02-17T14:28:51.876745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:35.598281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766633+0000","last_change":"2024-02-17T14:28:03.631678+0000","last_active":"2024-02-17T14:28:51.766633+0000","last_peered":"2024-02-17T14:28:51.766633+0000","last_clean":"2024-02-17T14:28:51.766633+0000","last_became_active":"2024-02-17T14:28:03.631431+0000","last_became_peered":"2024-02-17T14:28:03.631431+0000","last_unstale":"2024-02-17T14:28:51.766633+0000","last_undegraded":"2024-02-17T14:28:51.766633+0000","last_fullsized":"2024-02-17T14:28:51.766633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768398+0000","last_change":"2024-02-17T14:28:03.631661+0000","last_active":"2024-02-17T14:28:51.768398+0000","last_peered":"2024-02-17T14:28:51.768398+0000","last_clean":"2024-02-17T14:28:51.768398+0000","last_became_active":"2024-02-17T14:28:03.631379+0000","last_became_peered":"2024-02-17T14:28:03.631379+0000","last_unstale":"2024-02-17T14:28:51.768398+0000","last_undegraded":"2024-02-17T14:28:51.768398+0000","last_fullsized":"2024-02-17T14:28:51.768398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:03.242976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764990+0000","last_change":"2024-02-17T14:28:03.635522+0000","last_active":"2024-02-17T14:28:51.764990+0000","last_peered":"2024-02-17T14:28:51.764990+0000","last_clean":"2024-02-17T14:28:51.764990+0000","last_became_active":"2024-02-17T14:28:03.635254+0000","last_became_peered":"2024-02-17T14:28:03.635254+0000","last_unstale":"2024-02-17T14:28:51.764990+0000","last_undegraded":"2024-02-17T14:28:51.764990+0000","last_fullsized":"2024-02-17T14:28:51.764990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765844+0000","last_change":"2024-02-17T14:28:03.635588+0000","last_active":"2024-02-17T14:28:51.765844+0000","last_peered":"2024-02-17T14:28:51.765844+0000","last_clean":"2024-02-17T14:28:51.765844+0000","last_became_active":"2024-02-17T14:28:03.635312+0000","last_became_peered":"2024-02-17T14:28:03.635312+0000","last_unstale":"2024-02-17T14:28:51.765844+0000","last_undegraded":"2024-02-17T14:28:51.765844+0000","last_fullsized":"2024-02-17T14:28:51.765844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061122+0000","last_change":"2024-02-17T14:28:03.646624+0000","last_active":"2024-02-17T14:28:52.061122+0000","last_peered":"2024-02-17T14:28:52.061122+0000","last_clean":"2024-02-17T14:28:52.061122+0000","last_became_active":"2024-02-17T14:28:03.646337+0000","last_became_peered":"2024-02-17T14:28:03.646337+0000","last_unstale":"2024-02-17T14:28:52.061122+0000","last_undegraded":"2024-02-17T14:28:52.061122+0000","last_fullsized":"2024-02-17T14:28:52.061122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:10.836577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766486+0000","last_change":"2024-02-17T14:28:03.635018+0000","last_active":"2024-02-17T14:28:51.766486+0000","last_peered":"2024-02-17T14:28:51.766486+0000","last_clean":"2024-02-17T14:28:51.766486+0000","last_became_active":"2024-02-17T14:28:03.634751+0000","last_became_peered":"2024-02-17T14:28:03.634751+0000","last_unstale":"2024-02-17T14:28:51.766486+0000","last_undegraded":"2024-02-17T14:28:51.766486+0000","last_fullsized":"2024-02-17T14:28:51.766486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060492+0000","last_change":"2024-02-17T14:28:03.641708+0000","last_active":"2024-02-17T14:28:52.060492+0000","last_peered":"2024-02-17T14:28:52.060492+0000","last_clean":"2024-02-17T14:28:52.060492+0000","last_became_active":"2024-02-17T14:28:03.641260+0000","last_became_peered":"2024-02-17T14:28:03.641260+0000","last_unstale":"2024-02-17T14:28:52.060492+0000","last_undegraded":"2024-02-17T14:28:52.060492+0000","last_fullsized":"2024-02-17T14:28:52.060492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768705+0000","last_change":"2024-02-17T14:28:03.628239+0000","last_active":"2024-02-17T14:28:51.768705+0000","last_peered":"2024-02-17T14:28:51.768705+0000","last_clean":"2024-02-17T14:28:51.768705+0000","last_became_active":"2024-02-17T14:28:03.627918+0000","last_became_peered":"2024-02-17T14:28:03.627918+0000","last_unstale":"2024-02-17T14:28:51.768705+0000","last_undegraded":"2024-02-17T14:28:51.768705+0000","last_fullsized":"2024-02-17T14:28:51.768705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060535+0000","last_change":"2024-02-17T14:28:03.641192+0000","last_active":"2024-02-17T14:28:52.060535+0000","last_peered":"2024-02-17T14:28:52.060535+0000","last_clean":"2024-02-17T14:28:52.060535+0000","last_became_active":"2024-02-17T14:28:03.640873+0000","last_became_peered":"2024-02-17T14:28:03.640873+0000","last_unstale":"2024-02-17T14:28:52.060535+0000","last_undegraded":"2024-02-17T14:28:52.060535+0000","last_fullsized":"2024-02-17T14:28:52.060535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.772451+0000","last_change":"2024-02-17T14:28:51.768174+0000","last_active":"2024-02-17T14:28:51.772451+0000","last_peered":"2024-02-17T14:28:51.772451+0000","last_clean":"2024-02-17T14:28:51.772451+0000","last_became_active":"2024-02-17T14:28:51.767928+0000","last_became_peered":"2024-02-17T14:28:51.767928+0000","last_unstale":"2024-02-17T14:28:51.772451+0000","last_undegraded":"2024-02-17T14:28:51.772451+0000","last_fullsized":"2024-02-17T14:28:51.772451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876904+0000","last_change":"2024-02-17T14:28:03.628223+0000","last_active":"2024-02-17T14:28:51.876904+0000","last_peered":"2024-02-17T14:28:51.876904+0000","last_clean":"2024-02-17T14:28:51.876904+0000","last_became_active":"2024-02-17T14:28:03.627978+0000","last_became_peered":"2024-02-17T14:28:03.627978+0000","last_unstale":"2024-02-17T14:28:51.876904+0000","last_undegraded":"2024-02-17T14:28:51.876904+0000","last_fullsized":"2024-02-17T14:28:51.876904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765384+0000","last_change":"2024-02-17T14:28:03.631742+0000","last_active":"2024-02-17T14:28:51.765384+0000","last_peered":"2024-02-17T14:28:51.765384+0000","last_clean":"2024-02-17T14:28:51.765384+0000","last_became_active":"2024-02-17T14:28:03.631493+0000","last_became_peered":"2024-02-17T14:28:03.631493+0000","last_unstale":"2024-02-17T14:28:51.765384+0000","last_undegraded":"2024-02-17T14:28:51.765384+0000","last_fullsized":"2024-02-17T14:28:51.765384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061037+0000","last_change":"2024-02-17T14:28:03.641525+0000","last_active":"2024-02-17T14:28:52.061037+0000","last_peered":"2024-02-17T14:28:52.061037+0000","last_clean":"2024-02-17T14:28:52.061037+0000","last_became_active":"2024-02-17T14:28:03.641154+0000","last_became_peered":"2024-02-17T14:28:03.641154+0000","last_unstale":"2024-02-17T14:28:52.061037+0000","last_undegraded":"2024-02-17T14:28:52.061037+0000","last_fullsized":"2024-02-17T14:28:52.061037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8766,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":17532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":709990,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.55900000000000005}]},{"osd":1,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.501}]},{"osd":2,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.39200000000000002}]},{"osd":3,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57299999999999995}]},{"osd":4,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58899999999999997}]},{"osd":5,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.628}]},{"osd":6,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":127008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.64500000000000002}]},{"osd":1,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58999999999999997}]},{"osd":2,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.53600000000000003}]},{"osd":4,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.62}]},{"osd":5,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.495}]},{"osd":7,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.443},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.60699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.42399999999999999}]},{"osd":1,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.48399999999999999}]},{"osd":3,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.311}]},{"osd":6,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.33400000000000002}]},{"osd":7,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.45700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":119166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.52400000000000002}]},{"osd":2,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41499999999999998}]},{"osd":5,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.34499999999999997}]},{"osd":6,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.37},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.47599999999999998}]},{"osd":7,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.44700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":127008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.27700000000000002}]},{"osd":1,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.37},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.438},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.39200000000000002}]},{"osd":6,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.496}]},{"osd":7,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":119040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40699999999999997}]},{"osd":3,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32000000000000001}]},{"osd":4,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.61099999999999999}]},{"osd":6,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.629},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.57199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":119200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.375},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.316}]},{"osd":2,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.624},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54700000000000004}]},{"osd":7,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":710046,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.254}]},{"osd":2,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.28899999999999998}]},{"osd":3,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.52700000000000002}]},{"osd":6,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60599999999999998}]},{"osd":7,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":7968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":7968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T14:29:59.563 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-17T14:29:59.563 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T14:29:59.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.699+0000 7fadee34f640 1 Processor -- start 2024-02-17T14:29:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.699+0000 7fadee34f640 1 -- start start 2024-02-17T14:29:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fadee34f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fade8145080 0x7fade81444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fadee34f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fade8144a20 0x7fade8151940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fadee34f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade80af140 con 0x7fade814a880 2024-02-17T14:29:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fadee34f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade806dcb0 con 0x7fade8145080 2024-02-17T14:29:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fadee34f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade814ac60 con 0x7fade8144a20 2024-02-17T14:29:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fade77fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fade8145080 0x7fade81444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fade7fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fade814a880 0x7fade814afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52922/0 (socket says 172.21.15.134:52922) 2024-02-17T14:29:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fade77fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fade8145080 0x7fade81444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42890/0 (socket says 172.21.15.134:42890) 2024-02-17T14:29:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fade7fff640 1 -- 172.21.15.134:0/3011923074 learned_addr learned my addr 172.21.15.134:0/3011923074 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:29:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fadec8ec640 1 --2- 172.21.15.134:0/3011923074 >> v2:172.21.15.142:3300/0 conn(0x7fade8144a20 0x7fade8151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fade77fe640 1 -- 172.21.15.134:0/3011923074 >> v2:172.21.15.142:3300/0 conn(0x7fade8144a20 msgr2=0x7fade8151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:29:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fade77fe640 1 --2- 172.21.15.134:0/3011923074 >> v2:172.21.15.142:3300/0 conn(0x7fade8144a20 0x7fade8151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fade77fe640 1 -- 172.21.15.134:0/3011923074 >> v1:172.21.15.134:6789/0 conn(0x7fade814a880 legacy=0x7fade814afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fade77fe640 1 -- 172.21.15.134:0/3011923074 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade80adbb0 con 0x7fade8145080 2024-02-17T14:29:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.700+0000 7fade6ffd640 1 -- 172.21.15.134:0/3011923074 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992729228 0 0) 0x7fade80af140 con 0x7fade814a880 2024-02-17T14:29:59.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.701+0000 7fade77fe640 1 --2- 172.21.15.134:0/3011923074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade8145080 0x7fade81444e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fade80b6510 tx=0x7faddc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453c3262513003f1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:59.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.701+0000 7fade6ffd640 1 -- 172.21.15.134:0/3011923074 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc031830 con 0x7fade8145080 2024-02-17T14:29:59.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.701+0000 7fade6ffd640 1 -- 172.21.15.134:0/3011923074 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faddc031990 con 0x7fade8145080 2024-02-17T14:29:59.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.701+0000 7fade6ffd640 1 -- 172.21.15.134:0/3011923074 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc031d20 con 0x7fade8145080 2024-02-17T14:29:59.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.702+0000 7fadee34f640 1 -- 172.21.15.134:0/3011923074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade8145080 msgr2=0x7fade81444e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.702+0000 7fadee34f640 1 --2- 172.21.15.134:0/3011923074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade8145080 0x7fade81444e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fade80b6510 tx=0x7faddc02b8d0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.702+0000 7fadee34f640 1 -- 172.21.15.134:0/3011923074 shutdown_connections 2024-02-17T14:29:59.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.702+0000 7fadee34f640 1 --2- 172.21.15.134:0/3011923074 >> v2:172.21.15.142:3300/0 conn(0x7fade8144a20 0x7fade8151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.702+0000 7fadee34f640 1 --2- 172.21.15.134:0/3011923074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade8145080 0x7fade81444e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.702+0000 7fadee34f640 1 -- 172.21.15.134:0/3011923074 >> 172.21.15.134:0/3011923074 conn(0x7fade80b50e0 msgr2=0x7fade80b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:59.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.702+0000 7fadee34f640 1 -- 172.21.15.134:0/3011923074 shutdown_connections 2024-02-17T14:29:59.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.702+0000 7fadee34f640 1 -- 172.21.15.134:0/3011923074 wait complete. 2024-02-17T14:29:59.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.703+0000 7fadee34f640 1 Processor -- start 2024-02-17T14:29:59.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.703+0000 7fadee34f640 1 -- start start 2024-02-17T14:29:59.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.703+0000 7fadee34f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade8144a20 0x7fade80726c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.703+0000 7fadee34f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fade8145080 0x7fade80b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.703+0000 7fadee34f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fade814a880 0x7fade80b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.703+0000 7fadee34f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade80b0e30 con 0x7fade8144a20 2024-02-17T14:29:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.703+0000 7fadee34f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade80b24c0 con 0x7fade814a880 2024-02-17T14:29:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.703+0000 7fadee34f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade80b2980 con 0x7fade8145080 2024-02-17T14:29:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade8144a20 0x7fade80726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade8144a20 0x7fade80726c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42898/0 (socket says 172.21.15.134:42898) 2024-02-17T14:29:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade7fff640 1 -- 172.21.15.134:0/1479962064 learned_addr learned my addr 172.21.15.134:0/1479962064 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:29:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fadec8ec640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fade814a880 0x7fade80b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade77fe640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fade8145080 0x7fade80b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade7fff640 1 -- 172.21.15.134:0/1479962064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fade8145080 msgr2=0x7fade80b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade7fff640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fade8145080 0x7fade80b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade7fff640 1 -- 172.21.15.134:0/1479962064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fade814a880 msgr2=0x7fade80b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade7fff640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fade814a880 0x7fade80b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade7fff640 1 -- 172.21.15.134:0/1479962064 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc0093a0 con 0x7fade8144a20 2024-02-17T14:29:59.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade77fe640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fade8145080 0x7fade80b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:29:59.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fadec8ec640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fade814a880 0x7fade80b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:29:59.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade7fff640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade8144a20 0x7fade80726c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fadd800c430 tx=0x7fadd800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:59.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade4ff9640 1 -- 172.21.15.134:0/1479962064 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80074e0 con 0x7fade8144a20 2024-02-17T14:29:59.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade4ff9640 1 -- 172.21.15.134:0/1479962064 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd8007660 con 0x7fade8144a20 2024-02-17T14:29:59.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fadee34f640 1 -- 172.21.15.134:0/1479962064 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade80b0ae0 con 0x7fade8144a20 2024-02-17T14:29:59.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fade4ff9640 1 -- 172.21.15.134:0/1479962064 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8004a20 con 0x7fade8144a20 2024-02-17T14:29:59.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.704+0000 7fadee34f640 1 -- 172.21.15.134:0/1479962064 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade80b1790 con 0x7fade8144a20 2024-02-17T14:29:59.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.705+0000 7fadee34f640 1 -- 172.21.15.134:0/1479962064 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade80979a0 con 0x7fade8144a20 2024-02-17T14:29:59.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.706+0000 7fade4ff9640 1 -- 172.21.15.134:0/1479962064 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fadd8004b80 con 0x7fade8144a20 2024-02-17T14:29:59.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.706+0000 7fade4ff9640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fadd406b810 0x7fadd406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:29:59.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.706+0000 7fade4ff9640 1 -- 172.21.15.134:0/1479962064 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fadd808a340 con 0x7fade8144a20 2024-02-17T14:29:59.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.706+0000 7fade77fe640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fadd406b810 0x7fadd406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:29:59.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.706+0000 7fade77fe640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fadd406b810 0x7fadd406dcd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faddc036000 tx=0x7faddc03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:29:59.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.710+0000 7fade4ff9640 1 -- 172.21.15.134:0/1479962064 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fadd80549f0 con 0x7fade8144a20 2024-02-17T14:29:59.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.880+0000 7fadee34f640 1 -- 172.21.15.134:0/1479962064 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fade80b0f70 con 0x7fadd406b810 2024-02-17T14:29:59.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.890+0000 7fade4ff9640 1 -- 172.21.15.134:0/1479962064 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370994 (secure 0 0 0) 0x7fade80b0f70 con 0x7fadd406b810 2024-02-17T14:29:59.894 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:29:59.896 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-02-17T14:29:59.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.893+0000 7fadee34f640 1 -- 172.21.15.134:0/1479962064 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fadd406b810 msgr2=0x7fadd406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.893+0000 7fadee34f640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fadd406b810 0x7fadd406dcd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faddc036000 tx=0x7faddc03c040 comp rx=0 tx=0).stop 2024-02-17T14:29:59.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.893+0000 7fadee34f640 1 -- 172.21.15.134:0/1479962064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade8144a20 msgr2=0x7fade80726c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:29:59.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.893+0000 7fadee34f640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade8144a20 0x7fade80726c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fadd800c430 tx=0x7fadd800c8f0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.893+0000 7fadee34f640 1 -- 172.21.15.134:0/1479962064 shutdown_connections 2024-02-17T14:29:59.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.893+0000 7fadee34f640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fade814a880 0x7fade80b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.893+0000 7fadee34f640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fade8145080 0x7fade80b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.893+0000 7fadee34f640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fadd406b810 0x7fadd406dcd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.893+0000 7fadee34f640 1 --2- 172.21.15.134:0/1479962064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade8144a20 0x7fade80726c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:29:59.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.893+0000 7fadee34f640 1 -- 172.21.15.134:0/1479962064 >> 172.21.15.134:0/1479962064 conn(0x7fade80b50e0 msgr2=0x7fade80b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:29:59.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.894+0000 7fadee34f640 1 -- 172.21.15.134:0/1479962064 shutdown_connections 2024-02-17T14:29:59.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:29:59.894+0000 7fadee34f640 1 -- 172.21.15.134:0/1479962064 wait complete. 2024-02-17T14:29:59.904 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-02-17T14:29:58.593078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599134,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":215,"num_write_kb":2442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":2531328,"data_stored":2150588,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002946"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877225+0000","last_change":"2024-02-17T14:28:03.069069+0000","last_active":"2024-02-17T14:28:51.877225+0000","last_peered":"2024-02-17T14:28:51.877225+0000","last_clean":"2024-02-17T14:28:51.877225+0000","last_became_active":"2024-02-17T14:28:03.068714+0000","last_became_peered":"2024-02-17T14:28:03.068714+0000","last_unstale":"2024-02-17T14:28:51.877225+0000","last_undegraded":"2024-02-17T14:28:51.877225+0000","last_fullsized":"2024-02-17T14:28:51.877225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:49:37.606508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766915+0000","last_change":"2024-02-17T14:28:03.633277+0000","last_active":"2024-02-17T14:28:51.766915+0000","last_peered":"2024-02-17T14:28:51.766915+0000","last_clean":"2024-02-17T14:28:51.766915+0000","last_became_active":"2024-02-17T14:28:03.631462+0000","last_became_peered":"2024-02-17T14:28:03.631462+0000","last_unstale":"2024-02-17T14:28:51.766915+0000","last_undegraded":"2024-02-17T14:28:51.766915+0000","last_fullsized":"2024-02-17T14:28:51.766915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766084+0000","last_change":"2024-02-17T14:28:07.850214+0000","last_active":"2024-02-17T14:28:51.766084+0000","last_peered":"2024-02-17T14:28:51.766084+0000","last_clean":"2024-02-17T14:28:51.766084+0000","last_became_active":"2024-02-17T14:28:07.849871+0000","last_became_peered":"2024-02-17T14:28:07.849871+0000","last_unstale":"2024-02-17T14:28:51.766084+0000","last_undegraded":"2024-02-17T14:28:51.766084+0000","last_fullsized":"2024-02-17T14:28:51.766084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:46:12.614434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767115+0000","last_change":"2024-02-17T14:28:03.069234+0000","last_active":"2024-02-17T14:28:51.767115+0000","last_peered":"2024-02-17T14:28:51.767115+0000","last_clean":"2024-02-17T14:28:51.767115+0000","last_became_active":"2024-02-17T14:28:03.068978+0000","last_became_peered":"2024-02-17T14:28:03.068978+0000","last_unstale":"2024-02-17T14:28:51.767115+0000","last_undegraded":"2024-02-17T14:28:51.767115+0000","last_fullsized":"2024-02-17T14:28:51.767115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877045+0000","last_change":"2024-02-17T14:28:03.630763+0000","last_active":"2024-02-17T14:28:51.877045+0000","last_peered":"2024-02-17T14:28:51.877045+0000","last_clean":"2024-02-17T14:28:51.877045+0000","last_became_active":"2024-02-17T14:28:03.630517+0000","last_became_peered":"2024-02-17T14:28:03.630517+0000","last_unstale":"2024-02-17T14:28:51.877045+0000","last_undegraded":"2024-02-17T14:28:51.877045+0000","last_fullsized":"2024-02-17T14:28:51.877045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767213+0000","last_change":"2024-02-17T14:28:07.644982+0000","last_active":"2024-02-17T14:28:51.767213+0000","last_peered":"2024-02-17T14:28:51.767213+0000","last_clean":"2024-02-17T14:28:51.767213+0000","last_became_active":"2024-02-17T14:28:07.644458+0000","last_became_peered":"2024-02-17T14:28:07.644458+0000","last_unstale":"2024-02-17T14:28:51.767213+0000","last_undegraded":"2024-02-17T14:28:51.767213+0000","last_fullsized":"2024-02-17T14:28:51.767213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:42.133618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061064+0000","last_change":"2024-02-17T14:28:03.071236+0000","last_active":"2024-02-17T14:28:52.061064+0000","last_peered":"2024-02-17T14:28:52.061064+0000","last_clean":"2024-02-17T14:28:52.061064+0000","last_became_active":"2024-02-17T14:28:03.070955+0000","last_became_peered":"2024-02-17T14:28:03.070955+0000","last_unstale":"2024-02-17T14:28:52.061064+0000","last_undegraded":"2024-02-17T14:28:52.061064+0000","last_fullsized":"2024-02-17T14:28:52.061064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768896+0000","last_change":"2024-02-17T14:28:03.628182+0000","last_active":"2024-02-17T14:28:51.768896+0000","last_peered":"2024-02-17T14:28:51.768896+0000","last_clean":"2024-02-17T14:28:51.768896+0000","last_became_active":"2024-02-17T14:28:03.627865+0000","last_became_peered":"2024-02-17T14:28:03.627865+0000","last_unstale":"2024-02-17T14:28:51.768896+0000","last_undegraded":"2024-02-17T14:28:51.768896+0000","last_fullsized":"2024-02-17T14:28:51.768896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767499+0000","last_change":"2024-02-17T14:28:07.649384+0000","last_active":"2024-02-17T14:28:51.767499+0000","last_peered":"2024-02-17T14:28:51.767499+0000","last_clean":"2024-02-17T14:28:51.767499+0000","last_became_active":"2024-02-17T14:28:07.648936+0000","last_became_peered":"2024-02-17T14:28:07.648936+0000","last_unstale":"2024-02-17T14:28:51.767499+0000","last_undegraded":"2024-02-17T14:28:51.767499+0000","last_fullsized":"2024-02-17T14:28:51.767499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:13.199365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060828+0000","last_change":"2024-02-17T14:28:03.074776+0000","last_active":"2024-02-17T14:28:52.060828+0000","last_peered":"2024-02-17T14:28:52.060828+0000","last_clean":"2024-02-17T14:28:52.060828+0000","last_became_active":"2024-02-17T14:28:03.074490+0000","last_became_peered":"2024-02-17T14:28:03.074490+0000","last_unstale":"2024-02-17T14:28:52.060828+0000","last_undegraded":"2024-02-17T14:28:52.060828+0000","last_fullsized":"2024-02-17T14:28:52.060828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769046+0000","last_change":"2024-02-17T14:28:03.627957+0000","last_active":"2024-02-17T14:28:51.769046+0000","last_peered":"2024-02-17T14:28:51.769046+0000","last_clean":"2024-02-17T14:28:51.769046+0000","last_became_active":"2024-02-17T14:28:03.627675+0000","last_became_peered":"2024-02-17T14:28:03.627675+0000","last_unstale":"2024-02-17T14:28:51.769046+0000","last_undegraded":"2024-02-17T14:28:51.769046+0000","last_fullsized":"2024-02-17T14:28:51.769046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767195+0000","last_change":"2024-02-17T14:28:07.652422+0000","last_active":"2024-02-17T14:28:51.767195+0000","last_peered":"2024-02-17T14:28:51.767195+0000","last_clean":"2024-02-17T14:28:51.767195+0000","last_became_active":"2024-02-17T14:28:07.651946+0000","last_became_peered":"2024-02-17T14:28:07.651946+0000","last_unstale":"2024-02-17T14:28:51.767195+0000","last_undegraded":"2024-02-17T14:28:51.767195+0000","last_fullsized":"2024-02-17T14:28:51.767195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:21.967845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764800+0000","last_change":"2024-02-17T14:28:03.635059+0000","last_active":"2024-02-17T14:28:51.764800+0000","last_peered":"2024-02-17T14:28:51.764800+0000","last_clean":"2024-02-17T14:28:51.764800+0000","last_became_active":"2024-02-17T14:28:03.634759+0000","last_became_peered":"2024-02-17T14:28:03.634759+0000","last_unstale":"2024-02-17T14:28:51.764800+0000","last_undegraded":"2024-02-17T14:28:51.764800+0000","last_fullsized":"2024-02-17T14:28:51.764800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060724+0000","last_change":"2024-02-17T14:28:03.075604+0000","last_active":"2024-02-17T14:28:52.060724+0000","last_peered":"2024-02-17T14:28:52.060724+0000","last_clean":"2024-02-17T14:28:52.060724+0000","last_became_active":"2024-02-17T14:28:03.075329+0000","last_became_peered":"2024-02-17T14:28:03.075329+0000","last_unstale":"2024-02-17T14:28:52.060724+0000","last_undegraded":"2024-02-17T14:28:52.060724+0000","last_fullsized":"2024-02-17T14:28:52.060724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767399+0000","last_change":"2024-02-17T14:28:07.645791+0000","last_active":"2024-02-17T14:28:51.767399+0000","last_peered":"2024-02-17T14:28:51.767399+0000","last_clean":"2024-02-17T14:28:51.767399+0000","last_became_active":"2024-02-17T14:28:07.645418+0000","last_became_peered":"2024-02-17T14:28:07.645418+0000","last_unstale":"2024-02-17T14:28:51.767399+0000","last_undegraded":"2024-02-17T14:28:51.767399+0000","last_fullsized":"2024-02-17T14:28:51.767399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:26.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766726+0000","last_change":"2024-02-17T14:28:03.629378+0000","last_active":"2024-02-17T14:28:51.766726+0000","last_peered":"2024-02-17T14:28:51.766726+0000","last_clean":"2024-02-17T14:28:51.766726+0000","last_became_active":"2024-02-17T14:28:03.629097+0000","last_became_peered":"2024-02-17T14:28:03.629097+0000","last_unstale":"2024-02-17T14:28:51.766726+0000","last_undegraded":"2024-02-17T14:28:51.766726+0000","last_fullsized":"2024-02-17T14:28:51.766726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764993+0000","last_change":"2024-02-17T14:28:03.073579+0000","last_active":"2024-02-17T14:28:51.764993+0000","last_peered":"2024-02-17T14:28:51.764993+0000","last_clean":"2024-02-17T14:28:51.764993+0000","last_became_active":"2024-02-17T14:28:03.073167+0000","last_became_peered":"2024-02-17T14:28:03.073167+0000","last_unstale":"2024-02-17T14:28:51.764993+0000","last_undegraded":"2024-02-17T14:28:51.764993+0000","last_fullsized":"2024-02-17T14:28:51.764993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.773726+0000","last_change":"2024-02-17T14:28:51.773726+0000","last_active":"2024-02-17T14:28:51.773726+0000","last_peered":"2024-02-17T14:28:51.773726+0000","last_clean":"2024-02-17T14:28:51.773726+0000","last_became_active":"2024-02-17T14:28:51.773241+0000","last_became_peered":"2024-02-17T14:28:51.773241+0000","last_unstale":"2024-02-17T14:28:51.773726+0000","last_undegraded":"2024-02-17T14:28:51.773726+0000","last_fullsized":"2024-02-17T14:28:51.773726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:52.959315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766643+0000","last_change":"2024-02-17T14:28:03.628527+0000","last_active":"2024-02-17T14:28:51.766643+0000","last_peered":"2024-02-17T14:28:51.766643+0000","last_clean":"2024-02-17T14:28:51.766643+0000","last_became_active":"2024-02-17T14:28:03.628274+0000","last_became_peered":"2024-02-17T14:28:03.628274+0000","last_unstale":"2024-02-17T14:28:51.766643+0000","last_undegraded":"2024-02-17T14:28:51.766643+0000","last_fullsized":"2024-02-17T14:28:51.766643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765165+0000","last_change":"2024-02-17T14:28:03.072317+0000","last_active":"2024-02-17T14:28:51.765165+0000","last_peered":"2024-02-17T14:28:51.765165+0000","last_clean":"2024-02-17T14:28:51.765165+0000","last_became_active":"2024-02-17T14:28:03.072016+0000","last_became_peered":"2024-02-17T14:28:03.072016+0000","last_unstale":"2024-02-17T14:28:51.765165+0000","last_undegraded":"2024-02-17T14:28:51.765165+0000","last_fullsized":"2024-02-17T14:28:51.765165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764228+0000","last_change":"2024-02-17T14:28:07.851022+0000","last_active":"2024-02-17T14:28:51.764228+0000","last_peered":"2024-02-17T14:28:51.764228+0000","last_clean":"2024-02-17T14:28:51.764228+0000","last_became_active":"2024-02-17T14:28:07.850379+0000","last_became_peered":"2024-02-17T14:28:07.850379+0000","last_unstale":"2024-02-17T14:28:51.764228+0000","last_undegraded":"2024-02-17T14:28:51.764228+0000","last_fullsized":"2024-02-17T14:28:51.764228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768008+0000","last_change":"2024-02-17T14:28:03.624798+0000","last_active":"2024-02-17T14:28:51.768008+0000","last_peered":"2024-02-17T14:28:51.768008+0000","last_clean":"2024-02-17T14:28:51.768008+0000","last_became_active":"2024-02-17T14:28:03.624517+0000","last_became_peered":"2024-02-17T14:28:03.624517+0000","last_unstale":"2024-02-17T14:28:51.768008+0000","last_undegraded":"2024-02-17T14:28:51.768008+0000","last_fullsized":"2024-02-17T14:28:51.768008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:40.637145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060517+0000","last_change":"2024-02-17T14:28:03.072806+0000","last_active":"2024-02-17T14:28:52.060517+0000","last_peered":"2024-02-17T14:28:52.060517+0000","last_clean":"2024-02-17T14:28:52.060517+0000","last_became_active":"2024-02-17T14:28:03.072490+0000","last_became_peered":"2024-02-17T14:28:03.072490+0000","last_unstale":"2024-02-17T14:28:52.060517+0000","last_undegraded":"2024-02-17T14:28:52.060517+0000","last_fullsized":"2024-02-17T14:28:52.060517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.774116+0000","last_change":"2024-02-17T14:28:51.774116+0000","last_active":"2024-02-17T14:28:51.774116+0000","last_peered":"2024-02-17T14:28:51.774116+0000","last_clean":"2024-02-17T14:28:51.774116+0000","last_became_active":"2024-02-17T14:28:51.773478+0000","last_became_peered":"2024-02-17T14:28:51.773478+0000","last_unstale":"2024-02-17T14:28:51.774116+0000","last_undegraded":"2024-02-17T14:28:51.774116+0000","last_fullsized":"2024-02-17T14:28:51.774116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:00.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877331+0000","last_change":"2024-02-17T14:28:03.629190+0000","last_active":"2024-02-17T14:28:51.877331+0000","last_peered":"2024-02-17T14:28:51.877331+0000","last_clean":"2024-02-17T14:28:51.877331+0000","last_became_active":"2024-02-17T14:28:03.628777+0000","last_became_peered":"2024-02-17T14:28:03.628777+0000","last_unstale":"2024-02-17T14:28:51.877331+0000","last_undegraded":"2024-02-17T14:28:51.877331+0000","last_fullsized":"2024-02-17T14:28:51.877331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766033+0000","last_change":"2024-02-17T14:28:03.071097+0000","last_active":"2024-02-17T14:28:51.766033+0000","last_peered":"2024-02-17T14:28:51.766033+0000","last_clean":"2024-02-17T14:28:51.766033+0000","last_became_active":"2024-02-17T14:28:03.070790+0000","last_became_peered":"2024-02-17T14:28:03.070790+0000","last_unstale":"2024-02-17T14:28:51.766033+0000","last_undegraded":"2024-02-17T14:28:51.766033+0000","last_fullsized":"2024-02-17T14:28:51.766033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767459+0000","last_change":"2024-02-17T14:28:07.849764+0000","last_active":"2024-02-17T14:28:51.767459+0000","last_peered":"2024-02-17T14:28:51.767459+0000","last_clean":"2024-02-17T14:28:51.767459+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:51.767459+0000","last_undegraded":"2024-02-17T14:28:51.767459+0000","last_fullsized":"2024-02-17T14:28:51.767459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767308+0000","last_change":"2024-02-17T14:28:03.641818+0000","last_active":"2024-02-17T14:28:51.767308+0000","last_peered":"2024-02-17T14:28:51.767308+0000","last_clean":"2024-02-17T14:28:51.767308+0000","last_became_active":"2024-02-17T14:28:03.641577+0000","last_became_peered":"2024-02-17T14:28:03.641577+0000","last_unstale":"2024-02-17T14:28:51.767308+0000","last_undegraded":"2024-02-17T14:28:51.767308+0000","last_fullsized":"2024-02-17T14:28:51.767308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765366+0000","last_change":"2024-02-17T14:28:03.072074+0000","last_active":"2024-02-17T14:28:51.765366+0000","last_peered":"2024-02-17T14:28:51.765366+0000","last_clean":"2024-02-17T14:28:51.765366+0000","last_became_active":"2024-02-17T14:28:03.071850+0000","last_became_peered":"2024-02-17T14:28:03.071850+0000","last_unstale":"2024-02-17T14:28:51.765366+0000","last_undegraded":"2024-02-17T14:28:51.765366+0000","last_fullsized":"2024-02-17T14:28:51.765366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.062350+0000","last_change":"2024-02-17T14:28:52.062350+0000","last_active":"2024-02-17T14:28:52.062350+0000","last_peered":"2024-02-17T14:28:52.062350+0000","last_clean":"2024-02-17T14:28:52.062350+0000","last_became_active":"2024-02-17T14:28:52.061827+0000","last_became_peered":"2024-02-17T14:28:52.061827+0000","last_unstale":"2024-02-17T14:28:52.062350+0000","last_undegraded":"2024-02-17T14:28:52.062350+0000","last_fullsized":"2024-02-17T14:28:52.062350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:55:43.813329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764924+0000","last_change":"2024-02-17T14:28:03.632265+0000","last_active":"2024-02-17T14:28:51.764924+0000","last_peered":"2024-02-17T14:28:51.764924+0000","last_clean":"2024-02-17T14:28:51.764924+0000","last_became_active":"2024-02-17T14:28:03.632020+0000","last_became_peered":"2024-02-17T14:28:03.632020+0000","last_unstale":"2024-02-17T14:28:51.764924+0000","last_undegraded":"2024-02-17T14:28:51.764924+0000","last_fullsized":"2024-02-17T14:28:51.764924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061173+0000","last_change":"2024-02-17T14:28:03.072252+0000","last_active":"2024-02-17T14:28:52.061173+0000","last_peered":"2024-02-17T14:28:52.061173+0000","last_clean":"2024-02-17T14:28:52.061173+0000","last_became_active":"2024-02-17T14:28:03.071830+0000","last_became_peered":"2024-02-17T14:28:03.071830+0000","last_unstale":"2024-02-17T14:28:52.061173+0000","last_undegraded":"2024-02-17T14:28:52.061173+0000","last_fullsized":"2024-02-17T14:28:52.061173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:24.870956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876708+0000","last_change":"2024-02-17T14:28:07.849579+0000","last_active":"2024-02-17T14:28:51.876708+0000","last_peered":"2024-02-17T14:28:51.876708+0000","last_clean":"2024-02-17T14:28:51.876708+0000","last_became_active":"2024-02-17T14:28:07.849212+0000","last_became_peered":"2024-02-17T14:28:07.849212+0000","last_unstale":"2024-02-17T14:28:51.876708+0000","last_undegraded":"2024-02-17T14:28:51.876708+0000","last_fullsized":"2024-02-17T14:28:51.876708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769189+0000","last_change":"2024-02-17T14:28:03.626429+0000","last_active":"2024-02-17T14:28:51.769189+0000","last_peered":"2024-02-17T14:28:51.769189+0000","last_clean":"2024-02-17T14:28:51.769189+0000","last_became_active":"2024-02-17T14:28:03.626174+0000","last_became_peered":"2024-02-17T14:28:03.626174+0000","last_unstale":"2024-02-17T14:28:51.769189+0000","last_undegraded":"2024-02-17T14:28:51.769189+0000","last_fullsized":"2024-02-17T14:28:51.769189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765010+0000","last_change":"2024-02-17T14:28:03.068443+0000","last_active":"2024-02-17T14:28:51.765010+0000","last_peered":"2024-02-17T14:28:51.765010+0000","last_clean":"2024-02-17T14:28:51.765010+0000","last_became_active":"2024-02-17T14:28:03.068179+0000","last_became_peered":"2024-02-17T14:28:03.068179+0000","last_unstale":"2024-02-17T14:28:51.765010+0000","last_undegraded":"2024-02-17T14:28:51.765010+0000","last_fullsized":"2024-02-17T14:28:51.765010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764207+0000","last_change":"2024-02-17T14:28:07.650015+0000","last_active":"2024-02-17T14:28:51.764207+0000","last_peered":"2024-02-17T14:28:51.764207+0000","last_clean":"2024-02-17T14:28:51.764207+0000","last_became_active":"2024-02-17T14:28:07.647918+0000","last_became_peered":"2024-02-17T14:28:07.647918+0000","last_unstale":"2024-02-17T14:28:51.764207+0000","last_undegraded":"2024-02-17T14:28:51.764207+0000","last_fullsized":"2024-02-17T14:28:51.764207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767904+0000","last_change":"2024-02-17T14:28:03.629343+0000","last_active":"2024-02-17T14:28:51.767904+0000","last_peered":"2024-02-17T14:28:51.767904+0000","last_clean":"2024-02-17T14:28:51.767904+0000","last_became_active":"2024-02-17T14:28:03.629077+0000","last_became_peered":"2024-02-17T14:28:03.629077+0000","last_unstale":"2024-02-17T14:28:51.767904+0000","last_undegraded":"2024-02-17T14:28:51.767904+0000","last_fullsized":"2024-02-17T14:28:51.767904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:36.441335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769239+0000","last_change":"2024-02-17T14:28:03.069178+0000","last_active":"2024-02-17T14:28:51.769239+0000","last_peered":"2024-02-17T14:28:51.769239+0000","last_clean":"2024-02-17T14:28:51.769239+0000","last_became_active":"2024-02-17T14:28:03.068923+0000","last_became_peered":"2024-02-17T14:28:03.068923+0000","last_unstale":"2024-02-17T14:28:51.769239+0000","last_undegraded":"2024-02-17T14:28:51.769239+0000","last_fullsized":"2024-02-17T14:28:51.769239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764806+0000","last_change":"2024-02-17T14:28:07.648757+0000","last_active":"2024-02-17T14:28:51.764806+0000","last_peered":"2024-02-17T14:28:51.764806+0000","last_clean":"2024-02-17T14:28:51.764806+0000","last_became_active":"2024-02-17T14:28:07.645156+0000","last_became_peered":"2024-02-17T14:28:07.645156+0000","last_unstale":"2024-02-17T14:28:51.764806+0000","last_undegraded":"2024-02-17T14:28:51.764806+0000","last_fullsized":"2024-02-17T14:28:51.764806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:11.740506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764279+0000","last_change":"2024-02-17T14:28:03.627479+0000","last_active":"2024-02-17T14:28:51.764279+0000","last_peered":"2024-02-17T14:28:51.764279+0000","last_clean":"2024-02-17T14:28:51.764279+0000","last_became_active":"2024-02-17T14:28:03.627165+0000","last_became_peered":"2024-02-17T14:28:03.627165+0000","last_unstale":"2024-02-17T14:28:51.764279+0000","last_undegraded":"2024-02-17T14:28:51.764279+0000","last_fullsized":"2024-02-17T14:28:51.764279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.763758+0000","last_change":"2024-02-17T14:28:03.066452+0000","last_active":"2024-02-17T14:28:51.763758+0000","last_peered":"2024-02-17T14:28:51.763758+0000","last_clean":"2024-02-17T14:28:51.763758+0000","last_became_active":"2024-02-17T14:28:03.066156+0000","last_became_peered":"2024-02-17T14:28:03.066156+0000","last_unstale":"2024-02-17T14:28:51.763758+0000","last_undegraded":"2024-02-17T14:28:51.763758+0000","last_fullsized":"2024-02-17T14:28:51.763758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764316+0000","last_change":"2024-02-17T14:28:07.649765+0000","last_active":"2024-02-17T14:28:51.764316+0000","last_peered":"2024-02-17T14:28:51.764316+0000","last_clean":"2024-02-17T14:28:51.764316+0000","last_became_active":"2024-02-17T14:28:07.649403+0000","last_became_peered":"2024-02-17T14:28:07.649403+0000","last_unstale":"2024-02-17T14:28:51.764316+0000","last_undegraded":"2024-02-17T14:28:51.764316+0000","last_fullsized":"2024-02-17T14:28:51.764316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876601+0000","last_change":"2024-02-17T14:28:03.629628+0000","last_active":"2024-02-17T14:28:51.876601+0000","last_peered":"2024-02-17T14:28:51.876601+0000","last_clean":"2024-02-17T14:28:51.876601+0000","last_became_active":"2024-02-17T14:28:03.629247+0000","last_became_peered":"2024-02-17T14:28:03.629247+0000","last_unstale":"2024-02-17T14:28:51.876601+0000","last_undegraded":"2024-02-17T14:28:51.876601+0000","last_fullsized":"2024-02-17T14:28:51.876601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:00:51.336643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060538+0000","last_change":"2024-02-17T14:28:03.072090+0000","last_active":"2024-02-17T14:28:52.060538+0000","last_peered":"2024-02-17T14:28:52.060538+0000","last_clean":"2024-02-17T14:28:52.060538+0000","last_became_active":"2024-02-17T14:28:03.071778+0000","last_became_peered":"2024-02-17T14:28:03.071778+0000","last_unstale":"2024-02-17T14:28:52.060538+0000","last_undegraded":"2024-02-17T14:28:52.060538+0000","last_fullsized":"2024-02-17T14:28:52.060538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877170+0000","last_change":"2024-02-17T14:28:07.850472+0000","last_active":"2024-02-17T14:28:51.877170+0000","last_peered":"2024-02-17T14:28:51.877170+0000","last_clean":"2024-02-17T14:28:51.877170+0000","last_became_active":"2024-02-17T14:28:07.850106+0000","last_became_peered":"2024-02-17T14:28:07.850106+0000","last_unstale":"2024-02-17T14:28:51.877170+0000","last_undegraded":"2024-02-17T14:28:51.877170+0000","last_fullsized":"2024-02-17T14:28:51.877170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:14.414246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766517+0000","last_change":"2024-02-17T14:28:03.635109+0000","last_active":"2024-02-17T14:28:51.766517+0000","last_peered":"2024-02-17T14:28:51.766517+0000","last_clean":"2024-02-17T14:28:51.766517+0000","last_became_active":"2024-02-17T14:28:03.634570+0000","last_became_peered":"2024-02-17T14:28:03.634570+0000","last_unstale":"2024-02-17T14:28:51.766517+0000","last_undegraded":"2024-02-17T14:28:51.766517+0000","last_fullsized":"2024-02-17T14:28:51.766517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768818+0000","last_change":"2024-02-17T14:28:03.061647+0000","last_active":"2024-02-17T14:28:51.768818+0000","last_peered":"2024-02-17T14:28:51.768818+0000","last_clean":"2024-02-17T14:28:51.768818+0000","last_became_active":"2024-02-17T14:28:03.061026+0000","last_became_peered":"2024-02-17T14:28:03.061026+0000","last_unstale":"2024-02-17T14:28:51.768818+0000","last_undegraded":"2024-02-17T14:28:51.768818+0000","last_fullsized":"2024-02-17T14:28:51.768818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060684+0000","last_change":"2024-02-17T14:28:00.253131+0000","last_active":"2024-02-17T14:28:52.060684+0000","last_peered":"2024-02-17T14:28:52.060684+0000","last_clean":"2024-02-17T14:28:52.060684+0000","last_became_active":"2024-02-17T14:28:00.252180+0000","last_became_peered":"2024-02-17T14:28:00.252180+0000","last_unstale":"2024-02-17T14:28:52.060684+0000","last_undegraded":"2024-02-17T14:28:52.060684+0000","last_fullsized":"2024-02-17T14:28:52.060684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_clean_scrub_stamp":"2024-02-17T14:27:59.037303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:48.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764838+0000","last_change":"2024-02-17T14:28:07.849676+0000","last_active":"2024-02-17T14:28:51.764838+0000","last_peered":"2024-02-17T14:28:51.764838+0000","last_clean":"2024-02-17T14:28:51.764838+0000","last_became_active":"2024-02-17T14:28:07.849264+0000","last_became_peered":"2024-02-17T14:28:07.849264+0000","last_unstale":"2024-02-17T14:28:51.764838+0000","last_undegraded":"2024-02-17T14:28:51.764838+0000","last_fullsized":"2024-02-17T14:28:51.764838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060912+0000","last_change":"2024-02-17T14:28:03.642433+0000","last_active":"2024-02-17T14:28:52.060912+0000","last_peered":"2024-02-17T14:28:52.060912+0000","last_clean":"2024-02-17T14:28:52.060912+0000","last_became_active":"2024-02-17T14:28:03.641815+0000","last_became_peered":"2024-02-17T14:28:03.641815+0000","last_unstale":"2024-02-17T14:28:52.060912+0000","last_undegraded":"2024-02-17T14:28:52.060912+0000","last_fullsized":"2024-02-17T14:28:52.060912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:38.398272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764481+0000","last_change":"2024-02-17T14:28:03.066483+0000","last_active":"2024-02-17T14:28:51.764481+0000","last_peered":"2024-02-17T14:28:51.764481+0000","last_clean":"2024-02-17T14:28:51.764481+0000","last_became_active":"2024-02-17T14:28:03.066169+0000","last_became_peered":"2024-02-17T14:28:03.066169+0000","last_unstale":"2024-02-17T14:28:51.764481+0000","last_undegraded":"2024-02-17T14:28:51.764481+0000","last_fullsized":"2024-02-17T14:28:51.764481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764767+0000","last_change":"2024-02-17T14:28:07.846685+0000","last_active":"2024-02-17T14:28:51.764767+0000","last_peered":"2024-02-17T14:28:51.764767+0000","last_clean":"2024-02-17T14:28:51.764767+0000","last_became_active":"2024-02-17T14:28:07.846265+0000","last_became_peered":"2024-02-17T14:28:07.846265+0000","last_unstale":"2024-02-17T14:28:51.764767+0000","last_undegraded":"2024-02-17T14:28:51.764767+0000","last_fullsized":"2024-02-17T14:28:51.764767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769117+0000","last_change":"2024-02-17T14:28:03.634574+0000","last_active":"2024-02-17T14:28:51.769117+0000","last_peered":"2024-02-17T14:28:51.769117+0000","last_clean":"2024-02-17T14:28:51.769117+0000","last_became_active":"2024-02-17T14:28:03.634290+0000","last_became_peered":"2024-02-17T14:28:03.634290+0000","last_unstale":"2024-02-17T14:28:51.769117+0000","last_undegraded":"2024-02-17T14:28:51.769117+0000","last_fullsized":"2024-02-17T14:28:51.769117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765080+0000","last_change":"2024-02-17T14:28:03.072793+0000","last_active":"2024-02-17T14:28:51.765080+0000","last_peered":"2024-02-17T14:28:51.765080+0000","last_clean":"2024-02-17T14:28:51.765080+0000","last_became_active":"2024-02-17T14:28:03.072497+0000","last_became_peered":"2024-02-17T14:28:03.072497+0000","last_unstale":"2024-02-17T14:28:51.765080+0000","last_undegraded":"2024-02-17T14:28:51.765080+0000","last_fullsized":"2024-02-17T14:28:51.765080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876966+0000","last_change":"2024-02-17T14:28:07.651730+0000","last_active":"2024-02-17T14:28:51.876966+0000","last_peered":"2024-02-17T14:28:51.876966+0000","last_clean":"2024-02-17T14:28:51.876966+0000","last_became_active":"2024-02-17T14:28:07.651144+0000","last_became_peered":"2024-02-17T14:28:07.651144+0000","last_unstale":"2024-02-17T14:28:51.876966+0000","last_undegraded":"2024-02-17T14:28:51.876966+0000","last_fullsized":"2024-02-17T14:28:51.876966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:05.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061174+0000","last_change":"2024-02-17T14:28:03.643461+0000","last_active":"2024-02-17T14:28:52.061174+0000","last_peered":"2024-02-17T14:28:52.061174+0000","last_clean":"2024-02-17T14:28:52.061174+0000","last_became_active":"2024-02-17T14:28:03.643033+0000","last_became_peered":"2024-02-17T14:28:03.643033+0000","last_unstale":"2024-02-17T14:28:52.061174+0000","last_undegraded":"2024-02-17T14:28:52.061174+0000","last_fullsized":"2024-02-17T14:28:52.061174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:01.946139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764369+0000","last_change":"2024-02-17T14:28:03.067046+0000","last_active":"2024-02-17T14:28:51.764369+0000","last_peered":"2024-02-17T14:28:51.764369+0000","last_clean":"2024-02-17T14:28:51.764369+0000","last_became_active":"2024-02-17T14:28:03.066797+0000","last_became_peered":"2024-02-17T14:28:03.066797+0000","last_unstale":"2024-02-17T14:28:51.764369+0000","last_undegraded":"2024-02-17T14:28:51.764369+0000","last_fullsized":"2024-02-17T14:28:51.764369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768577+0000","last_change":"2024-02-17T14:28:07.850145+0000","last_active":"2024-02-17T14:28:51.768577+0000","last_peered":"2024-02-17T14:28:51.768577+0000","last_clean":"2024-02-17T14:28:51.768577+0000","last_became_active":"2024-02-17T14:28:07.849280+0000","last_became_peered":"2024-02-17T14:28:07.849280+0000","last_unstale":"2024-02-17T14:28:51.768577+0000","last_undegraded":"2024-02-17T14:28:51.768577+0000","last_fullsized":"2024-02-17T14:28:51.768577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061064+0000","last_change":"2024-02-17T14:28:03.641357+0000","last_active":"2024-02-17T14:28:52.061064+0000","last_peered":"2024-02-17T14:28:52.061064+0000","last_clean":"2024-02-17T14:28:52.061064+0000","last_became_active":"2024-02-17T14:28:03.640945+0000","last_became_peered":"2024-02-17T14:28:03.640945+0000","last_unstale":"2024-02-17T14:28:52.061064+0000","last_undegraded":"2024-02-17T14:28:52.061064+0000","last_fullsized":"2024-02-17T14:28:52.061064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767772+0000","last_change":"2024-02-17T14:28:03.066640+0000","last_active":"2024-02-17T14:28:51.767772+0000","last_peered":"2024-02-17T14:28:51.767772+0000","last_clean":"2024-02-17T14:28:51.767772+0000","last_became_active":"2024-02-17T14:28:03.066350+0000","last_became_peered":"2024-02-17T14:28:03.066350+0000","last_unstale":"2024-02-17T14:28:51.767772+0000","last_undegraded":"2024-02-17T14:28:51.767772+0000","last_fullsized":"2024-02-17T14:28:51.767772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:43.162911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767064+0000","last_change":"2024-02-17T14:28:07.652490+0000","last_active":"2024-02-17T14:28:51.767064+0000","last_peered":"2024-02-17T14:28:51.767064+0000","last_clean":"2024-02-17T14:28:51.767064+0000","last_became_active":"2024-02-17T14:28:07.652088+0000","last_became_peered":"2024-02-17T14:28:07.652088+0000","last_unstale":"2024-02-17T14:28:51.767064+0000","last_undegraded":"2024-02-17T14:28:51.767064+0000","last_fullsized":"2024-02-17T14:28:51.767064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:41.975941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.770874+0000","last_change":"2024-02-17T14:28:51.770495+0000","last_active":"2024-02-17T14:28:51.770874+0000","last_peered":"2024-02-17T14:28:51.770874+0000","last_clean":"2024-02-17T14:28:51.770874+0000","last_became_active":"2024-02-17T14:28:51.770241+0000","last_became_peered":"2024-02-17T14:28:51.770241+0000","last_unstale":"2024-02-17T14:28:51.770874+0000","last_undegraded":"2024-02-17T14:28:51.770874+0000","last_fullsized":"2024-02-17T14:28:51.770874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:24:37.784887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.763658+0000","last_change":"2024-02-17T14:28:03.070146+0000","last_active":"2024-02-17T14:28:51.763658+0000","last_peered":"2024-02-17T14:28:51.763658+0000","last_clean":"2024-02-17T14:28:51.763658+0000","last_became_active":"2024-02-17T14:28:03.069867+0000","last_became_peered":"2024-02-17T14:28:03.069867+0000","last_unstale":"2024-02-17T14:28:51.763658+0000","last_undegraded":"2024-02-17T14:28:51.763658+0000","last_fullsized":"2024-02-17T14:28:51.763658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877077+0000","last_change":"2024-02-17T14:28:07.644792+0000","last_active":"2024-02-17T14:28:51.877077+0000","last_peered":"2024-02-17T14:28:51.877077+0000","last_clean":"2024-02-17T14:28:51.877077+0000","last_became_active":"2024-02-17T14:28:07.644452+0000","last_became_peered":"2024-02-17T14:28:07.644452+0000","last_unstale":"2024-02-17T14:28:51.877077+0000","last_undegraded":"2024-02-17T14:28:51.877077+0000","last_fullsized":"2024-02-17T14:28:51.877077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764787+0000","last_change":"2024-02-17T14:28:03.630962+0000","last_active":"2024-02-17T14:28:51.764787+0000","last_peered":"2024-02-17T14:28:51.764787+0000","last_clean":"2024-02-17T14:28:51.764787+0000","last_became_active":"2024-02-17T14:28:03.630239+0000","last_became_peered":"2024-02-17T14:28:03.630239+0000","last_unstale":"2024-02-17T14:28:51.764787+0000","last_undegraded":"2024-02-17T14:28:51.764787+0000","last_fullsized":"2024-02-17T14:28:51.764787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764895+0000","last_change":"2024-02-17T14:28:03.073091+0000","last_active":"2024-02-17T14:28:51.764895+0000","last_peered":"2024-02-17T14:28:51.764895+0000","last_clean":"2024-02-17T14:28:51.764895+0000","last_became_active":"2024-02-17T14:28:03.072801+0000","last_became_peered":"2024-02-17T14:28:03.072801+0000","last_unstale":"2024-02-17T14:28:51.764895+0000","last_undegraded":"2024-02-17T14:28:51.764895+0000","last_fullsized":"2024-02-17T14:28:51.764895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767224+0000","last_change":"2024-02-17T14:28:07.849362+0000","last_active":"2024-02-17T14:28:51.767224+0000","last_peered":"2024-02-17T14:28:51.767224+0000","last_clean":"2024-02-17T14:28:51.767224+0000","last_became_active":"2024-02-17T14:28:07.848991+0000","last_became_peered":"2024-02-17T14:28:07.848991+0000","last_unstale":"2024-02-17T14:28:51.767224+0000","last_undegraded":"2024-02-17T14:28:51.767224+0000","last_fullsized":"2024-02-17T14:28:51.767224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:52.959315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060690+0000","last_change":"2024-02-17T14:28:03.641810+0000","last_active":"2024-02-17T14:28:52.060690+0000","last_peered":"2024-02-17T14:28:52.060690+0000","last_clean":"2024-02-17T14:28:52.060690+0000","last_became_active":"2024-02-17T14:28:03.641501+0000","last_became_peered":"2024-02-17T14:28:03.641501+0000","last_unstale":"2024-02-17T14:28:52.060690+0000","last_undegraded":"2024-02-17T14:28:52.060690+0000","last_fullsized":"2024-02-17T14:28:52.060690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769153+0000","last_change":"2024-02-17T14:28:03.066989+0000","last_active":"2024-02-17T14:28:51.769153+0000","last_peered":"2024-02-17T14:28:51.769153+0000","last_clean":"2024-02-17T14:28:51.769153+0000","last_became_active":"2024-02-17T14:28:03.066538+0000","last_became_peered":"2024-02-17T14:28:03.066538+0000","last_unstale":"2024-02-17T14:28:51.769153+0000","last_undegraded":"2024-02-17T14:28:51.769153+0000","last_fullsized":"2024-02-17T14:28:51.769153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767019+0000","last_change":"2024-02-17T14:28:07.846885+0000","last_active":"2024-02-17T14:28:51.767019+0000","last_peered":"2024-02-17T14:28:51.767019+0000","last_clean":"2024-02-17T14:28:51.767019+0000","last_became_active":"2024-02-17T14:28:07.846413+0000","last_became_peered":"2024-02-17T14:28:07.846413+0000","last_unstale":"2024-02-17T14:28:51.767019+0000","last_undegraded":"2024-02-17T14:28:51.767019+0000","last_fullsized":"2024-02-17T14:28:51.767019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:00.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876797+0000","last_change":"2024-02-17T14:28:03.638054+0000","last_active":"2024-02-17T14:28:51.876797+0000","last_peered":"2024-02-17T14:28:51.876797+0000","last_clean":"2024-02-17T14:28:51.876797+0000","last_became_active":"2024-02-17T14:28:03.637831+0000","last_became_peered":"2024-02-17T14:28:03.637831+0000","last_unstale":"2024-02-17T14:28:51.876797+0000","last_undegraded":"2024-02-17T14:28:51.876797+0000","last_fullsized":"2024-02-17T14:28:51.876797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:11:23.521059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877154+0000","last_change":"2024-02-17T14:28:03.064510+0000","last_active":"2024-02-17T14:28:51.877154+0000","last_peered":"2024-02-17T14:28:51.877154+0000","last_clean":"2024-02-17T14:28:51.877154+0000","last_became_active":"2024-02-17T14:28:03.064226+0000","last_became_peered":"2024-02-17T14:28:03.064226+0000","last_unstale":"2024-02-17T14:28:51.877154+0000","last_undegraded":"2024-02-17T14:28:51.877154+0000","last_fullsized":"2024-02-17T14:28:51.877154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:26:19.467344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769043+0000","last_change":"2024-02-17T14:28:07.849775+0000","last_active":"2024-02-17T14:28:51.769043+0000","last_peered":"2024-02-17T14:28:51.769043+0000","last_clean":"2024-02-17T14:28:51.769043+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:51.769043+0000","last_undegraded":"2024-02-17T14:28:51.769043+0000","last_fullsized":"2024-02-17T14:28:51.769043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060827+0000","last_change":"2024-02-17T14:28:03.642582+0000","last_active":"2024-02-17T14:28:52.060827+0000","last_peered":"2024-02-17T14:28:52.060827+0000","last_clean":"2024-02-17T14:28:52.060827+0000","last_became_active":"2024-02-17T14:28:03.642077+0000","last_became_peered":"2024-02-17T14:28:03.642077+0000","last_unstale":"2024-02-17T14:28:52.060827+0000","last_undegraded":"2024-02-17T14:28:52.060827+0000","last_fullsized":"2024-02-17T14:28:52.060827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'13","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765489+0000","last_change":"2024-02-17T14:28:03.071791+0000","last_active":"2024-02-17T14:28:51.765489+0000","last_peered":"2024-02-17T14:28:51.765489+0000","last_clean":"2024-02-17T14:28:51.765489+0000","last_became_active":"2024-02-17T14:28:03.071303+0000","last_became_peered":"2024-02-17T14:28:03.071303+0000","last_unstale":"2024-02-17T14:28:51.765489+0000","last_undegraded":"2024-02-17T14:28:51.765489+0000","last_fullsized":"2024-02-17T14:28:51.765489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7968,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764804+0000","last_change":"2024-02-17T14:28:07.649531+0000","last_active":"2024-02-17T14:28:51.764804+0000","last_peered":"2024-02-17T14:28:51.764804+0000","last_clean":"2024-02-17T14:28:51.764804+0000","last_became_active":"2024-02-17T14:28:07.645313+0000","last_became_peered":"2024-02-17T14:28:07.645313+0000","last_unstale":"2024-02-17T14:28:51.764804+0000","last_undegraded":"2024-02-17T14:28:51.764804+0000","last_fullsized":"2024-02-17T14:28:51.764804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:21:00.775032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768488+0000","last_change":"2024-02-17T14:28:03.638812+0000","last_active":"2024-02-17T14:28:51.768488+0000","last_peered":"2024-02-17T14:28:51.768488+0000","last_clean":"2024-02-17T14:28:51.768488+0000","last_became_active":"2024-02-17T14:28:03.637937+0000","last_became_peered":"2024-02-17T14:28:03.637937+0000","last_unstale":"2024-02-17T14:28:51.768488+0000","last_undegraded":"2024-02-17T14:28:51.768488+0000","last_fullsized":"2024-02-17T14:28:51.768488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764994+0000","last_change":"2024-02-17T14:28:03.069972+0000","last_active":"2024-02-17T14:28:51.764994+0000","last_peered":"2024-02-17T14:28:51.764994+0000","last_clean":"2024-02-17T14:28:51.764994+0000","last_became_active":"2024-02-17T14:28:03.069690+0000","last_became_peered":"2024-02-17T14:28:03.069690+0000","last_unstale":"2024-02-17T14:28:51.764994+0000","last_undegraded":"2024-02-17T14:28:51.764994+0000","last_fullsized":"2024-02-17T14:28:51.764994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767677+0000","last_change":"2024-02-17T14:28:07.647825+0000","last_active":"2024-02-17T14:28:51.767677+0000","last_peered":"2024-02-17T14:28:51.767677+0000","last_clean":"2024-02-17T14:28:51.767677+0000","last_became_active":"2024-02-17T14:28:07.647420+0000","last_became_peered":"2024-02-17T14:28:07.647420+0000","last_unstale":"2024-02-17T14:28:51.767677+0000","last_undegraded":"2024-02-17T14:28:51.767677+0000","last_fullsized":"2024-02-17T14:28:51.767677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877199+0000","last_change":"2024-02-17T14:28:03.631000+0000","last_active":"2024-02-17T14:28:51.877199+0000","last_peered":"2024-02-17T14:28:51.877199+0000","last_clean":"2024-02-17T14:28:51.877199+0000","last_became_active":"2024-02-17T14:28:03.630169+0000","last_became_peered":"2024-02-17T14:28:03.630169+0000","last_unstale":"2024-02-17T14:28:51.877199+0000","last_undegraded":"2024-02-17T14:28:51.877199+0000","last_fullsized":"2024-02-17T14:28:51.877199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768929+0000","last_change":"2024-02-17T14:28:03.069911+0000","last_active":"2024-02-17T14:28:51.768929+0000","last_peered":"2024-02-17T14:28:51.768929+0000","last_clean":"2024-02-17T14:28:51.768929+0000","last_became_active":"2024-02-17T14:28:03.069617+0000","last_became_peered":"2024-02-17T14:28:03.069617+0000","last_unstale":"2024-02-17T14:28:51.768929+0000","last_undegraded":"2024-02-17T14:28:51.768929+0000","last_fullsized":"2024-02-17T14:28:51.768929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766539+0000","last_change":"2024-02-17T14:28:07.646742+0000","last_active":"2024-02-17T14:28:51.766539+0000","last_peered":"2024-02-17T14:28:51.766539+0000","last_clean":"2024-02-17T14:28:51.766539+0000","last_became_active":"2024-02-17T14:28:07.646403+0000","last_became_peered":"2024-02-17T14:28:07.646403+0000","last_unstale":"2024-02-17T14:28:51.766539+0000","last_undegraded":"2024-02-17T14:28:51.766539+0000","last_fullsized":"2024-02-17T14:28:51.766539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768969+0000","last_change":"2024-02-17T14:28:03.638522+0000","last_active":"2024-02-17T14:28:51.768969+0000","last_peered":"2024-02-17T14:28:51.768969+0000","last_clean":"2024-02-17T14:28:51.768969+0000","last_became_active":"2024-02-17T14:28:03.638281+0000","last_became_peered":"2024-02-17T14:28:03.638281+0000","last_unstale":"2024-02-17T14:28:51.768969+0000","last_undegraded":"2024-02-17T14:28:51.768969+0000","last_fullsized":"2024-02-17T14:28:51.768969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765890+0000","last_change":"2024-02-17T14:28:03.072855+0000","last_active":"2024-02-17T14:28:51.765890+0000","last_peered":"2024-02-17T14:28:51.765890+0000","last_clean":"2024-02-17T14:28:51.765890+0000","last_became_active":"2024-02-17T14:28:03.072571+0000","last_became_peered":"2024-02-17T14:28:03.072571+0000","last_unstale":"2024-02-17T14:28:51.765890+0000","last_undegraded":"2024-02-17T14:28:51.765890+0000","last_fullsized":"2024-02-17T14:28:51.765890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766155+0000","last_change":"2024-02-17T14:28:07.849448+0000","last_active":"2024-02-17T14:28:51.766155+0000","last_peered":"2024-02-17T14:28:51.766155+0000","last_clean":"2024-02-17T14:28:51.766155+0000","last_became_active":"2024-02-17T14:28:07.849096+0000","last_became_peered":"2024-02-17T14:28:07.849096+0000","last_unstale":"2024-02-17T14:28:51.766155+0000","last_undegraded":"2024-02-17T14:28:51.766155+0000","last_fullsized":"2024-02-17T14:28:51.766155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877222+0000","last_change":"2024-02-17T14:28:07.849485+0000","last_active":"2024-02-17T14:28:51.877222+0000","last_peered":"2024-02-17T14:28:51.877222+0000","last_clean":"2024-02-17T14:28:51.877222+0000","last_became_active":"2024-02-17T14:28:07.849053+0000","last_became_peered":"2024-02-17T14:28:07.849053+0000","last_unstale":"2024-02-17T14:28:51.877222+0000","last_undegraded":"2024-02-17T14:28:51.877222+0000","last_fullsized":"2024-02-17T14:28:51.877222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764697+0000","last_change":"2024-02-17T14:28:03.632467+0000","last_active":"2024-02-17T14:28:51.764697+0000","last_peered":"2024-02-17T14:28:51.764697+0000","last_clean":"2024-02-17T14:28:51.764697+0000","last_became_active":"2024-02-17T14:28:03.632204+0000","last_became_peered":"2024-02-17T14:28:03.632204+0000","last_unstale":"2024-02-17T14:28:51.764697+0000","last_undegraded":"2024-02-17T14:28:51.764697+0000","last_fullsized":"2024-02-17T14:28:51.764697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768859+0000","last_change":"2024-02-17T14:28:03.062682+0000","last_active":"2024-02-17T14:28:51.768859+0000","last_peered":"2024-02-17T14:28:51.768859+0000","last_clean":"2024-02-17T14:28:51.768859+0000","last_became_active":"2024-02-17T14:28:03.062390+0000","last_became_peered":"2024-02-17T14:28:03.062390+0000","last_unstale":"2024-02-17T14:28:51.768859+0000","last_undegraded":"2024-02-17T14:28:51.768859+0000","last_fullsized":"2024-02-17T14:28:51.768859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765690+0000","last_change":"2024-02-17T14:28:07.651004+0000","last_active":"2024-02-17T14:28:51.765690+0000","last_peered":"2024-02-17T14:28:51.765690+0000","last_clean":"2024-02-17T14:28:51.765690+0000","last_became_active":"2024-02-17T14:28:07.650627+0000","last_became_peered":"2024-02-17T14:28:07.650627+0000","last_unstale":"2024-02-17T14:28:51.765690+0000","last_undegraded":"2024-02-17T14:28:51.765690+0000","last_fullsized":"2024-02-17T14:28:51.765690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766582+0000","last_change":"2024-02-17T14:28:03.627978+0000","last_active":"2024-02-17T14:28:51.766582+0000","last_peered":"2024-02-17T14:28:51.766582+0000","last_clean":"2024-02-17T14:28:51.766582+0000","last_became_active":"2024-02-17T14:28:03.627708+0000","last_became_peered":"2024-02-17T14:28:03.627708+0000","last_unstale":"2024-02-17T14:28:51.766582+0000","last_undegraded":"2024-02-17T14:28:51.766582+0000","last_fullsized":"2024-02-17T14:28:51.766582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766317+0000","last_change":"2024-02-17T14:28:03.071479+0000","last_active":"2024-02-17T14:28:51.766317+0000","last_peered":"2024-02-17T14:28:51.766317+0000","last_clean":"2024-02-17T14:28:51.766317+0000","last_became_active":"2024-02-17T14:28:03.071170+0000","last_became_peered":"2024-02-17T14:28:03.071170+0000","last_unstale":"2024-02-17T14:28:51.766317+0000","last_undegraded":"2024-02-17T14:28:51.766317+0000","last_fullsized":"2024-02-17T14:28:51.766317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:03:44.733125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765220+0000","last_change":"2024-02-17T14:28:03.073225+0000","last_active":"2024-02-17T14:28:51.765220+0000","last_peered":"2024-02-17T14:28:51.765220+0000","last_clean":"2024-02-17T14:28:51.765220+0000","last_became_active":"2024-02-17T14:28:03.072928+0000","last_became_peered":"2024-02-17T14:28:03.072928+0000","last_unstale":"2024-02-17T14:28:51.765220+0000","last_undegraded":"2024-02-17T14:28:51.765220+0000","last_fullsized":"2024-02-17T14:28:51.765220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877057+0000","last_change":"2024-02-17T14:28:03.635534+0000","last_active":"2024-02-17T14:28:51.877057+0000","last_peered":"2024-02-17T14:28:51.877057+0000","last_clean":"2024-02-17T14:28:51.877057+0000","last_became_active":"2024-02-17T14:28:03.635362+0000","last_became_peered":"2024-02-17T14:28:03.635362+0000","last_unstale":"2024-02-17T14:28:51.877057+0000","last_undegraded":"2024-02-17T14:28:51.877057+0000","last_fullsized":"2024-02-17T14:28:51.877057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764331+0000","last_change":"2024-02-17T14:28:07.645087+0000","last_active":"2024-02-17T14:28:51.764331+0000","last_peered":"2024-02-17T14:28:51.764331+0000","last_clean":"2024-02-17T14:28:51.764331+0000","last_became_active":"2024-02-17T14:28:07.644637+0000","last_became_peered":"2024-02-17T14:28:07.644637+0000","last_unstale":"2024-02-17T14:28:51.764331+0000","last_undegraded":"2024-02-17T14:28:51.764331+0000","last_fullsized":"2024-02-17T14:28:51.764331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:39.175950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766840+0000","last_change":"2024-02-17T14:28:03.072162+0000","last_active":"2024-02-17T14:28:51.766840+0000","last_peered":"2024-02-17T14:28:51.766840+0000","last_clean":"2024-02-17T14:28:51.766840+0000","last_became_active":"2024-02-17T14:28:03.071112+0000","last_became_peered":"2024-02-17T14:28:03.071112+0000","last_unstale":"2024-02-17T14:28:51.766840+0000","last_undegraded":"2024-02-17T14:28:51.766840+0000","last_fullsized":"2024-02-17T14:28:51.766840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767346+0000","last_change":"2024-02-17T14:28:03.628403+0000","last_active":"2024-02-17T14:28:51.767346+0000","last_peered":"2024-02-17T14:28:51.767346+0000","last_clean":"2024-02-17T14:28:51.767346+0000","last_became_active":"2024-02-17T14:28:03.628144+0000","last_became_peered":"2024-02-17T14:28:03.628144+0000","last_unstale":"2024-02-17T14:28:51.767346+0000","last_undegraded":"2024-02-17T14:28:51.767346+0000","last_fullsized":"2024-02-17T14:28:51.767346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:01.247136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766781+0000","last_change":"2024-02-17T14:28:07.648376+0000","last_active":"2024-02-17T14:28:51.766781+0000","last_peered":"2024-02-17T14:28:51.766781+0000","last_clean":"2024-02-17T14:28:51.766781+0000","last_became_active":"2024-02-17T14:28:07.647491+0000","last_became_peered":"2024-02-17T14:28:07.647491+0000","last_unstale":"2024-02-17T14:28:51.766781+0000","last_undegraded":"2024-02-17T14:28:51.766781+0000","last_fullsized":"2024-02-17T14:28:51.766781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:12.810441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764660+0000","last_change":"2024-02-17T14:28:03.631191+0000","last_active":"2024-02-17T14:28:51.764660+0000","last_peered":"2024-02-17T14:28:51.764660+0000","last_clean":"2024-02-17T14:28:51.764660+0000","last_became_active":"2024-02-17T14:28:03.630662+0000","last_became_peered":"2024-02-17T14:28:03.630662+0000","last_unstale":"2024-02-17T14:28:51.764660+0000","last_undegraded":"2024-02-17T14:28:51.764660+0000","last_fullsized":"2024-02-17T14:28:51.764660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.763722+0000","last_change":"2024-02-17T14:28:03.629028+0000","last_active":"2024-02-17T14:28:51.763722+0000","last_peered":"2024-02-17T14:28:51.763722+0000","last_clean":"2024-02-17T14:28:51.763722+0000","last_became_active":"2024-02-17T14:28:03.628781+0000","last_became_peered":"2024-02-17T14:28:03.628781+0000","last_unstale":"2024-02-17T14:28:51.763722+0000","last_undegraded":"2024-02-17T14:28:51.763722+0000","last_fullsized":"2024-02-17T14:28:51.763722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.773314+0000","last_change":"2024-02-17T14:28:51.773314+0000","last_active":"2024-02-17T14:28:51.773314+0000","last_peered":"2024-02-17T14:28:51.773314+0000","last_clean":"2024-02-17T14:28:51.773314+0000","last_became_active":"2024-02-17T14:28:51.772895+0000","last_became_peered":"2024-02-17T14:28:51.772895+0000","last_unstale":"2024-02-17T14:28:51.773314+0000","last_undegraded":"2024-02-17T14:28:51.773314+0000","last_fullsized":"2024-02-17T14:28:51.773314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:38:01.087874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877051+0000","last_change":"2024-02-17T14:28:03.627122+0000","last_active":"2024-02-17T14:28:51.877051+0000","last_peered":"2024-02-17T14:28:51.877051+0000","last_clean":"2024-02-17T14:28:51.877051+0000","last_became_active":"2024-02-17T14:28:03.626738+0000","last_became_peered":"2024-02-17T14:28:03.626738+0000","last_unstale":"2024-02-17T14:28:51.877051+0000","last_undegraded":"2024-02-17T14:28:51.877051+0000","last_fullsized":"2024-02-17T14:28:51.877051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767120+0000","last_change":"2024-02-17T14:28:03.631182+0000","last_active":"2024-02-17T14:28:51.767120+0000","last_peered":"2024-02-17T14:28:51.767120+0000","last_clean":"2024-02-17T14:28:51.767120+0000","last_became_active":"2024-02-17T14:28:03.630705+0000","last_became_peered":"2024-02-17T14:28:03.630705+0000","last_unstale":"2024-02-17T14:28:51.767120+0000","last_undegraded":"2024-02-17T14:28:51.767120+0000","last_fullsized":"2024-02-17T14:28:51.767120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764857+0000","last_change":"2024-02-17T14:28:03.631731+0000","last_active":"2024-02-17T14:28:51.764857+0000","last_peered":"2024-02-17T14:28:51.764857+0000","last_clean":"2024-02-17T14:28:51.764857+0000","last_became_active":"2024-02-17T14:28:03.631476+0000","last_became_peered":"2024-02-17T14:28:03.631476+0000","last_unstale":"2024-02-17T14:28:51.764857+0000","last_undegraded":"2024-02-17T14:28:51.764857+0000","last_fullsized":"2024-02-17T14:28:51.764857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765932+0000","last_change":"2024-02-17T14:28:03.638716+0000","last_active":"2024-02-17T14:28:51.765932+0000","last_peered":"2024-02-17T14:28:51.765932+0000","last_clean":"2024-02-17T14:28:51.765932+0000","last_became_active":"2024-02-17T14:28:03.638442+0000","last_became_peered":"2024-02-17T14:28:03.638442+0000","last_unstale":"2024-02-17T14:28:51.765932+0000","last_undegraded":"2024-02-17T14:28:51.765932+0000","last_fullsized":"2024-02-17T14:28:51.765932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767252+0000","last_change":"2024-02-17T14:28:03.630945+0000","last_active":"2024-02-17T14:28:51.767252+0000","last_peered":"2024-02-17T14:28:51.767252+0000","last_clean":"2024-02-17T14:28:51.767252+0000","last_became_active":"2024-02-17T14:28:03.630676+0000","last_became_peered":"2024-02-17T14:28:03.630676+0000","last_unstale":"2024-02-17T14:28:51.767252+0000","last_undegraded":"2024-02-17T14:28:51.767252+0000","last_fullsized":"2024-02-17T14:28:51.767252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768565+0000","last_change":"2024-02-17T14:28:03.627202+0000","last_active":"2024-02-17T14:28:51.768565+0000","last_peered":"2024-02-17T14:28:51.768565+0000","last_clean":"2024-02-17T14:28:51.768565+0000","last_became_active":"2024-02-17T14:28:03.626848+0000","last_became_peered":"2024-02-17T14:28:03.626848+0000","last_unstale":"2024-02-17T14:28:51.768565+0000","last_undegraded":"2024-02-17T14:28:51.768565+0000","last_fullsized":"2024-02-17T14:28:51.768565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766296+0000","last_change":"2024-02-17T14:28:03.627493+0000","last_active":"2024-02-17T14:28:51.766296+0000","last_peered":"2024-02-17T14:28:51.766296+0000","last_clean":"2024-02-17T14:28:51.766296+0000","last_became_active":"2024-02-17T14:28:03.626450+0000","last_became_peered":"2024-02-17T14:28:03.626450+0000","last_unstale":"2024-02-17T14:28:51.766296+0000","last_undegraded":"2024-02-17T14:28:51.766296+0000","last_fullsized":"2024-02-17T14:28:51.766296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768712+0000","last_change":"2024-02-17T14:28:03.639610+0000","last_active":"2024-02-17T14:28:51.768712+0000","last_peered":"2024-02-17T14:28:51.768712+0000","last_clean":"2024-02-17T14:28:51.768712+0000","last_became_active":"2024-02-17T14:28:03.639330+0000","last_became_peered":"2024-02-17T14:28:03.639330+0000","last_unstale":"2024-02-17T14:28:51.768712+0000","last_undegraded":"2024-02-17T14:28:51.768712+0000","last_fullsized":"2024-02-17T14:28:51.768712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876742+0000","last_change":"2024-02-17T14:28:03.641774+0000","last_active":"2024-02-17T14:28:51.876742+0000","last_peered":"2024-02-17T14:28:51.876742+0000","last_clean":"2024-02-17T14:28:51.876742+0000","last_became_active":"2024-02-17T14:28:03.641485+0000","last_became_peered":"2024-02-17T14:28:03.641485+0000","last_unstale":"2024-02-17T14:28:51.876742+0000","last_undegraded":"2024-02-17T14:28:51.876742+0000","last_fullsized":"2024-02-17T14:28:51.876742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765227+0000","last_change":"2024-02-17T14:28:03.630129+0000","last_active":"2024-02-17T14:28:51.765227+0000","last_peered":"2024-02-17T14:28:51.765227+0000","last_clean":"2024-02-17T14:28:51.765227+0000","last_became_active":"2024-02-17T14:28:03.629841+0000","last_became_peered":"2024-02-17T14:28:03.629841+0000","last_unstale":"2024-02-17T14:28:51.765227+0000","last_undegraded":"2024-02-17T14:28:51.765227+0000","last_fullsized":"2024-02-17T14:28:51.765227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061047+0000","last_change":"2024-02-17T14:28:03.642676+0000","last_active":"2024-02-17T14:28:52.061047+0000","last_peered":"2024-02-17T14:28:52.061047+0000","last_clean":"2024-02-17T14:28:52.061047+0000","last_became_active":"2024-02-17T14:28:03.642150+0000","last_became_peered":"2024-02-17T14:28:03.642150+0000","last_unstale":"2024-02-17T14:28:52.061047+0000","last_undegraded":"2024-02-17T14:28:52.061047+0000","last_fullsized":"2024-02-17T14:28:52.061047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764283+0000","last_change":"2024-02-17T14:28:03.632127+0000","last_active":"2024-02-17T14:28:51.764283+0000","last_peered":"2024-02-17T14:28:51.764283+0000","last_clean":"2024-02-17T14:28:51.764283+0000","last_became_active":"2024-02-17T14:28:03.631844+0000","last_became_peered":"2024-02-17T14:28:03.631844+0000","last_unstale":"2024-02-17T14:28:51.764283+0000","last_undegraded":"2024-02-17T14:28:51.764283+0000","last_fullsized":"2024-02-17T14:28:51.764283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:07.756422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.063081+0000","last_change":"2024-02-17T14:28:52.062031+0000","last_active":"2024-02-17T14:28:52.063081+0000","last_peered":"2024-02-17T14:28:52.063081+0000","last_clean":"2024-02-17T14:28:52.063081+0000","last_became_active":"2024-02-17T14:28:52.061682+0000","last_became_peered":"2024-02-17T14:28:52.061682+0000","last_unstale":"2024-02-17T14:28:52.063081+0000","last_undegraded":"2024-02-17T14:28:52.063081+0000","last_fullsized":"2024-02-17T14:28:52.063081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768418+0000","last_change":"2024-02-17T14:28:03.628626+0000","last_active":"2024-02-17T14:28:51.768418+0000","last_peered":"2024-02-17T14:28:51.768418+0000","last_clean":"2024-02-17T14:28:51.768418+0000","last_became_active":"2024-02-17T14:28:03.628343+0000","last_became_peered":"2024-02-17T14:28:03.628343+0000","last_unstale":"2024-02-17T14:28:51.768418+0000","last_undegraded":"2024-02-17T14:28:51.768418+0000","last_fullsized":"2024-02-17T14:28:51.768418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765084+0000","last_change":"2024-02-17T14:28:03.635610+0000","last_active":"2024-02-17T14:28:51.765084+0000","last_peered":"2024-02-17T14:28:51.765084+0000","last_clean":"2024-02-17T14:28:51.765084+0000","last_became_active":"2024-02-17T14:28:03.635340+0000","last_became_peered":"2024-02-17T14:28:03.635340+0000","last_unstale":"2024-02-17T14:28:51.765084+0000","last_undegraded":"2024-02-17T14:28:51.765084+0000","last_fullsized":"2024-02-17T14:28:51.765084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876745+0000","last_change":"2024-02-17T14:28:03.632540+0000","last_active":"2024-02-17T14:28:51.876745+0000","last_peered":"2024-02-17T14:28:51.876745+0000","last_clean":"2024-02-17T14:28:51.876745+0000","last_became_active":"2024-02-17T14:28:03.632273+0000","last_became_peered":"2024-02-17T14:28:03.632273+0000","last_unstale":"2024-02-17T14:28:51.876745+0000","last_undegraded":"2024-02-17T14:28:51.876745+0000","last_fullsized":"2024-02-17T14:28:51.876745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:09:35.598281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766633+0000","last_change":"2024-02-17T14:28:03.631678+0000","last_active":"2024-02-17T14:28:51.766633+0000","last_peered":"2024-02-17T14:28:51.766633+0000","last_clean":"2024-02-17T14:28:51.766633+0000","last_became_active":"2024-02-17T14:28:03.631431+0000","last_became_peered":"2024-02-17T14:28:03.631431+0000","last_unstale":"2024-02-17T14:28:51.766633+0000","last_undegraded":"2024-02-17T14:28:51.766633+0000","last_fullsized":"2024-02-17T14:28:51.766633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768398+0000","last_change":"2024-02-17T14:28:03.631661+0000","last_active":"2024-02-17T14:28:51.768398+0000","last_peered":"2024-02-17T14:28:51.768398+0000","last_clean":"2024-02-17T14:28:51.768398+0000","last_became_active":"2024-02-17T14:28:03.631379+0000","last_became_peered":"2024-02-17T14:28:03.631379+0000","last_unstale":"2024-02-17T14:28:51.768398+0000","last_undegraded":"2024-02-17T14:28:51.768398+0000","last_fullsized":"2024-02-17T14:28:51.768398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:03.242976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764990+0000","last_change":"2024-02-17T14:28:03.635522+0000","last_active":"2024-02-17T14:28:51.764990+0000","last_peered":"2024-02-17T14:28:51.764990+0000","last_clean":"2024-02-17T14:28:51.764990+0000","last_became_active":"2024-02-17T14:28:03.635254+0000","last_became_peered":"2024-02-17T14:28:03.635254+0000","last_unstale":"2024-02-17T14:28:51.764990+0000","last_undegraded":"2024-02-17T14:28:51.764990+0000","last_fullsized":"2024-02-17T14:28:51.764990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765844+0000","last_change":"2024-02-17T14:28:03.635588+0000","last_active":"2024-02-17T14:28:51.765844+0000","last_peered":"2024-02-17T14:28:51.765844+0000","last_clean":"2024-02-17T14:28:51.765844+0000","last_became_active":"2024-02-17T14:28:03.635312+0000","last_became_peered":"2024-02-17T14:28:03.635312+0000","last_unstale":"2024-02-17T14:28:51.765844+0000","last_undegraded":"2024-02-17T14:28:51.765844+0000","last_fullsized":"2024-02-17T14:28:51.765844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061122+0000","last_change":"2024-02-17T14:28:03.646624+0000","last_active":"2024-02-17T14:28:52.061122+0000","last_peered":"2024-02-17T14:28:52.061122+0000","last_clean":"2024-02-17T14:28:52.061122+0000","last_became_active":"2024-02-17T14:28:03.646337+0000","last_became_peered":"2024-02-17T14:28:03.646337+0000","last_unstale":"2024-02-17T14:28:52.061122+0000","last_undegraded":"2024-02-17T14:28:52.061122+0000","last_fullsized":"2024-02-17T14:28:52.061122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:10.836577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766486+0000","last_change":"2024-02-17T14:28:03.635018+0000","last_active":"2024-02-17T14:28:51.766486+0000","last_peered":"2024-02-17T14:28:51.766486+0000","last_clean":"2024-02-17T14:28:51.766486+0000","last_became_active":"2024-02-17T14:28:03.634751+0000","last_became_peered":"2024-02-17T14:28:03.634751+0000","last_unstale":"2024-02-17T14:28:51.766486+0000","last_undegraded":"2024-02-17T14:28:51.766486+0000","last_fullsized":"2024-02-17T14:28:51.766486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060492+0000","last_change":"2024-02-17T14:28:03.641708+0000","last_active":"2024-02-17T14:28:52.060492+0000","last_peered":"2024-02-17T14:28:52.060492+0000","last_clean":"2024-02-17T14:28:52.060492+0000","last_became_active":"2024-02-17T14:28:03.641260+0000","last_became_peered":"2024-02-17T14:28:03.641260+0000","last_unstale":"2024-02-17T14:28:52.060492+0000","last_undegraded":"2024-02-17T14:28:52.060492+0000","last_fullsized":"2024-02-17T14:28:52.060492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768705+0000","last_change":"2024-02-17T14:28:03.628239+0000","last_active":"2024-02-17T14:28:51.768705+0000","last_peered":"2024-02-17T14:28:51.768705+0000","last_clean":"2024-02-17T14:28:51.768705+0000","last_became_active":"2024-02-17T14:28:03.627918+0000","last_became_peered":"2024-02-17T14:28:03.627918+0000","last_unstale":"2024-02-17T14:28:51.768705+0000","last_undegraded":"2024-02-17T14:28:51.768705+0000","last_fullsized":"2024-02-17T14:28:51.768705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060535+0000","last_change":"2024-02-17T14:28:03.641192+0000","last_active":"2024-02-17T14:28:52.060535+0000","last_peered":"2024-02-17T14:28:52.060535+0000","last_clean":"2024-02-17T14:28:52.060535+0000","last_became_active":"2024-02-17T14:28:03.640873+0000","last_became_peered":"2024-02-17T14:28:03.640873+0000","last_unstale":"2024-02-17T14:28:52.060535+0000","last_undegraded":"2024-02-17T14:28:52.060535+0000","last_fullsized":"2024-02-17T14:28:52.060535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.772451+0000","last_change":"2024-02-17T14:28:51.768174+0000","last_active":"2024-02-17T14:28:51.772451+0000","last_peered":"2024-02-17T14:28:51.772451+0000","last_clean":"2024-02-17T14:28:51.772451+0000","last_became_active":"2024-02-17T14:28:51.767928+0000","last_became_peered":"2024-02-17T14:28:51.767928+0000","last_unstale":"2024-02-17T14:28:51.772451+0000","last_undegraded":"2024-02-17T14:28:51.772451+0000","last_fullsized":"2024-02-17T14:28:51.772451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876904+0000","last_change":"2024-02-17T14:28:03.628223+0000","last_active":"2024-02-17T14:28:51.876904+0000","last_peered":"2024-02-17T14:28:51.876904+0000","last_clean":"2024-02-17T14:28:51.876904+0000","last_became_active":"2024-02-17T14:28:03.627978+0000","last_became_peered":"2024-02-17T14:28:03.627978+0000","last_unstale":"2024-02-17T14:28:51.876904+0000","last_undegraded":"2024-02-17T14:28:51.876904+0000","last_fullsized":"2024-02-17T14:28:51.876904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765384+0000","last_change":"2024-02-17T14:28:03.631742+0000","last_active":"2024-02-17T14:28:51.765384+0000","last_peered":"2024-02-17T14:28:51.765384+0000","last_clean":"2024-02-17T14:28:51.765384+0000","last_became_active":"2024-02-17T14:28:03.631493+0000","last_became_peered":"2024-02-17T14:28:03.631493+0000","last_unstale":"2024-02-17T14:28:51.765384+0000","last_undegraded":"2024-02-17T14:28:51.765384+0000","last_fullsized":"2024-02-17T14:28:51.765384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061037+0000","last_change":"2024-02-17T14:28:03.641525+0000","last_active":"2024-02-17T14:28:52.061037+0000","last_peered":"2024-02-17T14:28:52.061037+0000","last_clean":"2024-02-17T14:28:52.061037+0000","last_became_active":"2024-02-17T14:28:03.641154+0000","last_became_peered":"2024-02-17T14:28:03.641154+0000","last_unstale":"2024-02-17T14:28:52.061037+0000","last_undegraded":"2024-02-17T14:28:52.061037+0000","last_fullsized":"2024-02-17T14:28:52.061037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8766,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":17532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":709990,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.55900000000000005}]},{"osd":1,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.501}]},{"osd":2,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.39200000000000002}]},{"osd":3,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57299999999999995}]},{"osd":4,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58899999999999997}]},{"osd":5,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.628}]},{"osd":6,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":127008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.64500000000000002}]},{"osd":1,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58999999999999997}]},{"osd":2,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.53600000000000003}]},{"osd":4,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.62}]},{"osd":5,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.495}]},{"osd":7,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.443},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.60699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.42399999999999999}]},{"osd":1,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.48399999999999999}]},{"osd":3,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.311}]},{"osd":6,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.33400000000000002}]},{"osd":7,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.45700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":119166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.52400000000000002}]},{"osd":2,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41499999999999998}]},{"osd":5,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.34499999999999997}]},{"osd":6,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.37},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.47599999999999998}]},{"osd":7,"last update":"Sat Feb 17 14:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.44700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":127008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.27700000000000002}]},{"osd":1,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.37},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.438},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.39200000000000002}]},{"osd":6,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.496}]},{"osd":7,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":119040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40699999999999997}]},{"osd":3,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32000000000000001}]},{"osd":4,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.61099999999999999}]},{"osd":6,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.629},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.57199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":119200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.375},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.316}]},{"osd":2,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.624},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54700000000000004}]},{"osd":7,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":710046,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.254}]},{"osd":2,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.28899999999999998}]},{"osd":3,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.52700000000000002}]},{"osd":6,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60599999999999998}]},{"osd":7,"last update":"Sat Feb 17 14:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":7968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":7968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T14:29:59.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:30:00.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.045+0000 7f7e13377640 1 Processor -- start 2024-02-17T14:30:00.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.045+0000 7f7e13377640 1 -- start start 2024-02-17T14:30:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.046+0000 7f7e13377640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e0c072810 0x7f7e0c0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.046+0000 7f7e13377640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7e0c148100 0x7f7e0c13e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.046+0000 7f7e13377640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c0b1ad0 con 0x7f7e0c0b0750 2024-02-17T14:30:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.046+0000 7f7e13377640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0c13f200 con 0x7f7e0c148100 2024-02-17T14:30:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.046+0000 7f7e13377640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0c0b1860 con 0x7f7e0c072810 2024-02-17T14:30:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.046+0000 7f7e10912640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7e0c148100 0x7f7e0c13e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:00.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.046+0000 7f7e10912640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7e0c148100 0x7f7e0c13e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42912/0 (socket says 172.21.15.134:42912) 2024-02-17T14:30:00.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.046+0000 7f7e10912640 1 -- 172.21.15.134:0/2687406366 learned_addr learned my addr 172.21.15.134:0/2687406366 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:00.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.046+0000 7f7e11113640 1 --2- 172.21.15.134:0/2687406366 >> v2:172.21.15.142:3300/0 conn(0x7f7e0c072810 0x7f7e0c0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:00.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.047+0000 7f7e10912640 1 -- 172.21.15.134:0/2687406366 >> v2:172.21.15.142:3300/0 conn(0x7f7e0c072810 msgr2=0x7f7e0c0b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:00.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.047+0000 7f7e10912640 1 --2- 172.21.15.134:0/2687406366 >> v2:172.21.15.142:3300/0 conn(0x7f7e0c072810 0x7f7e0c0b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:00.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.047+0000 7f7e10912640 1 -- 172.21.15.134:0/2687406366 >> v1:172.21.15.142:6789/0 conn(0x7f7e0c0b0750 legacy=0x7f7e0c13eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:00.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.047+0000 7f7e10912640 1 -- 172.21.15.134:0/2687406366 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c0b1f60 con 0x7f7e0c148100 2024-02-17T14:30:00.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.047+0000 7f7e10912640 1 --2- 172.21.15.134:0/2687406366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e0c148100 0x7f7e0c13e5b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0b6e70 tx=0x7f7dfc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db72172ad0e98e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:00.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.047+0000 7f7e03fff640 1 -- 172.21.15.134:0/2687406366 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc031870 con 0x7f7e0c148100 2024-02-17T14:30:00.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.047+0000 7f7e03fff640 1 -- 172.21.15.134:0/2687406366 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc0319d0 con 0x7f7e0c148100 2024-02-17T14:30:00.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.047+0000 7f7e03fff640 1 -- 172.21.15.134:0/2687406366 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc031d60 con 0x7f7e0c148100 2024-02-17T14:30:00.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.048+0000 7f7e13377640 1 -- 172.21.15.134:0/2687406366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e0c148100 msgr2=0x7f7e0c13e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:00.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.048+0000 7f7e13377640 1 --2- 172.21.15.134:0/2687406366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e0c148100 0x7f7e0c13e5b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0b6e70 tx=0x7f7dfc02b910 comp rx=0 tx=0).stop 2024-02-17T14:30:00.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.048+0000 7f7e13377640 1 -- 172.21.15.134:0/2687406366 shutdown_connections 2024-02-17T14:30:00.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.048+0000 7f7e13377640 1 --2- 172.21.15.134:0/2687406366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e0c148100 0x7f7e0c13e5b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:00.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.048+0000 7f7e13377640 1 --2- 172.21.15.134:0/2687406366 >> v2:172.21.15.142:3300/0 conn(0x7f7e0c072810 0x7f7e0c0b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:00.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.048+0000 7f7e13377640 1 -- 172.21.15.134:0/2687406366 >> 172.21.15.134:0/2687406366 conn(0x7f7e0c0b9350 msgr2=0x7f7e0c0b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:00.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.048+0000 7f7e13377640 1 -- 172.21.15.134:0/2687406366 shutdown_connections 2024-02-17T14:30:00.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.048+0000 7f7e13377640 1 -- 172.21.15.134:0/2687406366 wait complete. 2024-02-17T14:30:00.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.049+0000 7f7e13377640 1 Processor -- start 2024-02-17T14:30:00.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.049+0000 7f7e13377640 1 -- start start 2024-02-17T14:30:00.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e13377640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e0c072810 0x7f7e0c13a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:00.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e13377640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e0c0b0750 0x7f7e0c1ddff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:00.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e13377640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e0c148100 0x7f7e0c13c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:00.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e13377640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c142430 con 0x7f7e0c148100 2024-02-17T14:30:00.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e13377640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c13b9a0 con 0x7f7e0c0b0750 2024-02-17T14:30:00.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e13377640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c1dd5a0 con 0x7f7e0c072810 2024-02-17T14:30:00.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e11914640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e0c148100 0x7f7e0c13c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:00.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e11914640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e0c148100 0x7f7e0c13c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42928/0 (socket says 172.21.15.134:42928) 2024-02-17T14:30:00.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e11914640 1 -- 172.21.15.134:0/1634613308 learned_addr learned my addr 172.21.15.134:0/1634613308 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:00.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e10912640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e0c0b0750 0x7f7e0c1ddff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:00.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e11113640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e0c072810 0x7f7e0c13a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:00.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e11914640 1 -- 172.21.15.134:0/1634613308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e0c072810 msgr2=0x7f7e0c13a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:00.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e11914640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e0c072810 0x7f7e0c13a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:00.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e11914640 1 -- 172.21.15.134:0/1634613308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e0c0b0750 msgr2=0x7f7e0c1ddff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:00.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e11914640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e0c0b0750 0x7f7e0c1ddff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:00.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e11914640 1 -- 172.21.15.134:0/1634613308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc0094d0 con 0x7f7e0c148100 2024-02-17T14:30:00.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e11914640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e0c148100 0x7f7e0c13c7d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c3c0 tx=0x7f7e0400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:00.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e01ffb640 1 -- 172.21.15.134:0/1634613308 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e040052d0 con 0x7f7e0c148100 2024-02-17T14:30:00.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e01ffb640 1 -- 172.21.15.134:0/1634613308 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04005430 con 0x7f7e0c148100 2024-02-17T14:30:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e01ffb640 1 -- 172.21.15.134:0/1634613308 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04003830 con 0x7f7e0c148100 2024-02-17T14:30:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.050+0000 7f7e13377640 1 -- 172.21.15.134:0/1634613308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c13cd10 con 0x7f7e0c148100 2024-02-17T14:30:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.051+0000 7f7e13377640 1 -- 172.21.15.134:0/1634613308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0c1ddad0 con 0x7f7e0c148100 2024-02-17T14:30:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.051+0000 7f7e13377640 1 -- 172.21.15.134:0/1634613308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0c1ddcc0 con 0x7f7e0c148100 2024-02-17T14:30:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.052+0000 7f7e01ffb640 1 -- 172.21.15.134:0/1634613308 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f7e04003990 con 0x7f7e0c148100 2024-02-17T14:30:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.052+0000 7f7e01ffb640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7df006b810 0x7f7df006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:00.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.052+0000 7f7e01ffb640 1 -- 172.21.15.134:0/1634613308 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7e040898e0 con 0x7f7e0c148100 2024-02-17T14:30:00.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.052+0000 7f7e11113640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7df006b810 0x7f7df006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:00.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.053+0000 7f7e11113640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7df006b810 0x7f7df006dcd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7e080113e0 tx=0x7f7e0800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:00.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.056+0000 7f7e01ffb640 1 -- 172.21.15.134:0/1634613308 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7e04054040 con 0x7f7e0c148100 2024-02-17T14:30:00.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.227+0000 7f7e13377640 1 -- 172.21.15.134:0/1634613308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e0c068280 con 0x7f7e0c148100 2024-02-17T14:30:00.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.228+0000 7f7e01ffb640 1 -- 172.21.15.134:0/1634613308 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f7e04057700 con 0x7f7e0c148100 2024-02-17T14:30:00.229 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:30:00.229 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":27,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:51.760520+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:30:00.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.230+0000 7f7e13377640 1 -- 172.21.15.134:0/1634613308 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7df006b810 msgr2=0x7f7df006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:00.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.230+0000 7f7e13377640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7df006b810 0x7f7df006dcd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7e080113e0 tx=0x7f7e0800b040 comp rx=0 tx=0).stop 2024-02-17T14:30:00.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.230+0000 7f7e13377640 1 -- 172.21.15.134:0/1634613308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e0c148100 msgr2=0x7f7e0c13c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:00.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.230+0000 7f7e13377640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e0c148100 0x7f7e0c13c7d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c3c0 tx=0x7f7e0400c880 comp rx=0 tx=0).stop 2024-02-17T14:30:00.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.230+0000 7f7e13377640 1 -- 172.21.15.134:0/1634613308 shutdown_connections 2024-02-17T14:30:00.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.230+0000 7f7e13377640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f7df006b810 0x7f7df006dcd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:00.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.230+0000 7f7e13377640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e0c148100 0x7f7e0c13c7d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:00.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.230+0000 7f7e13377640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e0c0b0750 0x7f7e0c1ddff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:00.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.230+0000 7f7e13377640 1 --2- 172.21.15.134:0/1634613308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e0c072810 0x7f7e0c13a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:00.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.230+0000 7f7e13377640 1 -- 172.21.15.134:0/1634613308 >> 172.21.15.134:0/1634613308 conn(0x7f7e0c0b9350 msgr2=0x7f7e0c0b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:00.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.231+0000 7f7e13377640 1 -- 172.21.15.134:0/1634613308 shutdown_connections 2024-02-17T14:30:00.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:00.231+0000 7f7e13377640 1 -- 172.21.15.134:0/1634613308 wait complete. 2024-02-17T14:30:01.242 INFO:tasks.ceph:Scrubbing osd.0 2024-02-17T14:30:01.243 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-17T14:30:01.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.358+0000 7f96efaae640 1 Processor -- start 2024-02-17T14:30:01.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.358+0000 7f96efaae640 1 -- start start 2024-02-17T14:30:01.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.359+0000 7f96efaae640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96e80b3d40 0x7f96e80b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.359+0000 7f96efaae640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96e8147960 0x7f96e8141110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.359+0000 7f96efaae640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e80b59b0 con 0x7f96e8147540 2024-02-17T14:30:01.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.359+0000 7f96efaae640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e80b7050 con 0x7f96e8147960 2024-02-17T14:30:01.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.359+0000 7f96efaae640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8146d80 con 0x7f96e80b3d40 2024-02-17T14:30:01.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.359+0000 7f96ee04b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96e8147960 0x7f96e8141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.359+0000 7f96ed049640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f96e8147540 0x7f96e8140a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52930/0 (socket says 172.21.15.134:52930) 2024-02-17T14:30:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.359+0000 7f96ed049640 1 -- 172.21.15.134:0/3381594041 learned_addr learned my addr 172.21.15.134:0/3381594041 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.359+0000 7f96ed84a640 1 --2- 172.21.15.134:0/3381594041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96e80b3d40 0x7f96e80b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.359+0000 7f96ec848640 1 -- 172.21.15.134:0/3381594041 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022876362 0 0) 0x7f96e80b59b0 con 0x7f96e8147540 2024-02-17T14:30:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.360+0000 7f96ec848640 1 -- 172.21.15.134:0/3381594041 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d4003520 con 0x7f96e8147540 2024-02-17T14:30:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.360+0000 7f96ee04b640 1 -- 172.21.15.134:0/3381594041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96e80b3d40 msgr2=0x7f96e80b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.360+0000 7f96ee04b640 1 --2- 172.21.15.134:0/3381594041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96e80b3d40 0x7f96e80b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.360+0000 7f96ee04b640 1 -- 172.21.15.134:0/3381594041 >> v1:172.21.15.134:6789/0 conn(0x7f96e8147540 legacy=0x7f96e8140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.360+0000 7f96ee04b640 1 -- 172.21.15.134:0/3381594041 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80b4120 con 0x7f96e8147960 2024-02-17T14:30:01.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.360+0000 7f96ee04b640 1 --2- 172.21.15.134:0/3381594041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e8147960 0x7f96e8141110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009d90 tx=0x7f96e002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440b9cb61c8dbb01 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.360+0000 7f96ec848640 1 -- 172.21.15.134:0/3381594041 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e002cc50 con 0x7f96e8147960 2024-02-17T14:30:01.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.361+0000 7f96ec848640 1 -- 172.21.15.134:0/3381594041 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e002cdb0 con 0x7f96e8147960 2024-02-17T14:30:01.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.361+0000 7f96ec848640 1 -- 172.21.15.134:0/3381594041 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0034660 con 0x7f96e8147960 2024-02-17T14:30:01.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.361+0000 7f96efaae640 1 -- 172.21.15.134:0/3381594041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e8147960 msgr2=0x7f96e8141110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.361+0000 7f96efaae640 1 --2- 172.21.15.134:0/3381594041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e8147960 0x7f96e8141110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009d90 tx=0x7f96e002bea0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.361+0000 7f96efaae640 1 -- 172.21.15.134:0/3381594041 shutdown_connections 2024-02-17T14:30:01.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.361+0000 7f96efaae640 1 --2- 172.21.15.134:0/3381594041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e8147960 0x7f96e8141110 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.361+0000 7f96efaae640 1 --2- 172.21.15.134:0/3381594041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96e80b3d40 0x7f96e80b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.361+0000 7f96efaae640 1 -- 172.21.15.134:0/3381594041 >> 172.21.15.134:0/3381594041 conn(0x7f96e80bc6d0 msgr2=0x7f96e80bcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:01.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.361+0000 7f96efaae640 1 -- 172.21.15.134:0/3381594041 shutdown_connections 2024-02-17T14:30:01.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.361+0000 7f96efaae640 1 -- 172.21.15.134:0/3381594041 wait complete. 2024-02-17T14:30:01.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96efaae640 1 Processor -- start 2024-02-17T14:30:01.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96efaae640 1 -- start start 2024-02-17T14:30:01.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96efaae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e80b3d40 0x7f96e81443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96efaae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96e8147540 0x7f96e80b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96efaae640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96e8147960 0x7f96e81df5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96efaae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81422b0 con 0x7f96e80b3d40 2024-02-17T14:30:01.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96efaae640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8143f50 con 0x7f96e8147540 2024-02-17T14:30:01.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96efaae640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8144920 con 0x7f96e8147960 2024-02-17T14:30:01.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96ed84a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e80b3d40 0x7f96e81443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96ed84a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e80b3d40 0x7f96e81443e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42942/0 (socket says 172.21.15.134:42942) 2024-02-17T14:30:01.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96ed84a640 1 -- 172.21.15.134:0/1226107639 learned_addr learned my addr 172.21.15.134:0/1226107639 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:01.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96ee04b640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96e8147960 0x7f96e81df5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96ed049640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96e8147540 0x7f96e80b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.363+0000 7f96ed84a640 1 -- 172.21.15.134:0/1226107639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96e8147960 msgr2=0x7f96e81df5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.364+0000 7f96ed84a640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96e8147960 0x7f96e81df5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.364+0000 7f96ed84a640 1 -- 172.21.15.134:0/1226107639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96e8147540 msgr2=0x7f96e80b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.364+0000 7f96ed84a640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96e8147540 0x7f96e80b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.364+0000 7f96ed84a640 1 -- 172.21.15.134:0/1226107639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e0009a70 con 0x7f96e80b3d40 2024-02-17T14:30:01.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.364+0000 7f96ee04b640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96e8147960 0x7f96e81df5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:30:01.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.364+0000 7f96ed049640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96e8147540 0x7f96e80b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:30:01.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.364+0000 7f96ed84a640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e80b3d40 0x7f96e81443e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f96e400d800 tx=0x7f96e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.364+0000 7f96de7fc640 1 -- 172.21.15.134:0/1226107639 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400b6c0 con 0x7f96e80b3d40 2024-02-17T14:30:01.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.364+0000 7f96de7fc640 1 -- 172.21.15.134:0/1226107639 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e400b820 con 0x7f96e80b3d40 2024-02-17T14:30:01.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.364+0000 7f96efaae640 1 -- 172.21.15.134:0/1226107639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e8143690 con 0x7f96e80b3d40 2024-02-17T14:30:01.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.364+0000 7f96de7fc640 1 -- 172.21.15.134:0/1226107639 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400bbb0 con 0x7f96e80b3d40 2024-02-17T14:30:01.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.364+0000 7f96efaae640 1 -- 172.21.15.134:0/1226107639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e8142790 con 0x7f96e80b3d40 2024-02-17T14:30:01.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.365+0000 7f96efaae640 1 -- 172.21.15.134:0/1226107639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96e8147020 con 0x7f96e80b3d40 2024-02-17T14:30:01.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.365+0000 7f96de7fc640 1 -- 172.21.15.134:0/1226107639 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f96e400bd10 con 0x7f96e80b3d40 2024-02-17T14:30:01.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.366+0000 7f96de7fc640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f96cc06b840 0x7f96cc06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.366+0000 7f96de7fc640 1 -- 172.21.15.134:0/1226107639 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f96e408b500 con 0x7f96e80b3d40 2024-02-17T14:30:01.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.366+0000 7f96ed049640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f96cc06b840 0x7f96cc06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.366+0000 7f96de7fc640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] conn(0x7f96cc075260 0x7f96cc077700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.366+0000 7f96de7fc640 1 -- 172.21.15.134:0/1226107639 --> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96cc077dd0 con 0x7f96cc075260 2024-02-17T14:30:01.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.366+0000 7f96de7fc640 1 -- 172.21.15.134:0/1226107639 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96e408b950 con 0x7f96e80b3d40 2024-02-17T14:30:01.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.366+0000 7f96ee04b640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] conn(0x7f96cc075260 0x7f96cc077700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.366+0000 7f96ed049640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f96cc06b840 0x7f96cc06dd00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f96e813ffd0 tx=0x7f96d8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.366+0000 7f96ee04b640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] conn(0x7f96cc075260 0x7f96cc077700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.367+0000 7f96de7fc640 1 -- 172.21.15.134:0/1226107639 <== osd.0 v2:172.21.15.134:6809/3803014718 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f96cc077dd0 con 0x7f96cc075260 2024-02-17T14:30:01.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.380+0000 7f96efaae640 1 -- 172.21.15.134:0/1226107639 --> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f96e80b56d0 con 0x7f96cc075260 2024-02-17T14:30:01.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.380+0000 7f96de7fc640 1 -- 172.21.15.134:0/1226107639 <== osd.0 v2:172.21.15.134:6809/3803014718 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f96e002cb70 con 0x7f96cc075260 2024-02-17T14:30:01.381 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-17T14:30:01.381 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T14:30:01.381 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-17T14:30:01.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.381+0000 7f96efaae640 1 -- 172.21.15.134:0/1226107639 >> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] conn(0x7f96cc075260 msgr2=0x7f96cc077700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.381+0000 7f96efaae640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.134:6809/3803014718,v1:172.21.15.134:6811/3803014718] conn(0x7f96cc075260 0x7f96cc077700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.381+0000 7f96efaae640 1 -- 172.21.15.134:0/1226107639 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f96cc06b840 msgr2=0x7f96cc06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.381+0000 7f96efaae640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f96cc06b840 0x7f96cc06dd00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f96e813ffd0 tx=0x7f96d8009040 comp rx=0 tx=0).stop 2024-02-17T14:30:01.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.381+0000 7f96efaae640 1 -- 172.21.15.134:0/1226107639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e80b3d40 msgr2=0x7f96e81443e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.381+0000 7f96efaae640 1 --2- 172.21.15.134:0/1226107639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e80b3d40 0x7f96e81443e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f96e400d800 tx=0x7f96e400dcc0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.381+0000 7f96ee04b640 1 -- 172.21.15.134:0/1226107639 reap_dead start 2024-02-17T14:30:01.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.381+0000 7f96efaae640 1 -- 172.21.15.134:0/1226107639 shutdown_connections 2024-02-17T14:30:01.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.381+0000 7f96efaae640 1 -- 172.21.15.134:0/1226107639 >> 172.21.15.134:0/1226107639 conn(0x7f96e80bc6d0 msgr2=0x7f96e8073a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:01.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.381+0000 7f96efaae640 1 -- 172.21.15.134:0/1226107639 shutdown_connections 2024-02-17T14:30:01.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.381+0000 7f96efaae640 1 -- 172.21.15.134:0/1226107639 wait complete. 2024-02-17T14:30:01.392 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-17T14:30:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.493+0000 7f89864df640 1 Processor -- start 2024-02-17T14:30:01.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.493+0000 7f89864df640 1 -- start start 2024-02-17T14:30:01.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.493+0000 7f89864df640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f898013d790 0x7f89801432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.493+0000 7f89864df640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89800b0e10 con 0x7f8980143800 2024-02-17T14:30:01.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.493+0000 7f89864df640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89800b1c70 con 0x7f89800b36f0 2024-02-17T14:30:01.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.493+0000 7f89864df640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898006f830 con 0x7f898013d790 2024-02-17T14:30:01.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f8984a7c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8980143800 0x7f898014dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52932/0 (socket says 172.21.15.134:52932) 2024-02-17T14:30:01.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f8984a7c640 1 -- 172.21.15.134:0/311757448 learned_addr learned my addr 172.21.15.134:0/311757448 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:01.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897f7fe640 1 --2- 172.21.15.134:0/311757448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f898013d790 0x7f89801432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697752468 0 0) 0x7f89800b0e10 con 0x7f8980143800 2024-02-17T14:30:01.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8968003520 con 0x7f8980143800 2024-02-17T14:30:01.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2934684351 0 0) 0x7f8968003520 con 0x7f8980143800 2024-02-17T14:30:01.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f898013d790 msgr2=0x7f89801432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:01.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 --2- 172.21.15.134:0/311757448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f898013d790 0x7f89801432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 >> v1:172.21.15.142:6789/0 conn(0x7f89800b36f0 legacy=0x7f898013d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800b3ad0 con 0x7f8980143800 2024-02-17T14:30:01.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f89780019f0 con 0x7f8980143800 2024-02-17T14:30:01.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 >> v1:172.21.15.134:6789/0 conn(0x7f8980143800 legacy=0x7f898014dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 --2- 172.21.15.134:0/311757448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89680039a0 0x7f8968003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 --2- 172.21.15.134:0/311757448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f898013d790 0x7f89680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 --2- 172.21.15.134:0/311757448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8968004d00 0x7f8968005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898006f830 con 0x7f8968004d00 2024-02-17T14:30:01.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896800bb40 con 0x7f89680039a0 2024-02-17T14:30:01.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896800bd00 con 0x7f898013d790 2024-02-17T14:30:01.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f8984a7c640 1 --2- 172.21.15.134:0/311757448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8968004d00 0x7f8968005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897ffff640 1 --2- 172.21.15.134:0/311757448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89680039a0 0x7f8968003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f897f7fe640 1 --2- 172.21.15.134:0/311757448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f898013d790 0x7f89680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f8984a7c640 1 -- 172.21.15.134:0/311757448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f898013d790 msgr2=0x7f89680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:01.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f8984a7c640 1 --2- 172.21.15.134:0/311757448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f898013d790 0x7f89680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f8984a7c640 1 -- 172.21.15.134:0/311757448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89680039a0 msgr2=0x7f8968003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:01.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.494+0000 7f8984a7c640 1 --2- 172.21.15.134:0/311757448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89680039a0 0x7f8968003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.495+0000 7f8984a7c640 1 -- 172.21.15.134:0/311757448 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8968003520 con 0x7f8968004d00 2024-02-17T14:30:01.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.495+0000 7f8984a7c640 1 --2- 172.21.15.134:0/311757448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8968004d00 0x7f8968005180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f897800a820 tx=0x7f89680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a614444661f9cc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.495+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780072d0 con 0x7f8968004d00 2024-02-17T14:30:01.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.495+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897802f070 con 0x7f8968004d00 2024-02-17T14:30:01.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.495+0000 7f897effd640 1 -- 172.21.15.134:0/311757448 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780076b0 con 0x7f8968004d00 2024-02-17T14:30:01.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.496+0000 7f89864df640 1 -- 172.21.15.134:0/311757448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8968004d00 msgr2=0x7f8968005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.496+0000 7f89864df640 1 --2- 172.21.15.134:0/311757448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8968004d00 0x7f8968005180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f897800a820 tx=0x7f89680057f0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.496+0000 7f8984a7c640 1 -- 172.21.15.134:0/311757448 reap_dead start 2024-02-17T14:30:01.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.496+0000 7f89864df640 1 -- 172.21.15.134:0/311757448 shutdown_connections 2024-02-17T14:30:01.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.496+0000 7f89864df640 1 -- 172.21.15.134:0/311757448 >> 172.21.15.134:0/311757448 conn(0x7f89800b8270 msgr2=0x7f89800b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:01.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.496+0000 7f89864df640 1 -- 172.21.15.134:0/311757448 shutdown_connections 2024-02-17T14:30:01.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.496+0000 7f89864df640 1 -- 172.21.15.134:0/311757448 wait complete. 2024-02-17T14:30:01.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.497+0000 7f89864df640 1 Processor -- start 2024-02-17T14:30:01.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.497+0000 7f89864df640 1 -- start start 2024-02-17T14:30:01.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f89864df640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8968004d00 0x7f8980131e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f89864df640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f898013d340 0x7f898013c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f89864df640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f898013c970 0x7f898012bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f89864df640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8980142230 con 0x7f898013d340 2024-02-17T14:30:01.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f89864df640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8980142740 con 0x7f8968004d00 2024-02-17T14:30:01.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f89864df640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8980141c20 con 0x7f898013c970 2024-02-17T14:30:01.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f898013d340 0x7f898013c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f898013d340 0x7f898013c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42954/0 (socket says 172.21.15.134:42954) 2024-02-17T14:30:01.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897f7fe640 1 -- 172.21.15.134:0/782257020 learned_addr learned my addr 172.21.15.134:0/782257020 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:01.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897ffff640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8968004d00 0x7f8980131e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f8984a7c640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f898013c970 0x7f898012bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897f7fe640 1 -- 172.21.15.134:0/782257020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f898013c970 msgr2=0x7f898012bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897f7fe640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f898013c970 0x7f898012bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897f7fe640 1 -- 172.21.15.134:0/782257020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8968004d00 msgr2=0x7f8980131e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897f7fe640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8968004d00 0x7f8980131e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897f7fe640 1 -- 172.21.15.134:0/782257020 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898013ce20 con 0x7f898013d340 2024-02-17T14:30:01.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897ffff640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8968004d00 0x7f8980131e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:30:01.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897f7fe640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f898013d340 0x7f898013c430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89740119a0 tx=0x7f8974011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897cff9640 1 -- 172.21.15.134:0/782257020 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897400faf0 con 0x7f898013d340 2024-02-17T14:30:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897cff9640 1 -- 172.21.15.134:0/782257020 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897400fc50 con 0x7f898013d340 2024-02-17T14:30:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f89864df640 1 -- 172.21.15.134:0/782257020 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8980142c20 con 0x7f898013d340 2024-02-17T14:30:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f897cff9640 1 -- 172.21.15.134:0/782257020 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974014440 con 0x7f898013d340 2024-02-17T14:30:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.498+0000 7f89864df640 1 -- 172.21.15.134:0/782257020 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8980141940 con 0x7f898013d340 2024-02-17T14:30:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.499+0000 7f89864df640 1 -- 172.21.15.134:0/782257020 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898013c070 con 0x7f898013d340 2024-02-17T14:30:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.500+0000 7f897cff9640 1 -- 172.21.15.134:0/782257020 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f897401d400 con 0x7f898013d340 2024-02-17T14:30:01.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.500+0000 7f897cff9640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f896c06b810 0x7f896c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.500+0000 7f897cff9640 1 -- 172.21.15.134:0/782257020 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f897408ae50 con 0x7f898013d340 2024-02-17T14:30:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.500+0000 7f897ffff640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f896c06b810 0x7f896c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.501+0000 7f897ffff640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f896c06b810 0x7f896c06dcd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89800b4530 tx=0x7f8970009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.505+0000 7f897cff9640 1 -- 172.21.15.134:0/782257020 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8974055500 con 0x7f898013d340 2024-02-17T14:30:01.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.676+0000 7f89864df640 1 -- 172.21.15.134:0/782257020 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f89800b1900 con 0x7f896c06b810 2024-02-17T14:30:01.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.677+0000 7f897cff9640 1 -- 172.21.15.134:0/782257020 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8970001510 con 0x7f896c06b810 2024-02-17T14:30:01.677 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 0 to deep-scrub 2024-02-17T14:30:01.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.679+0000 7f89864df640 1 -- 172.21.15.134:0/782257020 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f896c06b810 msgr2=0x7f896c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.679+0000 7f89864df640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f896c06b810 0x7f896c06dcd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89800b4530 tx=0x7f8970009040 comp rx=0 tx=0).stop 2024-02-17T14:30:01.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.679+0000 7f89864df640 1 -- 172.21.15.134:0/782257020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f898013d340 msgr2=0x7f898013c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.679+0000 7f89864df640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f898013d340 0x7f898013c430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89740119a0 tx=0x7f8974011e60 comp rx=0 tx=0).stop 2024-02-17T14:30:01.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.679+0000 7f89864df640 1 -- 172.21.15.134:0/782257020 shutdown_connections 2024-02-17T14:30:01.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.679+0000 7f89864df640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f898013c970 0x7f898012bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.679+0000 7f89864df640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f896c06b810 0x7f896c06dcd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.679+0000 7f89864df640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f898013d340 0x7f898013c430 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.679+0000 7f89864df640 1 --2- 172.21.15.134:0/782257020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8968004d00 0x7f8980131e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.679+0000 7f89864df640 1 -- 172.21.15.134:0/782257020 >> 172.21.15.134:0/782257020 conn(0x7f89800b8270 msgr2=0x7f8980135f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:01.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.679+0000 7f89864df640 1 -- 172.21.15.134:0/782257020 shutdown_connections 2024-02-17T14:30:01.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.679+0000 7f89864df640 1 -- 172.21.15.134:0/782257020 wait complete. 2024-02-17T14:30:01.690 INFO:tasks.ceph:Scrubbing osd.1 2024-02-17T14:30:01.690 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-17T14:30:01.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.795+0000 7f0855593640 1 Processor -- start 2024-02-17T14:30:01.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.795+0000 7f0855593640 1 -- start start 2024-02-17T14:30:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f0855593640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08500b3d40 0x7f08500b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f0855593640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0850147540 0x7f0850147960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f0855593640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08500b59b0 con 0x7f0850140a00 2024-02-17T14:30:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f0855593640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0850141580 con 0x7f0850147540 2024-02-17T14:30:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f0855593640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08500b7050 con 0x7f08500b3d40 2024-02-17T14:30:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084f7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0850140a00 0x7f0850140e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52948/0 (socket says 172.21.15.134:52948) 2024-02-17T14:30:01.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084f7fe640 1 -- 172.21.15.134:0/1076449396 learned_addr learned my addr 172.21.15.134:0/1076449396 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:01.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084effd640 1 --2- 172.21.15.134:0/1076449396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08500b3d40 0x7f08500b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997017032 0 0) 0x7f08500b59b0 con 0x7f0850140a00 2024-02-17T14:30:01.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0838003520 con 0x7f0850140a00 2024-02-17T14:30:01.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084e7fc640 1 --2- 172.21.15.134:0/1076449396 >> v2:172.21.15.142:3300/0 conn(0x7f0850147540 0x7f0850147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1520082960 0 0) 0x7f0838003520 con 0x7f0850140a00 2024-02-17T14:30:01.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08500b3d40 msgr2=0x7f08500b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:01.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 --2- 172.21.15.134:0/1076449396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08500b3d40 0x7f08500b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 >> v2:172.21.15.142:3300/0 conn(0x7f0850147540 msgr2=0x7f0850147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 --2- 172.21.15.134:0/1076449396 >> v2:172.21.15.142:3300/0 conn(0x7f0850147540 0x7f0850147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0850146d80 con 0x7f0850140a00 2024-02-17T14:30:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f08480019f0 con 0x7f0850140a00 2024-02-17T14:30:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 >> v1:172.21.15.134:6789/0 conn(0x7f0850140a00 legacy=0x7f0850140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 --2- 172.21.15.134:0/1076449396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0838003970 0x7f0838003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 --2- 172.21.15.134:0/1076449396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08380047c0 0x7f0838004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 --2- 172.21.15.134:0/1076449396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08500b3d40 0x7f0838005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0850141580 con 0x7f08380047c0 2024-02-17T14:30:01.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08500b7050 con 0x7f0838003970 2024-02-17T14:30:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.796+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083800b980 con 0x7f08500b3d40 2024-02-17T14:30:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.797+0000 7f084e7fc640 1 --2- 172.21.15.134:0/1076449396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08380047c0 0x7f0838004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.797+0000 7f084effd640 1 --2- 172.21.15.134:0/1076449396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0838003970 0x7f0838003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.797+0000 7f084f7fe640 1 --2- 172.21.15.134:0/1076449396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08500b3d40 0x7f0838005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.797+0000 7f084e7fc640 1 -- 172.21.15.134:0/1076449396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08500b3d40 msgr2=0x7f0838005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.797+0000 7f084e7fc640 1 --2- 172.21.15.134:0/1076449396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08500b3d40 0x7f0838005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.797+0000 7f084e7fc640 1 -- 172.21.15.134:0/1076449396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0838003970 msgr2=0x7f0838003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:01.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.797+0000 7f084e7fc640 1 --2- 172.21.15.134:0/1076449396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0838003970 0x7f0838003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.797+0000 7f084e7fc640 1 -- 172.21.15.134:0/1076449396 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0838003520 con 0x7f08380047c0 2024-02-17T14:30:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.798+0000 7f084e7fc640 1 --2- 172.21.15.134:0/1076449396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08380047c0 0x7f0838004c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0844009ac0 tx=0x7f08380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84739fc3746c94c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.798+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084402c6d0 con 0x7f08380047c0 2024-02-17T14:30:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.798+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084402c830 con 0x7f08380047c0 2024-02-17T14:30:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.798+0000 7f084dffb640 1 -- 172.21.15.134:0/1076449396 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084402cbc0 con 0x7f08380047c0 2024-02-17T14:30:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.798+0000 7f0855593640 1 -- 172.21.15.134:0/1076449396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08380047c0 msgr2=0x7f0838004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.798+0000 7f0855593640 1 --2- 172.21.15.134:0/1076449396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08380047c0 0x7f0838004c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0844009ac0 tx=0x7f08380057f0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.798+0000 7f084f7fe640 1 -- 172.21.15.134:0/1076449396 reap_dead start 2024-02-17T14:30:01.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.798+0000 7f0855593640 1 -- 172.21.15.134:0/1076449396 shutdown_connections 2024-02-17T14:30:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.798+0000 7f0855593640 1 -- 172.21.15.134:0/1076449396 >> 172.21.15.134:0/1076449396 conn(0x7f08500bc6d0 msgr2=0x7f08500bcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.798+0000 7f0855593640 1 -- 172.21.15.134:0/1076449396 shutdown_connections 2024-02-17T14:30:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.798+0000 7f0855593640 1 -- 172.21.15.134:0/1076449396 wait complete. 2024-02-17T14:30:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.799+0000 7f0855593640 1 Processor -- start 2024-02-17T14:30:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.799+0000 7f0855593640 1 -- start start 2024-02-17T14:30:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f0855593640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08380047c0 0x7f0850143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f0855593640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0850143010 0x7f08501dcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f0855593640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08501dd0f0 0x7f085013ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f0855593640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0850142d80 con 0x7f08380047c0 2024-02-17T14:30:01.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f0855593640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08500b1600 con 0x7f0850143010 2024-02-17T14:30:01.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f0855593640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08501dc480 con 0x7f08501dd0f0 2024-02-17T14:30:01.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f084effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08380047c0 0x7f0850143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f084effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08380047c0 0x7f0850143ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42970/0 (socket says 172.21.15.134:42970) 2024-02-17T14:30:01.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f084effd640 1 -- 172.21.15.134:0/1320801587 learned_addr learned my addr 172.21.15.134:0/1320801587 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:01.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f084effd640 1 -- 172.21.15.134:0/1320801587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08501dd0f0 msgr2=0x7f085013ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f084effd640 1 --2- 172.21.15.134:0/1320801587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08501dd0f0 0x7f085013ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f084effd640 1 -- 172.21.15.134:0/1320801587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0850143010 msgr2=0x7f08501dcbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f084effd640 1 --2- 172.21.15.134:0/1320801587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0850143010 0x7f08501dcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f084effd640 1 -- 172.21.15.134:0/1320801587 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08501dc720 con 0x7f08380047c0 2024-02-17T14:30:01.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.800+0000 7f084effd640 1 --2- 172.21.15.134:0/1320801587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08380047c0 0x7f0850143ae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f08400118e0 tx=0x7f0840011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.801+0000 7f08377fe640 1 -- 172.21.15.134:0/1320801587 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084000fa10 con 0x7f08380047c0 2024-02-17T14:30:01.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.801+0000 7f08377fe640 1 -- 172.21.15.134:0/1320801587 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084000fb70 con 0x7f08380047c0 2024-02-17T14:30:01.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.801+0000 7f08377fe640 1 -- 172.21.15.134:0/1320801587 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840014440 con 0x7f08380047c0 2024-02-17T14:30:01.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.801+0000 7f0855593640 1 -- 172.21.15.134:0/1320801587 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0850142aa0 con 0x7f08380047c0 2024-02-17T14:30:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.801+0000 7f0855593640 1 -- 172.21.15.134:0/1320801587 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0850144930 con 0x7f08380047c0 2024-02-17T14:30:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.802+0000 7f0855593640 1 -- 172.21.15.134:0/1320801587 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08500b56d0 con 0x7f08380047c0 2024-02-17T14:30:01.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.802+0000 7f08377fe640 1 -- 172.21.15.134:0/1320801587 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f08400145a0 con 0x7f08380047c0 2024-02-17T14:30:01.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.802+0000 7f08377fe640 1 --2- 172.21.15.134:0/1320801587 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f083c06b840 0x7f083c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.803+0000 7f08377fe640 1 -- 172.21.15.134:0/1320801587 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f084008aca0 con 0x7f08380047c0 2024-02-17T14:30:01.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.803+0000 7f084e7fc640 1 --2- 172.21.15.134:0/1320801587 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f083c06b840 0x7f083c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.803+0000 7f08377fe640 1 --2- 172.21.15.134:0/1320801587 >> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] conn(0x7f083c075260 0x7f083c077700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.803+0000 7f08377fe640 1 -- 172.21.15.134:0/1320801587 --> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f083c077dd0 con 0x7f083c075260 2024-02-17T14:30:01.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.803+0000 7f08377fe640 1 -- 172.21.15.134:0/1320801587 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f084008d360 con 0x7f08380047c0 2024-02-17T14:30:01.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.803+0000 7f084f7fe640 1 --2- 172.21.15.134:0/1320801587 >> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] conn(0x7f083c075260 0x7f083c077700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.803+0000 7f084e7fc640 1 --2- 172.21.15.134:0/1320801587 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f083c06b840 0x7f083c06dd00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0844036000 tx=0x7f084402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.803+0000 7f084f7fe640 1 --2- 172.21.15.134:0/1320801587 >> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] conn(0x7f083c075260 0x7f083c077700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.804+0000 7f08377fe640 1 -- 172.21.15.134:0/1320801587 <== osd.1 v2:172.21.15.134:6808/3862322423 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f083c077dd0 con 0x7f083c075260 2024-02-17T14:30:01.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.817+0000 7f0855593640 1 -- 172.21.15.134:0/1320801587 --> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f08500b66c0 con 0x7f083c075260 2024-02-17T14:30:01.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.817+0000 7f08377fe640 1 -- 172.21.15.134:0/1320801587 <== osd.1 v2:172.21.15.134:6808/3862322423 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0848004be0 con 0x7f083c075260 2024-02-17T14:30:01.817 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-17T14:30:01.817 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T14:30:01.817 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-17T14:30:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.817+0000 7f0855593640 1 -- 172.21.15.134:0/1320801587 >> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] conn(0x7f083c075260 msgr2=0x7f083c077700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.817+0000 7f0855593640 1 --2- 172.21.15.134:0/1320801587 >> [v2:172.21.15.134:6808/3862322423,v1:172.21.15.134:6810/3862322423] conn(0x7f083c075260 0x7f083c077700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.817+0000 7f0855593640 1 -- 172.21.15.134:0/1320801587 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f083c06b840 msgr2=0x7f083c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.817+0000 7f0855593640 1 --2- 172.21.15.134:0/1320801587 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f083c06b840 0x7f083c06dd00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0844036000 tx=0x7f084402e000 comp rx=0 tx=0).stop 2024-02-17T14:30:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.817+0000 7f0855593640 1 -- 172.21.15.134:0/1320801587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08380047c0 msgr2=0x7f0850143ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.817+0000 7f0855593640 1 --2- 172.21.15.134:0/1320801587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08380047c0 0x7f0850143ae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f08400118e0 tx=0x7f0840011da0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.817+0000 7f084f7fe640 1 -- 172.21.15.134:0/1320801587 reap_dead start 2024-02-17T14:30:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.817+0000 7f0855593640 1 -- 172.21.15.134:0/1320801587 shutdown_connections 2024-02-17T14:30:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.817+0000 7f0855593640 1 -- 172.21.15.134:0/1320801587 >> 172.21.15.134:0/1320801587 conn(0x7f08500bc6d0 msgr2=0x7f08500b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.817+0000 7f0855593640 1 -- 172.21.15.134:0/1320801587 shutdown_connections 2024-02-17T14:30:01.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.817+0000 7f0855593640 1 -- 172.21.15.134:0/1320801587 wait complete. 2024-02-17T14:30:01.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-17T14:30:01.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.931+0000 7fdfcb40f640 1 Processor -- start 2024-02-17T14:30:01.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.931+0000 7fdfcb40f640 1 -- start start 2024-02-17T14:30:01.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.931+0000 7fdfcb40f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdfc40b5020 0x7fdfc4146f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.931+0000 7fdfcb40f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdfc4147480 0x7fdfc4071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.931+0000 7fdfcb40f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc4071e40 0x7fdfc406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.931+0000 7fdfcb40f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc40714b0 con 0x7fdfc4147480 2024-02-17T14:30:01.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.931+0000 7fdfcb40f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc40722d0 con 0x7fdfc40b5020 2024-02-17T14:30:01.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.931+0000 7fdfcb40f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40b5400 con 0x7fdfc4071e40 2024-02-17T14:30:01.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.932+0000 7fdfc89aa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdfc4147480 0x7fdfc4071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.932+0000 7fdfc89aa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdfc4147480 0x7fdfc4071900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42976/0 (socket says 172.21.15.134:42976) 2024-02-17T14:30:01.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.932+0000 7fdfc89aa640 1 -- 172.21.15.134:0/2575718104 learned_addr learned my addr 172.21.15.134:0/2575718104 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:01.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.932+0000 7fdfc99ac640 1 --2- 172.21.15.134:0/2575718104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc4071e40 0x7fdfc406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.932+0000 7fdfc91ab640 1 --2- 172.21.15.134:0/2575718104 >> v2:172.21.15.142:3300/0 conn(0x7fdfc40b5020 0x7fdfc4146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.932+0000 7fdfc89aa640 1 -- 172.21.15.134:0/2575718104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc4071e40 msgr2=0x7fdfc406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:01.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.932+0000 7fdfc89aa640 1 --2- 172.21.15.134:0/2575718104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc4071e40 0x7fdfc406cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.932+0000 7fdfc89aa640 1 -- 172.21.15.134:0/2575718104 >> v2:172.21.15.142:3300/0 conn(0x7fdfc40b5020 msgr2=0x7fdfc4146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:01.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.932+0000 7fdfc89aa640 1 --2- 172.21.15.134:0/2575718104 >> v2:172.21.15.142:3300/0 conn(0x7fdfc40b5020 0x7fdfc4146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.932+0000 7fdfc89aa640 1 -- 172.21.15.134:0/2575718104 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc4147a10 con 0x7fdfc4147480 2024-02-17T14:30:01.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.932+0000 7fdfc91ab640 1 --2- 172.21.15.134:0/2575718104 >> v2:172.21.15.142:3300/0 conn(0x7fdfc40b5020 0x7fdfc4146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:30:01.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.933+0000 7fdfc89aa640 1 --2- 172.21.15.134:0/2575718104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc4147480 0x7fdfc4071900 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4073300 tx=0x7fdfc002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef4719e48d0caf9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.933+0000 7fdfb7fff640 1 -- 172.21.15.134:0/2575718104 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc00317e0 con 0x7fdfc4147480 2024-02-17T14:30:01.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.933+0000 7fdfb7fff640 1 -- 172.21.15.134:0/2575718104 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc0031940 con 0x7fdfc4147480 2024-02-17T14:30:01.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.933+0000 7fdfb7fff640 1 -- 172.21.15.134:0/2575718104 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0031cd0 con 0x7fdfc4147480 2024-02-17T14:30:01.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.933+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2575718104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc4147480 msgr2=0x7fdfc4071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.933+0000 7fdfcb40f640 1 --2- 172.21.15.134:0/2575718104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc4147480 0x7fdfc4071900 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4073300 tx=0x7fdfc002b880 comp rx=0 tx=0).stop 2024-02-17T14:30:01.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.933+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2575718104 shutdown_connections 2024-02-17T14:30:01.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.933+0000 7fdfcb40f640 1 --2- 172.21.15.134:0/2575718104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc4071e40 0x7fdfc406cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.933+0000 7fdfcb40f640 1 --2- 172.21.15.134:0/2575718104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc4147480 0x7fdfc4071900 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.933+0000 7fdfcb40f640 1 --2- 172.21.15.134:0/2575718104 >> v2:172.21.15.142:3300/0 conn(0x7fdfc40b5020 0x7fdfc4146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.933+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2575718104 >> 172.21.15.134:0/2575718104 conn(0x7fdfc40ba430 msgr2=0x7fdfc40ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:01.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.933+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2575718104 shutdown_connections 2024-02-17T14:30:01.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.933+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2575718104 wait complete. 2024-02-17T14:30:01.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.934+0000 7fdfcb40f640 1 Processor -- start 2024-02-17T14:30:01.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.934+0000 7fdfcb40f640 1 -- start start 2024-02-17T14:30:01.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfcb40f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc4071e40 0x7fdfc409e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfcb40f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc40b5020 0x7fdfc4140620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfcb40f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc4147480 0x7fdfc409d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfcb40f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4141d30 con 0x7fdfc40b5020 2024-02-17T14:30:01.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfcb40f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41e0800 con 0x7fdfc4147480 2024-02-17T14:30:01.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfcb40f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41e0ce0 con 0x7fdfc4071e40 2024-02-17T14:30:01.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfc89aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc40b5020 0x7fdfc4140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfc89aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc40b5020 0x7fdfc4140620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42980/0 (socket says 172.21.15.134:42980) 2024-02-17T14:30:01.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfc89aa640 1 -- 172.21.15.134:0/2840837763 learned_addr learned my addr 172.21.15.134:0/2840837763 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:01.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfc91ab640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc4071e40 0x7fdfc409e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfc99ac640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc4147480 0x7fdfc409d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfc89aa640 1 -- 172.21.15.134:0/2840837763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc4071e40 msgr2=0x7fdfc409e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfc89aa640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc4071e40 0x7fdfc409e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfc89aa640 1 -- 172.21.15.134:0/2840837763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc4147480 msgr2=0x7fdfc409d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfc89aa640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc4147480 0x7fdfc409d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.935+0000 7fdfc89aa640 1 -- 172.21.15.134:0/2840837763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc00094d0 con 0x7fdfc40b5020 2024-02-17T14:30:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.936+0000 7fdfc89aa640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc40b5020 0x7fdfc4140620 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0000c00 tx=0x7fdfc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.936+0000 7fdfb5ffb640 1 -- 172.21.15.134:0/2840837763 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0032880 con 0x7fdfc40b5020 2024-02-17T14:30:01.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.936+0000 7fdfb5ffb640 1 -- 172.21.15.134:0/2840837763 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc0032a20 con 0x7fdfc40b5020 2024-02-17T14:30:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.936+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2840837763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc409f010 con 0x7fdfc40b5020 2024-02-17T14:30:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.936+0000 7fdfb5ffb640 1 -- 172.21.15.134:0/2840837763 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0032dd0 con 0x7fdfc40b5020 2024-02-17T14:30:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.936+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2840837763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc40b4210 con 0x7fdfc40b5020 2024-02-17T14:30:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.937+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2840837763 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc409f1a0 con 0x7fdfc40b5020 2024-02-17T14:30:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.937+0000 7fdfb5ffb640 1 -- 172.21.15.134:0/2840837763 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fdfc004e450 con 0x7fdfc40b5020 2024-02-17T14:30:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.938+0000 7fdfb5ffb640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fdfa806b810 0x7fdfa806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:01.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.938+0000 7fdfb5ffb640 1 -- 172.21.15.134:0/2840837763 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fdfc00ac520 con 0x7fdfc40b5020 2024-02-17T14:30:01.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.938+0000 7fdfc91ab640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fdfa806b810 0x7fdfa806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:01.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.938+0000 7fdfc91ab640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fdfa806b810 0x7fdfa806dcd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40b4730 tx=0x7fdfb8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:01.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:01.942+0000 7fdfb5ffb640 1 -- 172.21.15.134:0/2840837763 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdfc0076e60 con 0x7fdfc40b5020 2024-02-17T14:30:02.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.112+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2840837763 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfc4072f30 con 0x7fdfa806b810 2024-02-17T14:30:02.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.112+0000 7fdfb5ffb640 1 -- 172.21.15.134:0/2840837763 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdfc4072f30 con 0x7fdfa806b810 2024-02-17T14:30:02.112 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 1 to deep-scrub 2024-02-17T14:30:02.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.114+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2840837763 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fdfa806b810 msgr2=0x7fdfa806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.114+0000 7fdfcb40f640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fdfa806b810 0x7fdfa806dcd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40b4730 tx=0x7fdfb8008040 comp rx=0 tx=0).stop 2024-02-17T14:30:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.114+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2840837763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc40b5020 msgr2=0x7fdfc4140620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.114+0000 7fdfcb40f640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc40b5020 0x7fdfc4140620 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0000c00 tx=0x7fdfc00046c0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.114+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2840837763 shutdown_connections 2024-02-17T14:30:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.114+0000 7fdfcb40f640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc4147480 0x7fdfc409d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.114+0000 7fdfcb40f640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fdfa806b810 0x7fdfa806dcd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.114+0000 7fdfcb40f640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc40b5020 0x7fdfc4140620 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.114+0000 7fdfcb40f640 1 --2- 172.21.15.134:0/2840837763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfc4071e40 0x7fdfc409e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.114+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2840837763 >> 172.21.15.134:0/2840837763 conn(0x7fdfc40ba430 msgr2=0x7fdfc406f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:02.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.114+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2840837763 shutdown_connections 2024-02-17T14:30:02.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.114+0000 7fdfcb40f640 1 -- 172.21.15.134:0/2840837763 wait complete. 2024-02-17T14:30:02.125 INFO:tasks.ceph:Scrubbing osd.2 2024-02-17T14:30:02.126 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-17T14:30:02.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.230+0000 7ff4e13e9640 1 Processor -- start 2024-02-17T14:30:02.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.230+0000 7ff4e13e9640 1 -- start start 2024-02-17T14:30:02.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.231+0000 7ff4e13e9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4dc0b3d40 0x7ff4dc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.231+0000 7ff4e13e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4dc147540 0x7ff4dc147960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.231+0000 7ff4e13e9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4dc0b59b0 con 0x7ff4dc140a00 2024-02-17T14:30:02.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.231+0000 7ff4e13e9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4dc141580 con 0x7ff4dc0b3d40 2024-02-17T14:30:02.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.231+0000 7ff4e13e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc0b7050 con 0x7ff4dc147540 2024-02-17T14:30:02.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.231+0000 7ff4da7fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4dc147540 0x7ff4dc147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.231+0000 7ff4daffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4dc0b3d40 0x7ff4dc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.231+0000 7ff4db7fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff4dc140a00 0x7ff4dc140e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:59996/0 (socket says 172.21.15.134:59996) 2024-02-17T14:30:02.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.231+0000 7ff4db7fe640 1 -- 172.21.15.134:0/3925907516 learned_addr learned my addr 172.21.15.134:0/3925907516 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:02.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.231+0000 7ff4da7fc640 1 -- 172.21.15.134:0/3925907516 >> v2:172.21.15.142:3300/0 conn(0x7ff4dc0b3d40 msgr2=0x7ff4dc0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:02.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.231+0000 7ff4da7fc640 1 --2- 172.21.15.134:0/3925907516 >> v2:172.21.15.142:3300/0 conn(0x7ff4dc0b3d40 0x7ff4dc0b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.231+0000 7ff4da7fc640 1 -- 172.21.15.134:0/3925907516 >> v1:172.21.15.142:6789/0 conn(0x7ff4dc140a00 legacy=0x7ff4dc140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.231+0000 7ff4da7fc640 1 -- 172.21.15.134:0/3925907516 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc146d80 con 0x7ff4dc147540 2024-02-17T14:30:02.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.232+0000 7ff4da7fc640 1 --2- 172.21.15.134:0/3925907516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4dc147540 0x7ff4dc147960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00097a0 tx=0x7ff4d002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a22c9578b16291df server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.232+0000 7ff4d9ffb640 1 -- 172.21.15.134:0/3925907516 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0031830 con 0x7ff4dc147540 2024-02-17T14:30:02.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.232+0000 7ff4d9ffb640 1 -- 172.21.15.134:0/3925907516 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d0031990 con 0x7ff4dc147540 2024-02-17T14:30:02.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.232+0000 7ff4d9ffb640 1 -- 172.21.15.134:0/3925907516 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0031d20 con 0x7ff4dc147540 2024-02-17T14:30:02.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.233+0000 7ff4e13e9640 1 -- 172.21.15.134:0/3925907516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4dc147540 msgr2=0x7ff4dc147960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.233+0000 7ff4e13e9640 1 --2- 172.21.15.134:0/3925907516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4dc147540 0x7ff4dc147960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00097a0 tx=0x7ff4d002b8d0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.233+0000 7ff4e13e9640 1 -- 172.21.15.134:0/3925907516 shutdown_connections 2024-02-17T14:30:02.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.233+0000 7ff4e13e9640 1 --2- 172.21.15.134:0/3925907516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4dc147540 0x7ff4dc147960 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.233+0000 7ff4e13e9640 1 --2- 172.21.15.134:0/3925907516 >> v2:172.21.15.142:3300/0 conn(0x7ff4dc0b3d40 0x7ff4dc0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.233+0000 7ff4e13e9640 1 -- 172.21.15.134:0/3925907516 >> 172.21.15.134:0/3925907516 conn(0x7ff4dc0bc6d0 msgr2=0x7ff4dc0bcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:02.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.233+0000 7ff4e13e9640 1 -- 172.21.15.134:0/3925907516 shutdown_connections 2024-02-17T14:30:02.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.233+0000 7ff4e13e9640 1 -- 172.21.15.134:0/3925907516 wait complete. 2024-02-17T14:30:02.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.234+0000 7ff4e13e9640 1 Processor -- start 2024-02-17T14:30:02.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.234+0000 7ff4e13e9640 1 -- start start 2024-02-17T14:30:02.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.234+0000 7ff4e13e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4dc0b3d40 0x7ff4dc0b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4e13e9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4dc140a00 0x7ff4dc1dc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4e13e9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4dc147540 0x7ff4dc1dca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4e13e9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc0b27f0 con 0x7ff4dc140a00 2024-02-17T14:30:02.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4e13e9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc13d380 con 0x7ff4dc147540 2024-02-17T14:30:02.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4e13e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc141ae0 con 0x7ff4dc0b3d40 2024-02-17T14:30:02.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4daffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4dc0b3d40 0x7ff4dc0b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4da7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4dc140a00 0x7ff4dc1dc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4daffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4dc0b3d40 0x7ff4dc0b20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.134:43134/0 (socket says 172.21.15.134:43134) 2024-02-17T14:30:02.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4daffd640 1 -- 172.21.15.134:0/51264563 learned_addr learned my addr 172.21.15.134:0/51264563 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:02.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4db7fe640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4dc147540 0x7ff4dc1dca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4daffd640 1 -- 172.21.15.134:0/51264563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4dc147540 msgr2=0x7ff4dc1dca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4daffd640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4dc147540 0x7ff4dc1dca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4daffd640 1 -- 172.21.15.134:0/51264563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4dc140a00 msgr2=0x7ff4dc1dc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4daffd640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4dc140a00 0x7ff4dc1dc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4daffd640 1 -- 172.21.15.134:0/51264563 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0009400 con 0x7ff4dc0b3d40 2024-02-17T14:30:02.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4da7fc640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4dc140a00 0x7ff4dc1dc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:30:02.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4daffd640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4dc0b3d40 0x7ff4dc0b20d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00e930 tx=0x7ff4cc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4c37fe640 1 -- 172.21.15.134:0/51264563 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc009690 con 0x7ff4dc0b3d40 2024-02-17T14:30:02.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4c37fe640 1 -- 172.21.15.134:0/51264563 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc00ca00 con 0x7ff4dc0b3d40 2024-02-17T14:30:02.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4e13e9640 1 -- 172.21.15.134:0/51264563 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4dc13b510 con 0x7ff4dc0b3d40 2024-02-17T14:30:02.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4c37fe640 1 -- 172.21.15.134:0/51264563 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc00cdb0 con 0x7ff4dc0b3d40 2024-02-17T14:30:02.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.235+0000 7ff4e13e9640 1 -- 172.21.15.134:0/51264563 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4dc0b3440 con 0x7ff4dc0b3d40 2024-02-17T14:30:02.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.236+0000 7ff4e13e9640 1 -- 172.21.15.134:0/51264563 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4dc0b56d0 con 0x7ff4dc0b3d40 2024-02-17T14:30:02.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.237+0000 7ff4c37fe640 1 -- 172.21.15.134:0/51264563 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7ff4cc013470 con 0x7ff4dc0b3d40 2024-02-17T14:30:02.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.237+0000 7ff4c37fe640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff4c806b810 0x7ff4c806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.237+0000 7ff4c37fe640 1 -- 172.21.15.134:0/51264563 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff4cc08ab30 con 0x7ff4dc0b3d40 2024-02-17T14:30:02.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.237+0000 7ff4da7fc640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff4c806b810 0x7ff4c806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.237+0000 7ff4c37fe640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] conn(0x7ff4c8075230 0x7ff4c80776d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.237+0000 7ff4c37fe640 1 -- 172.21.15.134:0/51264563 --> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4c8077da0 con 0x7ff4c8075230 2024-02-17T14:30:02.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.237+0000 7ff4c37fe640 1 -- 172.21.15.134:0/51264563 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4cc08aea0 con 0x7ff4dc0b3d40 2024-02-17T14:30:02.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.238+0000 7ff4db7fe640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] conn(0x7ff4c8075230 0x7ff4c80776d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.238+0000 7ff4da7fc640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff4c806b810 0x7ff4c806dcd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0036000 tx=0x7ff4d003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.238+0000 7ff4db7fe640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] conn(0x7ff4c8075230 0x7ff4c80776d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.239+0000 7ff4c37fe640 1 -- 172.21.15.134:0/51264563 <== osd.2 v2:172.21.15.134:6800/1064515362 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff4c8077da0 con 0x7ff4c8075230 2024-02-17T14:30:02.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.251+0000 7ff4e13e9640 1 -- 172.21.15.134:0/51264563 --> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff4dc0b6700 con 0x7ff4c8075230 2024-02-17T14:30:02.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.252+0000 7ff4c37fe640 1 -- 172.21.15.134:0/51264563 <== osd.2 v2:172.21.15.134:6800/1064515362 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff4d4001f00 con 0x7ff4c8075230 2024-02-17T14:30:02.252 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-17T14:30:02.252 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T14:30:02.252 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-17T14:30:02.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.252+0000 7ff4e13e9640 1 -- 172.21.15.134:0/51264563 >> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] conn(0x7ff4c8075230 msgr2=0x7ff4c80776d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.252+0000 7ff4e13e9640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.134:6800/1064515362,v1:172.21.15.134:6801/1064515362] conn(0x7ff4c8075230 0x7ff4c80776d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.252+0000 7ff4e13e9640 1 -- 172.21.15.134:0/51264563 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff4c806b810 msgr2=0x7ff4c806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.252+0000 7ff4e13e9640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7ff4c806b810 0x7ff4c806dcd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0036000 tx=0x7ff4d003c040 comp rx=0 tx=0).stop 2024-02-17T14:30:02.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.252+0000 7ff4e13e9640 1 -- 172.21.15.134:0/51264563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4dc0b3d40 msgr2=0x7ff4dc0b20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.252+0000 7ff4e13e9640 1 --2- 172.21.15.134:0/51264563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4dc0b3d40 0x7ff4dc0b20d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00e930 tx=0x7ff4cc00edf0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.252+0000 7ff4db7fe640 1 -- 172.21.15.134:0/51264563 reap_dead start 2024-02-17T14:30:02.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.252+0000 7ff4e13e9640 1 -- 172.21.15.134:0/51264563 shutdown_connections 2024-02-17T14:30:02.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.252+0000 7ff4e13e9640 1 -- 172.21.15.134:0/51264563 >> 172.21.15.134:0/51264563 conn(0x7ff4dc0bc6d0 msgr2=0x7ff4dc073a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:02.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.252+0000 7ff4e13e9640 1 -- 172.21.15.134:0/51264563 shutdown_connections 2024-02-17T14:30:02.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.252+0000 7ff4e13e9640 1 -- 172.21.15.134:0/51264563 wait complete. 2024-02-17T14:30:02.263 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-17T14:30:02.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.363+0000 7f6702d2c640 1 Processor -- start 2024-02-17T14:30:02.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.364+0000 7f6702d2c640 1 -- start start 2024-02-17T14:30:02.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.364+0000 7f6702d2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc144960 0x7f66fc0b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.364+0000 7f6702d2c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f66fc09b190 0x7f66fc1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.364+0000 7f6702d2c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc14aaf0 con 0x7f66fc14a710 2024-02-17T14:30:02.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.364+0000 7f6702d2c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc09c280 con 0x7f66fc09b190 2024-02-17T14:30:02.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.364+0000 7f6702d2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc09b5e0 con 0x7f66fc144960 2024-02-17T14:30:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.364+0000 7f67012c9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f66fc09b190 0x7f66fc1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.364+0000 7f66fbfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc144960 0x7f66fc0b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.365+0000 7f67012c9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f66fc09b190 0x7f66fc1517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.134:39400/0 (socket says 172.21.15.134:39400) 2024-02-17T14:30:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.365+0000 7f67012c9640 1 -- 172.21.15.134:0/139529557 learned_addr learned my addr 172.21.15.134:0/139529557 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.365+0000 7f66fbfff640 1 -- 172.21.15.134:0/139529557 >> v2:172.21.15.142:3300/0 conn(0x7f66fc09b190 msgr2=0x7f66fc1517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.365+0000 7f66fbfff640 1 --2- 172.21.15.134:0/139529557 >> v2:172.21.15.142:3300/0 conn(0x7f66fc09b190 0x7f66fc1517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.365+0000 7f66fbfff640 1 -- 172.21.15.134:0/139529557 >> v1:172.21.15.142:6789/0 conn(0x7f66fc14a710 legacy=0x7f66fc144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.365+0000 7f66fbfff640 1 -- 172.21.15.134:0/139529557 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc09c4f0 con 0x7f66fc144960 2024-02-17T14:30:02.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.366+0000 7f66fbfff640 1 --2- 172.21.15.134:0/139529557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc144960 0x7f66fc0b6fc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66e80097a0 tx=0x7f66e802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e812182057aef2c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.366+0000 7f66fb7fe640 1 -- 172.21.15.134:0/139529557 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e802e070 con 0x7f66fc144960 2024-02-17T14:30:02.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.366+0000 7f66fb7fe640 1 -- 172.21.15.134:0/139529557 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e80315a0 con 0x7f66fc144960 2024-02-17T14:30:02.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.366+0000 7f66fb7fe640 1 -- 172.21.15.134:0/139529557 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8031930 con 0x7f66fc144960 2024-02-17T14:30:02.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.366+0000 7f6702d2c640 1 -- 172.21.15.134:0/139529557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc144960 msgr2=0x7f66fc0b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.366+0000 7f6702d2c640 1 --2- 172.21.15.134:0/139529557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc144960 0x7f66fc0b6fc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66e80097a0 tx=0x7f66e802b840 comp rx=0 tx=0).stop 2024-02-17T14:30:02.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.366+0000 7f6702d2c640 1 -- 172.21.15.134:0/139529557 shutdown_connections 2024-02-17T14:30:02.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.366+0000 7f6702d2c640 1 --2- 172.21.15.134:0/139529557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc144960 0x7f66fc0b6fc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.366+0000 7f6702d2c640 1 --2- 172.21.15.134:0/139529557 >> v2:172.21.15.142:3300/0 conn(0x7f66fc09b190 0x7f66fc1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.366+0000 7f6702d2c640 1 -- 172.21.15.134:0/139529557 >> 172.21.15.134:0/139529557 conn(0x7f66fc0b90c0 msgr2=0x7f66fc0b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:02.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.366+0000 7f6702d2c640 1 -- 172.21.15.134:0/139529557 shutdown_connections 2024-02-17T14:30:02.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.366+0000 7f6702d2c640 1 -- 172.21.15.134:0/139529557 wait complete. 2024-02-17T14:30:02.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.367+0000 7f6702d2c640 1 Processor -- start 2024-02-17T14:30:02.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.367+0000 7f6702d2c640 1 -- start start 2024-02-17T14:30:02.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.368+0000 7f6702d2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc09b190 0x7f66fc1dc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.368+0000 7f6702d2c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66fc144960 0x7f66fc13e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.368+0000 7f6702d2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66fc14a710 0x7f66fc144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.368+0000 7f6702d2c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0b4ea0 con 0x7f66fc14a710 2024-02-17T14:30:02.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.368+0000 7f6702d2c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc1dd2a0 con 0x7f66fc144960 2024-02-17T14:30:02.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.368+0000 7f6702d2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc1dcc50 con 0x7f66fc09b190 2024-02-17T14:30:02.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.368+0000 7f67012c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66fc14a710 0x7f66fc144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.368+0000 7f67012c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66fc14a710 0x7f66fc144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42996/0 (socket says 172.21.15.134:42996) 2024-02-17T14:30:02.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.368+0000 7f67012c9640 1 -- 172.21.15.134:0/1772379806 learned_addr learned my addr 172.21.15.134:0/1772379806 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:02.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.368+0000 7f6700ac8640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc09b190 0x7f66fc1dc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.368+0000 7f66fbfff640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66fc144960 0x7f66fc13e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.369+0000 7f67012c9640 1 -- 172.21.15.134:0/1772379806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc09b190 msgr2=0x7f66fc1dc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.369+0000 7f67012c9640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc09b190 0x7f66fc1dc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.369+0000 7f67012c9640 1 -- 172.21.15.134:0/1772379806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66fc144960 msgr2=0x7f66fc13e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.369+0000 7f67012c9640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66fc144960 0x7f66fc13e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.369+0000 7f67012c9640 1 -- 172.21.15.134:0/1772379806 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8009400 con 0x7f66fc14a710 2024-02-17T14:30:02.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.369+0000 7f67012c9640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66fc14a710 0x7f66fc144e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f66f400efc0 tx=0x7f66f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.369+0000 7f66f97fa640 1 -- 172.21.15.134:0/1772379806 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f400cd20 con 0x7f66fc14a710 2024-02-17T14:30:02.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.369+0000 7f66f97fa640 1 -- 172.21.15.134:0/1772379806 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f400f040 con 0x7f66fc14a710 2024-02-17T14:30:02.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.369+0000 7f6702d2c640 1 -- 172.21.15.134:0/1772379806 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66fc1dcf30 con 0x7f66fc14a710 2024-02-17T14:30:02.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.369+0000 7f66f97fa640 1 -- 172.21.15.134:0/1772379806 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4003bd0 con 0x7f66fc14a710 2024-02-17T14:30:02.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.369+0000 7f6702d2c640 1 -- 172.21.15.134:0/1772379806 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc147bb0 con 0x7f66fc14a710 2024-02-17T14:30:02.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.370+0000 7f6702d2c640 1 -- 172.21.15.134:0/1772379806 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc143d20 con 0x7f66fc14a710 2024-02-17T14:30:02.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.370+0000 7f66f97fa640 1 -- 172.21.15.134:0/1772379806 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f66f4003d30 con 0x7f66fc14a710 2024-02-17T14:30:02.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.371+0000 7f66f97fa640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f66e006b810 0x7f66e006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.371+0000 7f6700ac8640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f66e006b810 0x7f66e006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.371+0000 7f66f97fa640 1 -- 172.21.15.134:0/1772379806 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f66f408ac40 con 0x7f66fc14a710 2024-02-17T14:30:02.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.371+0000 7f6700ac8640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f66e006b810 0x7f66e006dcd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f66f0007fd0 tx=0x7f66f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.375+0000 7f66f97fa640 1 -- 172.21.15.134:0/1772379806 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f66f40552f0 con 0x7f66fc14a710 2024-02-17T14:30:02.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.548+0000 7f6702d2c640 1 -- 172.21.15.134:0/1772379806 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f66fc09ac70 con 0x7f66e006b810 2024-02-17T14:30:02.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.548+0000 7f66f97fa640 1 -- 172.21.15.134:0/1772379806 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f66f00050d0 con 0x7f66e006b810 2024-02-17T14:30:02.549 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 2 to deep-scrub 2024-02-17T14:30:02.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.550+0000 7f6702d2c640 1 -- 172.21.15.134:0/1772379806 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f66e006b810 msgr2=0x7f66e006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.550+0000 7f6702d2c640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f66e006b810 0x7f66e006dcd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f66f0007fd0 tx=0x7f66f0009040 comp rx=0 tx=0).stop 2024-02-17T14:30:02.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.550+0000 7f6702d2c640 1 -- 172.21.15.134:0/1772379806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66fc14a710 msgr2=0x7f66fc144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.550+0000 7f6702d2c640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66fc14a710 0x7f66fc144e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f66f400efc0 tx=0x7f66f400c490 comp rx=0 tx=0).stop 2024-02-17T14:30:02.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.550+0000 7f6702d2c640 1 -- 172.21.15.134:0/1772379806 shutdown_connections 2024-02-17T14:30:02.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.550+0000 7f6702d2c640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f66e006b810 0x7f66e006dcd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.550+0000 7f6702d2c640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66fc14a710 0x7f66fc144e10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.550+0000 7f6702d2c640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66fc144960 0x7f66fc13e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.550+0000 7f6702d2c640 1 --2- 172.21.15.134:0/1772379806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc09b190 0x7f66fc1dc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.550+0000 7f6702d2c640 1 -- 172.21.15.134:0/1772379806 >> 172.21.15.134:0/1772379806 conn(0x7f66fc0b90c0 msgr2=0x7f66fc0baa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:02.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.550+0000 7f6702d2c640 1 -- 172.21.15.134:0/1772379806 shutdown_connections 2024-02-17T14:30:02.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.550+0000 7f6702d2c640 1 -- 172.21.15.134:0/1772379806 wait complete. 2024-02-17T14:30:02.562 INFO:tasks.ceph:Scrubbing osd.3 2024-02-17T14:30:02.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-17T14:30:02.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.666+0000 7f70fc09a640 1 Processor -- start 2024-02-17T14:30:02.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.666+0000 7f70fc09a640 1 -- start start 2024-02-17T14:30:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70fc09a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70f4072dc0 0x7f70f413eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70fc09a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f70f413f000 0x7f70f414f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70fc09a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f409d010 con 0x7f70f406e570 2024-02-17T14:30:02.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70fc09a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f40b57a0 con 0x7f70f413f000 2024-02-17T14:30:02.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70fc09a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f406f220 con 0x7f70f4072dc0 2024-02-17T14:30:02.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70fa637640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f70f413f000 0x7f70f414f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70f9e36640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f70f406e570 0x7f70f40b5e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52956/0 (socket says 172.21.15.134:52956) 2024-02-17T14:30:02.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70fa637640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f70f413f000 0x7f70f414f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43004/0 (socket says 172.21.15.134:43004) 2024-02-17T14:30:02.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70f9e36640 1 -- 172.21.15.134:0/2726276839 learned_addr learned my addr 172.21.15.134:0/2726276839 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:02.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70f9635640 1 --2- 172.21.15.134:0/2726276839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70f4072dc0 0x7f70f413eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70fa637640 1 -- 172.21.15.134:0/2726276839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70f4072dc0 msgr2=0x7f70f413eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:02.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70fa637640 1 --2- 172.21.15.134:0/2726276839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70f4072dc0 0x7f70f413eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70fa637640 1 -- 172.21.15.134:0/2726276839 >> v1:172.21.15.134:6789/0 conn(0x7f70f406e570 legacy=0x7f70f40b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70fa637640 1 -- 172.21.15.134:0/2726276839 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f406e950 con 0x7f70f413f000 2024-02-17T14:30:02.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.667+0000 7f70f8e34640 1 -- 172.21.15.134:0/2726276839 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551972912 0 0) 0x7f70f409d010 con 0x7f70f406e570 2024-02-17T14:30:02.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.668+0000 7f70fa637640 1 --2- 172.21.15.134:0/2726276839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f413f000 0x7f70f414f520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0097a0 tx=0x7f70ec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5e1c3af1a7adf6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.668+0000 7f70f8e34640 1 -- 172.21.15.134:0/2726276839 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec02e070 con 0x7f70f413f000 2024-02-17T14:30:02.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.668+0000 7f70f8e34640 1 -- 172.21.15.134:0/2726276839 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec0315a0 con 0x7f70f413f000 2024-02-17T14:30:02.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.668+0000 7f70f8e34640 1 -- 172.21.15.134:0/2726276839 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec031930 con 0x7f70f413f000 2024-02-17T14:30:02.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.669+0000 7f70fc09a640 1 -- 172.21.15.134:0/2726276839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f413f000 msgr2=0x7f70f414f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.669+0000 7f70fc09a640 1 --2- 172.21.15.134:0/2726276839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f413f000 0x7f70f414f520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0097a0 tx=0x7f70ec02b840 comp rx=0 tx=0).stop 2024-02-17T14:30:02.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.669+0000 7f70fc09a640 1 -- 172.21.15.134:0/2726276839 shutdown_connections 2024-02-17T14:30:02.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.669+0000 7f70fc09a640 1 --2- 172.21.15.134:0/2726276839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f413f000 0x7f70f414f520 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.669+0000 7f70fc09a640 1 --2- 172.21.15.134:0/2726276839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70f4072dc0 0x7f70f413eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.669+0000 7f70fc09a640 1 -- 172.21.15.134:0/2726276839 >> 172.21.15.134:0/2726276839 conn(0x7f70f4099a30 msgr2=0x7f70f409c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:02.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.669+0000 7f70fc09a640 1 -- 172.21.15.134:0/2726276839 shutdown_connections 2024-02-17T14:30:02.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.669+0000 7f70fc09a640 1 -- 172.21.15.134:0/2726276839 wait complete. 2024-02-17T14:30:02.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.670+0000 7f70fc09a640 1 Processor -- start 2024-02-17T14:30:02.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.670+0000 7f70fc09a640 1 -- start start 2024-02-17T14:30:02.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.670+0000 7f70fc09a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f406e570 0x7f70f40ba940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70fc09a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70f4072dc0 0x7f70f41daa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70fc09a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70f413f000 0x7f70f409e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70fc09a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f41da600 con 0x7f70f406e570 2024-02-17T14:30:02.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70fc09a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4146820 con 0x7f70f4072dc0 2024-02-17T14:30:02.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70fc09a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f41da220 con 0x7f70f413f000 2024-02-17T14:30:02.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70f9e36640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f406e570 0x7f70f40ba940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70f9e36640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f406e570 0x7f70f40ba940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43014/0 (socket says 172.21.15.134:43014) 2024-02-17T14:30:02.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70f9e36640 1 -- 172.21.15.134:0/1700420074 learned_addr learned my addr 172.21.15.134:0/1700420074 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:02.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70fa637640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70f413f000 0x7f70f409e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70f9635640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70f4072dc0 0x7f70f41daa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70f9e36640 1 -- 172.21.15.134:0/1700420074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70f413f000 msgr2=0x7f70f409e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70f9e36640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70f413f000 0x7f70f409e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70f9e36640 1 -- 172.21.15.134:0/1700420074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70f4072dc0 msgr2=0x7f70f41daa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70f9e36640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70f4072dc0 0x7f70f41daa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70f9e36640 1 -- 172.21.15.134:0/1700420074 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec009400 con 0x7f70f406e570 2024-02-17T14:30:02.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70f9e36640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f406e570 0x7f70f40ba940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c890 tx=0x7f70f000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70ea7fc640 1 -- 172.21.15.134:0/1700420074 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f000a640 con 0x7f70f406e570 2024-02-17T14:30:02.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70ea7fc640 1 -- 172.21.15.134:0/1700420074 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f000a7c0 con 0x7f70f406e570 2024-02-17T14:30:02.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70fc09a640 1 -- 172.21.15.134:0/1700420074 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f406f880 con 0x7f70f406e570 2024-02-17T14:30:02.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70ea7fc640 1 -- 172.21.15.134:0/1700420074 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f000ab70 con 0x7f70f406e570 2024-02-17T14:30:02.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.671+0000 7f70fc09a640 1 -- 172.21.15.134:0/1700420074 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f409ef70 con 0x7f70f406e570 2024-02-17T14:30:02.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.672+0000 7f70fc09a640 1 -- 172.21.15.134:0/1700420074 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70f406f700 con 0x7f70f406e570 2024-02-17T14:30:02.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.673+0000 7f70ea7fc640 1 -- 172.21.15.134:0/1700420074 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f70f000acd0 con 0x7f70f406e570 2024-02-17T14:30:02.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.673+0000 7f70ea7fc640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f70d806b810 0x7f70d806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.673+0000 7f70ea7fc640 1 -- 172.21.15.134:0/1700420074 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f70f0089d50 con 0x7f70f406e570 2024-02-17T14:30:02.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.673+0000 7f70f9635640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f70d806b810 0x7f70d806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.673+0000 7f70ea7fc640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] conn(0x7f70d8075220 0x7f70d80776c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.673+0000 7f70ea7fc640 1 -- 172.21.15.134:0/1700420074 --> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70d8077d90 con 0x7f70d8075220 2024-02-17T14:30:02.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.673+0000 7f70ea7fc640 1 -- 172.21.15.134:0/1700420074 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70f008c410 con 0x7f70f406e570 2024-02-17T14:30:02.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.673+0000 7f70fa637640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] conn(0x7f70d8075220 0x7f70d80776c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.674+0000 7f70f9635640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f70d806b810 0x7f70d806dcd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f70f413c2d0 tx=0x7f70e4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.674+0000 7f70fa637640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] conn(0x7f70d8075220 0x7f70d80776c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.674+0000 7f70ea7fc640 1 -- 172.21.15.134:0/1700420074 <== osd.3 v2:172.21.15.134:6818/2845314185 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f70d8077d90 con 0x7f70d8075220 2024-02-17T14:30:02.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.687+0000 7f70fc09a640 1 -- 172.21.15.134:0/1700420074 --> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f70f409cd30 con 0x7f70d8075220 2024-02-17T14:30:02.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.687+0000 7f70ea7fc640 1 -- 172.21.15.134:0/1700420074 <== osd.3 v2:172.21.15.134:6818/2845314185 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f70ec031a40 con 0x7f70d8075220 2024-02-17T14:30:02.688 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-17T14:30:02.688 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T14:30:02.688 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-17T14:30:02.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.688+0000 7f70fc09a640 1 -- 172.21.15.134:0/1700420074 >> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] conn(0x7f70d8075220 msgr2=0x7f70d80776c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.688+0000 7f70fc09a640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.134:6818/2845314185,v1:172.21.15.134:6821/2845314185] conn(0x7f70d8075220 0x7f70d80776c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.688+0000 7f70fc09a640 1 -- 172.21.15.134:0/1700420074 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f70d806b810 msgr2=0x7f70d806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.688+0000 7f70fc09a640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f70d806b810 0x7f70d806dcd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f70f413c2d0 tx=0x7f70e4009190 comp rx=0 tx=0).stop 2024-02-17T14:30:02.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.688+0000 7f70fc09a640 1 -- 172.21.15.134:0/1700420074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f406e570 msgr2=0x7f70f40ba940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.688+0000 7f70fc09a640 1 --2- 172.21.15.134:0/1700420074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f406e570 0x7f70f40ba940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c890 tx=0x7f70f000cd50 comp rx=0 tx=0).stop 2024-02-17T14:30:02.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.688+0000 7f70fa637640 1 -- 172.21.15.134:0/1700420074 reap_dead start 2024-02-17T14:30:02.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.688+0000 7f70fc09a640 1 -- 172.21.15.134:0/1700420074 shutdown_connections 2024-02-17T14:30:02.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.688+0000 7f70fc09a640 1 -- 172.21.15.134:0/1700420074 >> 172.21.15.134:0/1700420074 conn(0x7f70f4099a30 msgr2=0x7f70f4073a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:02.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.688+0000 7f70fc09a640 1 -- 172.21.15.134:0/1700420074 shutdown_connections 2024-02-17T14:30:02.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.688+0000 7f70fc09a640 1 -- 172.21.15.134:0/1700420074 wait complete. 2024-02-17T14:30:02.698 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-17T14:30:02.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.800+0000 7fbefa18c640 1 Processor -- start 2024-02-17T14:30:02.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.800+0000 7fbefa18c640 1 -- start start 2024-02-17T14:30:02.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.800+0000 7fbefa18c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40acb20 0x7fbef4146e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.800+0000 7fbefa18c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbef414f800 0x7fbef4151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.800+0000 7fbefa18c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef40b51f0 con 0x7fbef40ada50 2024-02-17T14:30:02.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.800+0000 7fbefa18c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef40b6640 con 0x7fbef414f800 2024-02-17T14:30:02.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.800+0000 7fbefa18c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef40ad2b0 con 0x7fbef40acb20 2024-02-17T14:30:02.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.801+0000 7fbef3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbef414f800 0x7fbef4151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.801+0000 7fbef37fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40acb20 0x7fbef4146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.801+0000 7fbeeaffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbef40ada50 0x7fbef4140b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.134:60018/0 (socket says 172.21.15.134:60018) 2024-02-17T14:30:02.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.801+0000 7fbeeaffd640 1 -- 172.21.15.134:0/3943756313 learned_addr learned my addr 172.21.15.134:0/3943756313 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:02.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.801+0000 7fbef37fe640 1 -- 172.21.15.134:0/3943756313 >> v2:172.21.15.142:3300/0 conn(0x7fbef414f800 msgr2=0x7fbef4151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:02.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.801+0000 7fbef37fe640 1 --2- 172.21.15.134:0/3943756313 >> v2:172.21.15.142:3300/0 conn(0x7fbef414f800 0x7fbef4151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.801+0000 7fbef37fe640 1 -- 172.21.15.134:0/3943756313 >> v1:172.21.15.142:6789/0 conn(0x7fbef40ada50 legacy=0x7fbef4140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.801+0000 7fbef37fe640 1 -- 172.21.15.134:0/3943756313 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef40ad590 con 0x7fbef40acb20 2024-02-17T14:30:02.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.802+0000 7fbef37fe640 1 --2- 172.21.15.134:0/3943756313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40acb20 0x7fbef4146e90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbee4009790 tx=0x7fbee402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60505ad075b45b29 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.802+0000 7fbef2ffd640 1 -- 172.21.15.134:0/3943756313 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4031800 con 0x7fbef40acb20 2024-02-17T14:30:02.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.802+0000 7fbef2ffd640 1 -- 172.21.15.134:0/3943756313 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee4031960 con 0x7fbef40acb20 2024-02-17T14:30:02.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.802+0000 7fbef2ffd640 1 -- 172.21.15.134:0/3943756313 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4031cf0 con 0x7fbef40acb20 2024-02-17T14:30:02.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.802+0000 7fbefa18c640 1 -- 172.21.15.134:0/3943756313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40acb20 msgr2=0x7fbef4146e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.802+0000 7fbefa18c640 1 --2- 172.21.15.134:0/3943756313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40acb20 0x7fbef4146e90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbee4009790 tx=0x7fbee402b8a0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.802+0000 7fbefa18c640 1 -- 172.21.15.134:0/3943756313 shutdown_connections 2024-02-17T14:30:02.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.802+0000 7fbefa18c640 1 --2- 172.21.15.134:0/3943756313 >> v2:172.21.15.142:3300/0 conn(0x7fbef414f800 0x7fbef4151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.802+0000 7fbefa18c640 1 --2- 172.21.15.134:0/3943756313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40acb20 0x7fbef4146e90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.802+0000 7fbefa18c640 1 -- 172.21.15.134:0/3943756313 >> 172.21.15.134:0/3943756313 conn(0x7fbef40ba420 msgr2=0x7fbef40ba830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:02.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.803+0000 7fbefa18c640 1 -- 172.21.15.134:0/3943756313 shutdown_connections 2024-02-17T14:30:02.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.803+0000 7fbefa18c640 1 -- 172.21.15.134:0/3943756313 wait complete. 2024-02-17T14:30:02.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.803+0000 7fbefa18c640 1 Processor -- start 2024-02-17T14:30:02.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.804+0000 7fbefa18c640 1 -- start start 2024-02-17T14:30:02.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.804+0000 7fbefa18c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbef40acb20 0x7fbef4149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.804+0000 7fbefa18c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40ada50 0x7fbef406c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.804+0000 7fbefa18c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbef414f800 0x7fbef406c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.804+0000 7fbefa18c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef414a1b0 con 0x7fbef414f800 2024-02-17T14:30:02.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.804+0000 7fbefa18c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef414a6e0 con 0x7fbef40acb20 2024-02-17T14:30:02.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.804+0000 7fbefa18c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef414ad40 con 0x7fbef40ada50 2024-02-17T14:30:02.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.804+0000 7fbef3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbef414f800 0x7fbef406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.804+0000 7fbef3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbef414f800 0x7fbef406c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43026/0 (socket says 172.21.15.134:43026) 2024-02-17T14:30:02.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.804+0000 7fbef3fff640 1 -- 172.21.15.134:0/1959157033 learned_addr learned my addr 172.21.15.134:0/1959157033 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:02.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.804+0000 7fbeeaffd640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40ada50 0x7fbef406c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.804+0000 7fbef37fe640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbef40acb20 0x7fbef4149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.805+0000 7fbef3fff640 1 -- 172.21.15.134:0/1959157033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40ada50 msgr2=0x7fbef406c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.805+0000 7fbef3fff640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40ada50 0x7fbef406c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.805+0000 7fbef3fff640 1 -- 172.21.15.134:0/1959157033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbef40acb20 msgr2=0x7fbef4149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.805+0000 7fbef3fff640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbef40acb20 0x7fbef4149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.805+0000 7fbef3fff640 1 -- 172.21.15.134:0/1959157033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee40093a0 con 0x7fbef414f800 2024-02-17T14:30:02.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.805+0000 7fbef3fff640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbef414f800 0x7fbef406c590 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00efc0 tx=0x7fbeec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.805+0000 7fbef0ff9640 1 -- 172.21.15.134:0/1959157033 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec009b20 con 0x7fbef414f800 2024-02-17T14:30:02.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.805+0000 7fbef0ff9640 1 -- 172.21.15.134:0/1959157033 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec00f040 con 0x7fbef414f800 2024-02-17T14:30:02.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.805+0000 7fbef0ff9640 1 -- 172.21.15.134:0/1959157033 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0146c0 con 0x7fbef414f800 2024-02-17T14:30:02.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.805+0000 7fbefa18c640 1 -- 172.21.15.134:0/1959157033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef40b5800 con 0x7fbef414f800 2024-02-17T14:30:02.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.805+0000 7fbefa18c640 1 -- 172.21.15.134:0/1959157033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef4141cb0 con 0x7fbef414f800 2024-02-17T14:30:02.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.806+0000 7fbefa18c640 1 -- 172.21.15.134:0/1959157033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef4068280 con 0x7fbef414f800 2024-02-17T14:30:02.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.806+0000 7fbef0ff9640 1 -- 172.21.15.134:0/1959157033 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbeec014820 con 0x7fbef414f800 2024-02-17T14:30:02.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.807+0000 7fbef0ff9640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbed406b810 0x7fbed406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:02.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.807+0000 7fbef37fe640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbed406b810 0x7fbed406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:02.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.807+0000 7fbef0ff9640 1 -- 172.21.15.134:0/1959157033 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbeec08b160 con 0x7fbef414f800 2024-02-17T14:30:02.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.807+0000 7fbef37fe640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbed406b810 0x7fbed406dcd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbee4036000 tx=0x7fbee403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:02.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.811+0000 7fbef0ff9640 1 -- 172.21.15.134:0/1959157033 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbeec0558c0 con 0x7fbef414f800 2024-02-17T14:30:02.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.985+0000 7fbefa18c640 1 -- 172.21.15.134:0/1959157033 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbef40b62c0 con 0x7fbed406b810 2024-02-17T14:30:02.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.985+0000 7fbef0ff9640 1 -- 172.21.15.134:0/1959157033 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbee4031bd0 con 0x7fbed406b810 2024-02-17T14:30:02.985 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 3 to deep-scrub 2024-02-17T14:30:02.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.988+0000 7fbefa18c640 1 -- 172.21.15.134:0/1959157033 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbed406b810 msgr2=0x7fbed406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.988+0000 7fbefa18c640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbed406b810 0x7fbed406dcd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbee4036000 tx=0x7fbee403c040 comp rx=0 tx=0).stop 2024-02-17T14:30:02.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.988+0000 7fbefa18c640 1 -- 172.21.15.134:0/1959157033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbef414f800 msgr2=0x7fbef406c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:02.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.988+0000 7fbefa18c640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbef414f800 0x7fbef406c590 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00efc0 tx=0x7fbeec00c490 comp rx=0 tx=0).stop 2024-02-17T14:30:02.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.988+0000 7fbefa18c640 1 -- 172.21.15.134:0/1959157033 shutdown_connections 2024-02-17T14:30:02.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.988+0000 7fbefa18c640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbed406b810 0x7fbed406dcd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.988+0000 7fbefa18c640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbef414f800 0x7fbef406c590 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.988+0000 7fbefa18c640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40ada50 0x7fbef406c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.988+0000 7fbefa18c640 1 --2- 172.21.15.134:0/1959157033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbef40acb20 0x7fbef4149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:02.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.988+0000 7fbefa18c640 1 -- 172.21.15.134:0/1959157033 >> 172.21.15.134:0/1959157033 conn(0x7fbef40ba420 msgr2=0x7fbef413f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:02.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.988+0000 7fbefa18c640 1 -- 172.21.15.134:0/1959157033 shutdown_connections 2024-02-17T14:30:02.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:02.988+0000 7fbefa18c640 1 -- 172.21.15.134:0/1959157033 wait complete. 2024-02-17T14:30:02.999 INFO:tasks.ceph:Scrubbing osd.4 2024-02-17T14:30:02.999 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-02-17T14:30:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.105+0000 7fc8a5cc9640 1 Processor -- start 2024-02-17T14:30:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.105+0000 7fc8a5cc9640 1 -- start start 2024-02-17T14:30:03.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.106+0000 7fc8a5cc9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc8a00b7e70 0x7fc8a0147180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.106+0000 7fc8a5cc9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a01476c0 0x7fc8a0151840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.106+0000 7fc8a5cc9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a00b7760 con 0x7fc8a006b250 2024-02-17T14:30:03.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.106+0000 7fc8a5cc9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a006c430 con 0x7fc8a00b7e70 2024-02-17T14:30:03.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.106+0000 7fc8a5cc9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a009b6e0 con 0x7fc8a01476c0 2024-02-17T14:30:03.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.106+0000 7fc89effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc8a00b7e70 0x7fc8a0147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.106+0000 7fc89effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc8a00b7e70 0x7fc8a0147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43038/0 (socket says 172.21.15.134:43038) 2024-02-17T14:30:03.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.106+0000 7fc89effd640 1 -- 172.21.15.134:0/820004062 learned_addr learned my addr 172.21.15.134:0/820004062 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:03.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.106+0000 7fc89ffff640 1 --2- 172.21.15.134:0/820004062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a01476c0 0x7fc8a0151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.106+0000 7fc89effd640 1 -- 172.21.15.134:0/820004062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a01476c0 msgr2=0x7fc8a0151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:03.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.106+0000 7fc89effd640 1 --2- 172.21.15.134:0/820004062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a01476c0 0x7fc8a0151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.106+0000 7fc89effd640 1 -- 172.21.15.134:0/820004062 >> v1:172.21.15.142:6789/0 conn(0x7fc8a006b250 legacy=0x7fc8a009afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.106+0000 7fc89effd640 1 -- 172.21.15.134:0/820004062 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a0147b20 con 0x7fc8a00b7e70 2024-02-17T14:30:03.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.107+0000 7fc89effd640 1 --2- 172.21.15.134:0/820004062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a00b7e70 0x7fc8a0147180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc894009870 tx=0x7fc89402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b503bcf43cc8830b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.107+0000 7fc89e7fc640 1 -- 172.21.15.134:0/820004062 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8940317c0 con 0x7fc8a00b7e70 2024-02-17T14:30:03.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.107+0000 7fc89e7fc640 1 -- 172.21.15.134:0/820004062 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc894031920 con 0x7fc8a00b7e70 2024-02-17T14:30:03.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.107+0000 7fc89e7fc640 1 -- 172.21.15.134:0/820004062 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894031cb0 con 0x7fc8a00b7e70 2024-02-17T14:30:03.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.108+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/820004062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a00b7e70 msgr2=0x7fc8a0147180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.108+0000 7fc8a5cc9640 1 --2- 172.21.15.134:0/820004062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a00b7e70 0x7fc8a0147180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc894009870 tx=0x7fc89402b860 comp rx=0 tx=0).stop 2024-02-17T14:30:03.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.108+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/820004062 shutdown_connections 2024-02-17T14:30:03.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.108+0000 7fc8a5cc9640 1 --2- 172.21.15.134:0/820004062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a01476c0 0x7fc8a0151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.108+0000 7fc8a5cc9640 1 --2- 172.21.15.134:0/820004062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a00b7e70 0x7fc8a0147180 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.108+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/820004062 >> 172.21.15.134:0/820004062 conn(0x7fc8a00bc6b0 msgr2=0x7fc8a00bcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:03.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.108+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/820004062 shutdown_connections 2024-02-17T14:30:03.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.108+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/820004062 wait complete. 2024-02-17T14:30:03.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.109+0000 7fc8a5cc9640 1 Processor -- start 2024-02-17T14:30:03.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.109+0000 7fc8a5cc9640 1 -- start start 2024-02-17T14:30:03.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.109+0000 7fc8a5cc9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a006b250 0x7fc8a00b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc8a5cc9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a00b7e70 0x7fc8a0142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc8a5cc9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a01476c0 0x7fc8a01dc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc8a5cc9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00a0fc0 con 0x7fc8a01476c0 2024-02-17T14:30:03.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc8a5cc9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a01dce10 con 0x7fc8a006b250 2024-02-17T14:30:03.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc8a5cc9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00b51c0 con 0x7fc8a00b7e70 2024-02-17T14:30:03.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc89ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a01476c0 0x7fc8a01dc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc89ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a01476c0 0x7fc8a01dc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43054/0 (socket says 172.21.15.134:43054) 2024-02-17T14:30:03.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc89ffff640 1 -- 172.21.15.134:0/738874118 learned_addr learned my addr 172.21.15.134:0/738874118 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:03.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc89effd640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a00b7e70 0x7fc8a0142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc89f7fe640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a006b250 0x7fc8a00b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc89ffff640 1 -- 172.21.15.134:0/738874118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a00b7e70 msgr2=0x7fc8a0142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc89ffff640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8a00b7e70 0x7fc8a0142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc89ffff640 1 -- 172.21.15.134:0/738874118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a006b250 msgr2=0x7fc8a00b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc89ffff640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a006b250 0x7fc8a00b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc89ffff640 1 -- 172.21.15.134:0/738874118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8940094d0 con 0x7fc8a01476c0 2024-02-17T14:30:03.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc89ffff640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a01476c0 0x7fc8a01dc8d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc898007e40 tx=0x7fc89800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc887fff640 1 -- 172.21.15.134:0/738874118 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc898014620 con 0x7fc8a01476c0 2024-02-17T14:30:03.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc887fff640 1 -- 172.21.15.134:0/738874118 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89800ee90 con 0x7fc8a01476c0 2024-02-17T14:30:03.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/738874118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a00a11a0 con 0x7fc8a01476c0 2024-02-17T14:30:03.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc887fff640 1 -- 172.21.15.134:0/738874118 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980149e0 con 0x7fc8a01476c0 2024-02-17T14:30:03.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.110+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/738874118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a00a0440 con 0x7fc8a01476c0 2024-02-17T14:30:03.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.111+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/738874118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8a00b73f0 con 0x7fc8a01476c0 2024-02-17T14:30:03.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.112+0000 7fc887fff640 1 -- 172.21.15.134:0/738874118 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fc898014b40 con 0x7fc8a01476c0 2024-02-17T14:30:03.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.112+0000 7fc887fff640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc88c06b840 0x7fc88c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.112+0000 7fc887fff640 1 -- 172.21.15.134:0/738874118 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc89808ad70 con 0x7fc8a01476c0 2024-02-17T14:30:03.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.112+0000 7fc89f7fe640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc88c06b840 0x7fc88c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.112+0000 7fc887fff640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] conn(0x7fc88c075260 0x7fc88c077700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.112+0000 7fc887fff640 1 -- 172.21.15.134:0/738874118 --> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc88c077dd0 con 0x7fc88c075260 2024-02-17T14:30:03.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.112+0000 7fc887fff640 1 -- 172.21.15.134:0/738874118 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc89808d430 con 0x7fc8a01476c0 2024-02-17T14:30:03.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.112+0000 7fc89effd640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] conn(0x7fc88c075260 0x7fc88c077700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.112+0000 7fc89f7fe640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc88c06b840 0x7fc88c06dd00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc8900016e0 tx=0x7fc890009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.113+0000 7fc89effd640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] conn(0x7fc88c075260 0x7fc88c077700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.114+0000 7fc887fff640 1 -- 172.21.15.134:0/738874118 <== osd.4 v2:172.21.15.142:6800/2415773380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc88c077dd0 con 0x7fc88c075260 2024-02-17T14:30:03.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.127+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/738874118 --> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc8a00b86a0 con 0x7fc88c075260 2024-02-17T14:30:03.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.127+0000 7fc887fff640 1 -- 172.21.15.134:0/738874118 <== osd.4 v2:172.21.15.142:6800/2415773380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc8940315c0 con 0x7fc88c075260 2024-02-17T14:30:03.127 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-17T14:30:03.127 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T14:30:03.128 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-17T14:30:03.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.127+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/738874118 >> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] conn(0x7fc88c075260 msgr2=0x7fc88c077700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.127+0000 7fc8a5cc9640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.142:6800/2415773380,v1:172.21.15.142:6801/2415773380] conn(0x7fc88c075260 0x7fc88c077700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.128+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/738874118 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc88c06b840 msgr2=0x7fc88c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.128+0000 7fc8a5cc9640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fc88c06b840 0x7fc88c06dd00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc8900016e0 tx=0x7fc890009040 comp rx=0 tx=0).stop 2024-02-17T14:30:03.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.128+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/738874118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a01476c0 msgr2=0x7fc8a01dc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.128+0000 7fc8a5cc9640 1 --2- 172.21.15.134:0/738874118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a01476c0 0x7fc8a01dc8d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc898007e40 tx=0x7fc89800e4b0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.128+0000 7fc89ffff640 1 -- 172.21.15.134:0/738874118 reap_dead start 2024-02-17T14:30:03.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.128+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/738874118 shutdown_connections 2024-02-17T14:30:03.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.128+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/738874118 >> 172.21.15.134:0/738874118 conn(0x7fc8a00bc6b0 msgr2=0x7fc8a0144380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:03.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.128+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/738874118 shutdown_connections 2024-02-17T14:30:03.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.128+0000 7fc8a5cc9640 1 -- 172.21.15.134:0/738874118 wait complete. 2024-02-17T14:30:03.138 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-02-17T14:30:03.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.238+0000 7f5ef1e2e640 1 Processor -- start 2024-02-17T14:30:03.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.239+0000 7f5ef1e2e640 1 -- start start 2024-02-17T14:30:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.239+0000 7f5ef1e2e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5eec1439d0 0x7f5eec14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.239+0000 7f5ef1e2e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eec0b0e10 con 0x7f5eec13d790 2024-02-17T14:30:03.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.239+0000 7f5ef1e2e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eec0b1c70 con 0x7f5eec0b36f0 2024-02-17T14:30:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.239+0000 7f5ef1e2e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec06f830 con 0x7f5eec1439d0 2024-02-17T14:30:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.239+0000 7f5ee2ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5eec13d790 0x7f5eec1432c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:52958/0 (socket says 172.21.15.134:52958) 2024-02-17T14:30:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.239+0000 7f5ee2ffd640 1 -- 172.21.15.134:0/3562313788 learned_addr learned my addr 172.21.15.134:0/3562313788 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.239+0000 7f5eebfff640 1 --2- 172.21.15.134:0/3562313788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5eec1439d0 0x7f5eec14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.240+0000 7f5eeaffd640 1 -- 172.21.15.134:0/3562313788 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946589299 0 0) 0x7f5eec0b0e10 con 0x7f5eec13d790 2024-02-17T14:30:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.240+0000 7f5eeaffd640 1 -- 172.21.15.134:0/3562313788 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed8003520 con 0x7f5eec13d790 2024-02-17T14:30:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.240+0000 7f5eeaffd640 1 -- 172.21.15.134:0/3562313788 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819434187 0 0) 0x7f5eec0b1c70 con 0x7f5eec0b36f0 2024-02-17T14:30:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.240+0000 7f5eeaffd640 1 -- 172.21.15.134:0/3562313788 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eec0b0e10 con 0x7f5eec0b36f0 2024-02-17T14:30:03.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.240+0000 7f5eebfff640 1 -- 172.21.15.134:0/3562313788 >> v1:172.21.15.142:6789/0 conn(0x7f5eec0b36f0 legacy=0x7f5eec13d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.240+0000 7f5eebfff640 1 -- 172.21.15.134:0/3562313788 >> v1:172.21.15.134:6789/0 conn(0x7f5eec13d790 legacy=0x7f5eec1432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.240+0000 7f5eebfff640 1 -- 172.21.15.134:0/3562313788 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec0b3ad0 con 0x7f5eec1439d0 2024-02-17T14:30:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.241+0000 7f5eebfff640 1 --2- 172.21.15.134:0/3562313788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5eec1439d0 0x7f5eec14ec50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400aed0 tx=0x7f5ee402cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f98157244efeb01e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.241+0000 7f5eeaffd640 1 -- 172.21.15.134:0/3562313788 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee402dab0 con 0x7f5eec1439d0 2024-02-17T14:30:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.241+0000 7f5eeaffd640 1 -- 172.21.15.134:0/3562313788 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee402dc10 con 0x7f5eec1439d0 2024-02-17T14:30:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.241+0000 7f5eeaffd640 1 -- 172.21.15.134:0/3562313788 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400a2e0 con 0x7f5eec1439d0 2024-02-17T14:30:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.241+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/3562313788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5eec1439d0 msgr2=0x7f5eec14ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.241+0000 7f5ef1e2e640 1 --2- 172.21.15.134:0/3562313788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5eec1439d0 0x7f5eec14ec50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400aed0 tx=0x7f5ee402cf10 comp rx=0 tx=0).stop 2024-02-17T14:30:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.241+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/3562313788 shutdown_connections 2024-02-17T14:30:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.241+0000 7f5ef1e2e640 1 --2- 172.21.15.134:0/3562313788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5eec1439d0 0x7f5eec14ec50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.241+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/3562313788 >> 172.21.15.134:0/3562313788 conn(0x7f5eec0b8270 msgr2=0x7f5eec0b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.241+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/3562313788 shutdown_connections 2024-02-17T14:30:03.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.241+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/3562313788 wait complete. 2024-02-17T14:30:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.242+0000 7f5ef1e2e640 1 Processor -- start 2024-02-17T14:30:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.243+0000 7f5ef1e2e640 1 -- start start 2024-02-17T14:30:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.243+0000 7f5ef1e2e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5eec0b36f0 0x7f5eec1446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.243+0000 7f5ef1e2e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5eec13d790 0x7f5eec13feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.243+0000 7f5ef1e2e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eec1439d0 0x7f5eec145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.243+0000 7f5ef1e2e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec144e10 con 0x7f5eec1439d0 2024-02-17T14:30:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.243+0000 7f5ef1e2e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec146380 con 0x7f5eec13d790 2024-02-17T14:30:03.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.243+0000 7f5ef1e2e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec146660 con 0x7f5eec0b36f0 2024-02-17T14:30:03.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.243+0000 7f5eebfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eec1439d0 0x7f5eec145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.243+0000 7f5eebfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eec1439d0 0x7f5eec145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43064/0 (socket says 172.21.15.134:43064) 2024-02-17T14:30:03.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.243+0000 7f5eebfff640 1 -- 172.21.15.134:0/2689319631 learned_addr learned my addr 172.21.15.134:0/2689319631 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:03.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.243+0000 7f5ee2ffd640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5eec13d790 0x7f5eec13feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.243+0000 7f5eeb7fe640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5eec0b36f0 0x7f5eec1446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.244+0000 7f5eebfff640 1 -- 172.21.15.134:0/2689319631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5eec0b36f0 msgr2=0x7f5eec1446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.244+0000 7f5eebfff640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5eec0b36f0 0x7f5eec1446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.244+0000 7f5eebfff640 1 -- 172.21.15.134:0/2689319631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5eec13d790 msgr2=0x7f5eec13feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.244+0000 7f5eebfff640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5eec13d790 0x7f5eec13feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.244+0000 7f5eebfff640 1 -- 172.21.15.134:0/2689319631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee400ab80 con 0x7f5eec1439d0 2024-02-17T14:30:03.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.244+0000 7f5ee2ffd640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5eec13d790 0x7f5eec13feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:30:03.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.244+0000 7f5eebfff640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eec1439d0 0x7f5eec145950 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5ee402caf0 tx=0x7f5ee4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.244+0000 7f5ee8ff9640 1 -- 172.21.15.134:0/2689319631 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400a560 con 0x7f5eec1439d0 2024-02-17T14:30:03.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.244+0000 7f5ee8ff9640 1 -- 172.21.15.134:0/2689319631 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee4003e10 con 0x7f5eec1439d0 2024-02-17T14:30:03.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.244+0000 7f5ee8ff9640 1 -- 172.21.15.134:0/2689319631 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4004470 con 0x7f5eec1439d0 2024-02-17T14:30:03.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.244+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/2689319631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eec146c00 con 0x7f5eec1439d0 2024-02-17T14:30:03.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.244+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/2689319631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eec1403f0 con 0x7f5eec1439d0 2024-02-17T14:30:03.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.245+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/2689319631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eec147120 con 0x7f5eec1439d0 2024-02-17T14:30:03.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.245+0000 7f5ee8ff9640 1 -- 172.21.15.134:0/2689319631 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f5ee40045d0 con 0x7f5eec1439d0 2024-02-17T14:30:03.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.246+0000 7f5ee8ff9640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f5ecc06b810 0x7f5ecc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.246+0000 7f5ee8ff9640 1 -- 172.21.15.134:0/2689319631 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5ee40adf00 con 0x7f5eec1439d0 2024-02-17T14:30:03.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.246+0000 7f5eeb7fe640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f5ecc06b810 0x7f5ecc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.246+0000 7f5eeb7fe640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f5ecc06b810 0x7f5ecc06dcd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5edc007fd0 tx=0x7f5edc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.250+0000 7f5ee8ff9640 1 -- 172.21.15.134:0/2689319631 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5eec147120 con 0x7f5eec1439d0 2024-02-17T14:30:03.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.419+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/2689319631 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5eec0b12f0 con 0x7f5ecc06b810 2024-02-17T14:30:03.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.420+0000 7f5ee8ff9640 1 -- 172.21.15.134:0/2689319631 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5edc00f850 con 0x7f5ecc06b810 2024-02-17T14:30:03.420 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 4 to deep-scrub 2024-02-17T14:30:03.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.421+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/2689319631 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f5ecc06b810 msgr2=0x7f5ecc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.421+0000 7f5ef1e2e640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f5ecc06b810 0x7f5ecc06dcd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5edc007fd0 tx=0x7f5edc009040 comp rx=0 tx=0).stop 2024-02-17T14:30:03.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.421+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/2689319631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eec1439d0 msgr2=0x7f5eec145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.421+0000 7f5ef1e2e640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eec1439d0 0x7f5eec145950 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5ee402caf0 tx=0x7f5ee4004a40 comp rx=0 tx=0).stop 2024-02-17T14:30:03.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.422+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/2689319631 shutdown_connections 2024-02-17T14:30:03.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.422+0000 7f5ef1e2e640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f5ecc06b810 0x7f5ecc06dcd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.422+0000 7f5ef1e2e640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5eec1439d0 0x7f5eec145950 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.422+0000 7f5ef1e2e640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5eec13d790 0x7f5eec13feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.422+0000 7f5ef1e2e640 1 --2- 172.21.15.134:0/2689319631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5eec0b36f0 0x7f5eec1446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.422+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/2689319631 >> 172.21.15.134:0/2689319631 conn(0x7f5eec0b8270 msgr2=0x7f5eec13cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:03.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.422+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/2689319631 shutdown_connections 2024-02-17T14:30:03.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.422+0000 7f5ef1e2e640 1 -- 172.21.15.134:0/2689319631 wait complete. 2024-02-17T14:30:03.432 INFO:tasks.ceph:Scrubbing osd.5 2024-02-17T14:30:03.433 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-02-17T14:30:03.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.538+0000 7f3601e6f640 1 Processor -- start 2024-02-17T14:30:03.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.538+0000 7f3601e6f640 1 -- start start 2024-02-17T14:30:03.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.538+0000 7f3601e6f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06e570 0x7f35fc0b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.539+0000 7f3601e6f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f35fc0b6350 0x7f35fc13eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.539+0000 7f3601e6f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc09d010 con 0x7f35fc072dc0 2024-02-17T14:30:03.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.539+0000 7f3601e6f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc0b57a0 con 0x7f35fc0b6350 2024-02-17T14:30:03.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.539+0000 7f3601e6f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc06f220 con 0x7f35fc06e570 2024-02-17T14:30:03.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.539+0000 7f35f2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f35fc0b6350 0x7f35fc13eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.539+0000 7f35f2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f35fc0b6350 0x7f35fc13eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38752/0 (socket says 172.21.15.134:38752) 2024-02-17T14:30:03.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.539+0000 7f35f2ffd640 1 -- 172.21.15.134:0/3785936606 learned_addr learned my addr 172.21.15.134:0/3785936606 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:03.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.539+0000 7f35fb7fe640 1 --2- 172.21.15.134:0/3785936606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06e570 0x7f35fc0b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.539+0000 7f35f2ffd640 1 -- 172.21.15.134:0/3785936606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06e570 msgr2=0x7f35fc0b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:03.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.539+0000 7f35f2ffd640 1 --2- 172.21.15.134:0/3785936606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06e570 0x7f35fc0b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.539+0000 7f35f2ffd640 1 -- 172.21.15.134:0/3785936606 >> v1:172.21.15.142:6789/0 conn(0x7f35fc072dc0 legacy=0x7f35fc148190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.539+0000 7f35f2ffd640 1 -- 172.21.15.134:0/3785936606 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc06e950 con 0x7f35fc0b6350 2024-02-17T14:30:03.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.539+0000 7f35fb7fe640 1 --2- 172.21.15.134:0/3785936606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06e570 0x7f35fc0b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:30:03.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.540+0000 7f35f2ffd640 1 --2- 172.21.15.134:0/3785936606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0b6350 0x7f35fc13eac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009870 tx=0x7f35e402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1de2f1f5c945b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.540+0000 7f35faffd640 1 -- 172.21.15.134:0/3785936606 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4031640 con 0x7f35fc0b6350 2024-02-17T14:30:03.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.540+0000 7f35faffd640 1 -- 172.21.15.134:0/3785936606 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e40317a0 con 0x7f35fc0b6350 2024-02-17T14:30:03.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.540+0000 7f35faffd640 1 -- 172.21.15.134:0/3785936606 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4031b30 con 0x7f35fc0b6350 2024-02-17T14:30:03.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.540+0000 7f3601e6f640 1 -- 172.21.15.134:0/3785936606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0b6350 msgr2=0x7f35fc13eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.540+0000 7f3601e6f640 1 --2- 172.21.15.134:0/3785936606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0b6350 0x7f35fc13eac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009870 tx=0x7f35e402b8f0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.540+0000 7f3601e6f640 1 -- 172.21.15.134:0/3785936606 shutdown_connections 2024-02-17T14:30:03.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.540+0000 7f3601e6f640 1 --2- 172.21.15.134:0/3785936606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0b6350 0x7f35fc13eac0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.540+0000 7f3601e6f640 1 --2- 172.21.15.134:0/3785936606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06e570 0x7f35fc0b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.540+0000 7f3601e6f640 1 -- 172.21.15.134:0/3785936606 >> 172.21.15.134:0/3785936606 conn(0x7f35fc099a30 msgr2=0x7f35fc09c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:03.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.541+0000 7f3601e6f640 1 -- 172.21.15.134:0/3785936606 shutdown_connections 2024-02-17T14:30:03.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.541+0000 7f3601e6f640 1 -- 172.21.15.134:0/3785936606 wait complete. 2024-02-17T14:30:03.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.541+0000 7f3601e6f640 1 Processor -- start 2024-02-17T14:30:03.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.542+0000 7f3601e6f640 1 -- start start 2024-02-17T14:30:03.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.542+0000 7f3601e6f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06e570 0x7f35fc147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.542+0000 7f3601e6f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc072dc0 0x7f35fc0b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.542+0000 7f3601e6f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0b6350 0x7f35fc0b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.542+0000 7f3601e6f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc13fea0 con 0x7f35fc0b6350 2024-02-17T14:30:03.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.542+0000 7f3601e6f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0baf10 con 0x7f35fc072dc0 2024-02-17T14:30:03.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.542+0000 7f3601e6f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc140180 con 0x7f35fc06e570 2024-02-17T14:30:03.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.542+0000 7f35fbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0b6350 0x7f35fc0b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.542+0000 7f35fbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0b6350 0x7f35fc0b9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38768/0 (socket says 172.21.15.134:38768) 2024-02-17T14:30:03.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.542+0000 7f35fbfff640 1 -- 172.21.15.134:0/266617388 learned_addr learned my addr 172.21.15.134:0/266617388 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:03.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.542+0000 7f35fb7fe640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06e570 0x7f35fc147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.543+0000 7f35f2ffd640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc072dc0 0x7f35fc0b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.543+0000 7f35fbfff640 1 -- 172.21.15.134:0/266617388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06e570 msgr2=0x7f35fc147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.543+0000 7f35fbfff640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06e570 0x7f35fc147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.543+0000 7f35fbfff640 1 -- 172.21.15.134:0/266617388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc072dc0 msgr2=0x7f35fc0b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.543+0000 7f35fbfff640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc072dc0 0x7f35fc0b9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.543+0000 7f35fbfff640 1 -- 172.21.15.134:0/266617388 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e40094d0 con 0x7f35fc0b6350 2024-02-17T14:30:03.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.543+0000 7f35fbfff640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0b6350 0x7f35fc0b9f50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c730 tx=0x7f35f400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.543+0000 7f35f8ff9640 1 -- 172.21.15.134:0/266617388 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4003b70 con 0x7f35fc0b6350 2024-02-17T14:30:03.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.543+0000 7f35f8ff9640 1 -- 172.21.15.134:0/266617388 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4003cd0 con 0x7f35fc0b6350 2024-02-17T14:30:03.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.543+0000 7f35f8ff9640 1 -- 172.21.15.134:0/266617388 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f400aa90 con 0x7f35fc0b6350 2024-02-17T14:30:03.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.543+0000 7f3601e6f640 1 -- 172.21.15.134:0/266617388 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc06f880 con 0x7f35fc0b6350 2024-02-17T14:30:03.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.543+0000 7f3601e6f640 1 -- 172.21.15.134:0/266617388 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc148960 con 0x7f35fc0b6350 2024-02-17T14:30:03.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.544+0000 7f3601e6f640 1 -- 172.21.15.134:0/266617388 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35fc06f700 con 0x7f35fc0b6350 2024-02-17T14:30:03.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.544+0000 7f35f8ff9640 1 -- 172.21.15.134:0/266617388 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f35f400abf0 con 0x7f35fc0b6350 2024-02-17T14:30:03.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.545+0000 7f35f8ff9640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f35dc06b810 0x7f35dc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.545+0000 7f35f8ff9640 1 -- 172.21.15.134:0/266617388 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f35f408a370 con 0x7f35fc0b6350 2024-02-17T14:30:03.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.545+0000 7f35fb7fe640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f35dc06b810 0x7f35dc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.545+0000 7f35f8ff9640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] conn(0x7f35dc075220 0x7f35dc0776c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.545+0000 7f35f8ff9640 1 -- 172.21.15.134:0/266617388 --> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35dc077d90 con 0x7f35dc075220 2024-02-17T14:30:03.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.545+0000 7f35f8ff9640 1 -- 172.21.15.134:0/266617388 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35f408ca30 con 0x7f35fc0b6350 2024-02-17T14:30:03.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.545+0000 7f35f2ffd640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] conn(0x7f35dc075220 0x7f35dc0776c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.545+0000 7f35fb7fe640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f35dc06b810 0x7f35dc06dcd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f35fc13e000 tx=0x7f35ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.545+0000 7f35f2ffd640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] conn(0x7f35dc075220 0x7f35dc0776c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.546+0000 7f35f8ff9640 1 -- 172.21.15.134:0/266617388 <== osd.5 v2:172.21.15.142:6824/819337168 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f35dc077d90 con 0x7f35dc075220 2024-02-17T14:30:03.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.559+0000 7f3601e6f640 1 -- 172.21.15.134:0/266617388 --> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f35fc09c950 con 0x7f35dc075220 2024-02-17T14:30:03.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.559+0000 7f35f8ff9640 1 -- 172.21.15.134:0/266617388 <== osd.5 v2:172.21.15.142:6824/819337168 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f35e4031990 con 0x7f35dc075220 2024-02-17T14:30:03.560 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-17T14:30:03.560 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T14:30:03.560 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-17T14:30:03.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.560+0000 7f3601e6f640 1 -- 172.21.15.134:0/266617388 >> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] conn(0x7f35dc075220 msgr2=0x7f35dc0776c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.560+0000 7f3601e6f640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.142:6824/819337168,v1:172.21.15.142:6825/819337168] conn(0x7f35dc075220 0x7f35dc0776c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.560+0000 7f3601e6f640 1 -- 172.21.15.134:0/266617388 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f35dc06b810 msgr2=0x7f35dc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.560+0000 7f3601e6f640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f35dc06b810 0x7f35dc06dcd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f35fc13e000 tx=0x7f35ec008040 comp rx=0 tx=0).stop 2024-02-17T14:30:03.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.560+0000 7f3601e6f640 1 -- 172.21.15.134:0/266617388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0b6350 msgr2=0x7f35fc0b9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.560+0000 7f3601e6f640 1 --2- 172.21.15.134:0/266617388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35fc0b6350 0x7f35fc0b9f50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c730 tx=0x7f35f400cbf0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.560+0000 7f35fbfff640 1 -- 172.21.15.134:0/266617388 reap_dead start 2024-02-17T14:30:03.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.560+0000 7f3601e6f640 1 -- 172.21.15.134:0/266617388 shutdown_connections 2024-02-17T14:30:03.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.560+0000 7f3601e6f640 1 -- 172.21.15.134:0/266617388 >> 172.21.15.134:0/266617388 conn(0x7f35fc099a30 msgr2=0x7f35fc143e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:03.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.560+0000 7f3601e6f640 1 -- 172.21.15.134:0/266617388 shutdown_connections 2024-02-17T14:30:03.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.560+0000 7f3601e6f640 1 -- 172.21.15.134:0/266617388 wait complete. 2024-02-17T14:30:03.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-02-17T14:30:03.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.675+0000 7f063f6dd640 1 Processor -- start 2024-02-17T14:30:03.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.675+0000 7f063f6dd640 1 -- start start 2024-02-17T14:30:03.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063f6dd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f06380afe40 0x7f06381461a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063f6dd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06381466e0 0x7f0638146b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063f6dd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06380b57b0 con 0x7f063806ae10 2024-02-17T14:30:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063f6dd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06380703f0 con 0x7f06380afe40 2024-02-17T14:30:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063f6dd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0638147070 con 0x7f06381466e0 2024-02-17T14:30:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063cc78640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f06380afe40 0x7f06381461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063cc78640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f06380afe40 0x7f06381461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38770/0 (socket says 172.21.15.134:38770) 2024-02-17T14:30:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063cc78640 1 -- 172.21.15.134:0/1037209221 learned_addr learned my addr 172.21.15.134:0/1037209221 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:03.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063dc7a640 1 --2- 172.21.15.134:0/1037209221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06381466e0 0x7f0638146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063cc78640 1 -- 172.21.15.134:0/1037209221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06381466e0 msgr2=0x7f0638146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:03.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063cc78640 1 --2- 172.21.15.134:0/1037209221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06381466e0 0x7f0638146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063cc78640 1 -- 172.21.15.134:0/1037209221 >> v1:172.21.15.142:6789/0 conn(0x7f063806ae10 legacy=0x7f0638072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:03.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063cc78640 1 -- 172.21.15.134:0/1037209221 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063806b1f0 con 0x7f06380afe40 2024-02-17T14:30:03.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.676+0000 7f063dc7a640 1 --2- 172.21.15.134:0/1037209221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06381466e0 0x7f0638146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:30:03.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.677+0000 7f063cc78640 1 --2- 172.21.15.134:0/1037209221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06380afe40 0x7f06381461a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0628009870 tx=0x7f062802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb22190f2ac4c98 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.677+0000 7f062ffff640 1 -- 172.21.15.134:0/1037209221 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06280317c0 con 0x7f06380afe40 2024-02-17T14:30:03.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.677+0000 7f062ffff640 1 -- 172.21.15.134:0/1037209221 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0628031920 con 0x7f06380afe40 2024-02-17T14:30:03.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.677+0000 7f062ffff640 1 -- 172.21.15.134:0/1037209221 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628031cb0 con 0x7f06380afe40 2024-02-17T14:30:03.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.677+0000 7f063f6dd640 1 -- 172.21.15.134:0/1037209221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06380afe40 msgr2=0x7f06381461a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.677+0000 7f063f6dd640 1 --2- 172.21.15.134:0/1037209221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06380afe40 0x7f06381461a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0628009870 tx=0x7f062802b860 comp rx=0 tx=0).stop 2024-02-17T14:30:03.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.678+0000 7f063f6dd640 1 -- 172.21.15.134:0/1037209221 shutdown_connections 2024-02-17T14:30:03.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.678+0000 7f063f6dd640 1 --2- 172.21.15.134:0/1037209221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06381466e0 0x7f0638146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.678+0000 7f063f6dd640 1 --2- 172.21.15.134:0/1037209221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06380afe40 0x7f06381461a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.678+0000 7f063f6dd640 1 -- 172.21.15.134:0/1037209221 >> 172.21.15.134:0/1037209221 conn(0x7f06380b9310 msgr2=0x7f06380b9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:03.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.678+0000 7f063f6dd640 1 -- 172.21.15.134:0/1037209221 shutdown_connections 2024-02-17T14:30:03.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.678+0000 7f063f6dd640 1 -- 172.21.15.134:0/1037209221 wait complete. 2024-02-17T14:30:03.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.679+0000 7f063f6dd640 1 Processor -- start 2024-02-17T14:30:03.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.679+0000 7f063f6dd640 1 -- start start 2024-02-17T14:30:03.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.679+0000 7f063f6dd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f063806ae10 0x7f0638142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.679+0000 7f063f6dd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06380afe40 0x7f06380ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.679+0000 7f063f6dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06381466e0 0x7f06381dfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.679+0000 7f063f6dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06381e0700 con 0x7f06381466e0 2024-02-17T14:30:03.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.679+0000 7f063f6dd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06380aea20 con 0x7f06380afe40 2024-02-17T14:30:03.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.679+0000 7f063f6dd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0638144dc0 con 0x7f063806ae10 2024-02-17T14:30:03.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.679+0000 7f063dc7a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06381466e0 0x7f06381dfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.679+0000 7f063dc7a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06381466e0 0x7f06381dfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38774/0 (socket says 172.21.15.134:38774) 2024-02-17T14:30:03.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.679+0000 7f063dc7a640 1 -- 172.21.15.134:0/2755832687 learned_addr learned my addr 172.21.15.134:0/2755832687 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:03.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.679+0000 7f063cc78640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06380afe40 0x7f06380ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.679+0000 7f063d479640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f063806ae10 0x7f0638142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.680+0000 7f063dc7a640 1 -- 172.21.15.134:0/2755832687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f063806ae10 msgr2=0x7f0638142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.680+0000 7f063dc7a640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f063806ae10 0x7f0638142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.680+0000 7f063dc7a640 1 -- 172.21.15.134:0/2755832687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06380afe40 msgr2=0x7f06380ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.680+0000 7f063dc7a640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06380afe40 0x7f06380ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.680+0000 7f063dc7a640 1 -- 172.21.15.134:0/2755832687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06280094d0 con 0x7f06381466e0 2024-02-17T14:30:03.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.680+0000 7f063dc7a640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06381466e0 0x7f06381dfac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f063000cd50 tx=0x7f063000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.680+0000 7f062dffb640 1 -- 172.21.15.134:0/2755832687 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063000f680 con 0x7f06381466e0 2024-02-17T14:30:03.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.680+0000 7f062dffb640 1 -- 172.21.15.134:0/2755832687 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063000f800 con 0x7f06381466e0 2024-02-17T14:30:03.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.680+0000 7f063f6dd640 1 -- 172.21.15.134:0/2755832687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06381e0390 con 0x7f06381466e0 2024-02-17T14:30:03.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.680+0000 7f062dffb640 1 -- 172.21.15.134:0/2755832687 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063000fbb0 con 0x7f06381466e0 2024-02-17T14:30:03.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.680+0000 7f063f6dd640 1 -- 172.21.15.134:0/2755832687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0638144320 con 0x7f06381466e0 2024-02-17T14:30:03.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.681+0000 7f063f6dd640 1 -- 172.21.15.134:0/2755832687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06381e01e0 con 0x7f06381466e0 2024-02-17T14:30:03.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.681+0000 7f062dffb640 1 -- 172.21.15.134:0/2755832687 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f063000b040 con 0x7f06381466e0 2024-02-17T14:30:03.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.682+0000 7f062dffb640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f061c06b840 0x7f061c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.682+0000 7f062dffb640 1 -- 172.21.15.134:0/2755832687 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f063008aec0 con 0x7f06381466e0 2024-02-17T14:30:03.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.682+0000 7f063d479640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f061c06b840 0x7f061c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.682+0000 7f063d479640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f061c06b840 0x7f061c06dd00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0634004ea0 tx=0x7f0634009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.686+0000 7f062dffb640 1 -- 172.21.15.134:0/2755832687 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0630055570 con 0x7f06381466e0 2024-02-17T14:30:03.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.858+0000 7f063f6dd640 1 -- 172.21.15.134:0/2755832687 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f06380722e0 con 0x7f061c06b840 2024-02-17T14:30:03.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.859+0000 7f062dffb640 1 -- 172.21.15.134:0/2755832687 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0634005420 con 0x7f061c06b840 2024-02-17T14:30:03.859 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 5 to deep-scrub 2024-02-17T14:30:03.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.861+0000 7f063f6dd640 1 -- 172.21.15.134:0/2755832687 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f061c06b840 msgr2=0x7f061c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.861+0000 7f063f6dd640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f061c06b840 0x7f061c06dd00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0634004ea0 tx=0x7f0634009040 comp rx=0 tx=0).stop 2024-02-17T14:30:03.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.861+0000 7f063f6dd640 1 -- 172.21.15.134:0/2755832687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06381466e0 msgr2=0x7f06381dfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.861+0000 7f063f6dd640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06381466e0 0x7f06381dfac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f063000cd50 tx=0x7f063000a650 comp rx=0 tx=0).stop 2024-02-17T14:30:03.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.861+0000 7f063f6dd640 1 -- 172.21.15.134:0/2755832687 shutdown_connections 2024-02-17T14:30:03.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.861+0000 7f063f6dd640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f061c06b840 0x7f061c06dd00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.861+0000 7f063f6dd640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06381466e0 0x7f06381dfac0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.861+0000 7f063f6dd640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06380afe40 0x7f06380ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.861+0000 7f063f6dd640 1 --2- 172.21.15.134:0/2755832687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f063806ae10 0x7f0638142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.861+0000 7f063f6dd640 1 -- 172.21.15.134:0/2755832687 >> 172.21.15.134:0/2755832687 conn(0x7f06380b9310 msgr2=0x7f06380b96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:03.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.861+0000 7f063f6dd640 1 -- 172.21.15.134:0/2755832687 shutdown_connections 2024-02-17T14:30:03.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.861+0000 7f063f6dd640 1 -- 172.21.15.134:0/2755832687 wait complete. 2024-02-17T14:30:03.872 INFO:tasks.ceph:Scrubbing osd.6 2024-02-17T14:30:03.872 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-02-17T14:30:03.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.976+0000 7f9bc060e640 1 Processor -- start 2024-02-17T14:30:03.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.976+0000 7f9bc060e640 1 -- start start 2024-02-17T14:30:03.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.977+0000 7f9bc060e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9bb8071c50 0x7f9bb80b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.977+0000 7f9bc060e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9bb806de40 0x7f9bb80b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.977+0000 7f9bc060e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb8072030 con 0x7f9bb80afb70 2024-02-17T14:30:03.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.977+0000 7f9bc060e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb806d4b0 con 0x7f9bb806de40 2024-02-17T14:30:03.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.977+0000 7f9bc060e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb806d1d0 con 0x7f9bb8071c50 2024-02-17T14:30:03.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.977+0000 7f9bbdba9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9bb806de40 0x7f9bb80b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.977+0000 7f9bbdba9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9bb806de40 0x7f9bb80b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38784/0 (socket says 172.21.15.134:38784) 2024-02-17T14:30:03.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.977+0000 7f9bbdba9640 1 -- 172.21.15.134:0/4212866341 learned_addr learned my addr 172.21.15.134:0/4212866341 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:03.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.977+0000 7f9bbe3aa640 1 --2- 172.21.15.134:0/4212866341 >> v2:172.21.15.142:3300/0 conn(0x7f9bb8071c50 0x7f9bb80b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.977+0000 7f9bbdba9640 1 -- 172.21.15.134:0/4212866341 >> v2:172.21.15.142:3300/0 conn(0x7f9bb8071c50 msgr2=0x7f9bb80b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:03.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.977+0000 7f9bbdba9640 1 --2- 172.21.15.134:0/4212866341 >> v2:172.21.15.142:3300/0 conn(0x7f9bb8071c50 0x7f9bb80b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.977+0000 7f9bbdba9640 1 -- 172.21.15.134:0/4212866341 >> v1:172.21.15.142:6789/0 conn(0x7f9bb80afb70 legacy=0x7f9bb813e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.977+0000 7f9bbdba9640 1 -- 172.21.15.134:0/4212866341 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb806ca50 con 0x7f9bb806de40 2024-02-17T14:30:03.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.978+0000 7f9bbdba9640 1 --2- 172.21.15.134:0/4212866341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bb806de40 0x7f9bb80b19b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9bb806b8f0 tx=0x7f9ba802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db773ae1f39c1cef server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.978+0000 7f9bbd3a8640 1 -- 172.21.15.134:0/4212866341 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8031870 con 0x7f9bb806de40 2024-02-17T14:30:03.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.978+0000 7f9bbd3a8640 1 -- 172.21.15.134:0/4212866341 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba80319d0 con 0x7f9bb806de40 2024-02-17T14:30:03.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.978+0000 7f9bbd3a8640 1 -- 172.21.15.134:0/4212866341 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8031d60 con 0x7f9bb806de40 2024-02-17T14:30:03.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.979+0000 7f9bc060e640 1 -- 172.21.15.134:0/4212866341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bb806de40 msgr2=0x7f9bb80b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.979+0000 7f9bc060e640 1 --2- 172.21.15.134:0/4212866341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bb806de40 0x7f9bb80b19b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9bb806b8f0 tx=0x7f9ba802b910 comp rx=0 tx=0).stop 2024-02-17T14:30:03.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.979+0000 7f9bc060e640 1 -- 172.21.15.134:0/4212866341 shutdown_connections 2024-02-17T14:30:03.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.979+0000 7f9bc060e640 1 --2- 172.21.15.134:0/4212866341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bb806de40 0x7f9bb80b19b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.979+0000 7f9bc060e640 1 --2- 172.21.15.134:0/4212866341 >> v2:172.21.15.142:3300/0 conn(0x7f9bb8071c50 0x7f9bb80b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.979+0000 7f9bc060e640 1 -- 172.21.15.134:0/4212866341 >> 172.21.15.134:0/4212866341 conn(0x7f9bb806aba0 msgr2=0x7f9bb806af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:03.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.979+0000 7f9bc060e640 1 -- 172.21.15.134:0/4212866341 shutdown_connections 2024-02-17T14:30:03.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.979+0000 7f9bc060e640 1 -- 172.21.15.134:0/4212866341 wait complete. 2024-02-17T14:30:03.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.980+0000 7f9bc060e640 1 Processor -- start 2024-02-17T14:30:03.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.980+0000 7f9bc060e640 1 -- start start 2024-02-17T14:30:03.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.980+0000 7f9bc060e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bb8071c50 0x7f9bb80708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.980+0000 7f9bc060e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bb80afb70 0x7f9bb80aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.980+0000 7f9bc060e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bb80af020 0x7f9bb8137840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.980+0000 7f9bc060e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80af4d0 con 0x7f9bb8071c50 2024-02-17T14:30:03.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.980+0000 7f9bc060e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80adec0 con 0x7f9bb80afb70 2024-02-17T14:30:03.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.980+0000 7f9bc060e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80ac8b0 con 0x7f9bb80af020 2024-02-17T14:30:03.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.980+0000 7f9bbe3aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bb8071c50 0x7f9bb80708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.980+0000 7f9bbe3aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bb8071c50 0x7f9bb80708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38788/0 (socket says 172.21.15.134:38788) 2024-02-17T14:30:03.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.980+0000 7f9bbe3aa640 1 -- 172.21.15.134:0/1479830455 learned_addr learned my addr 172.21.15.134:0/1479830455 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:03.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9bbdba9640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bb80afb70 0x7f9bb80aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9bbe3aa640 1 -- 172.21.15.134:0/1479830455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bb80af020 msgr2=0x7f9bb8137840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9bbebab640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bb80af020 0x7f9bb8137840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9bbe3aa640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bb80af020 0x7f9bb8137840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9bbe3aa640 1 -- 172.21.15.134:0/1479830455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bb80afb70 msgr2=0x7f9bb80aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9bbe3aa640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bb80afb70 0x7f9bb80aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:03.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9bbe3aa640 1 -- 172.21.15.134:0/1479830455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba80094d0 con 0x7f9bb8071c50 2024-02-17T14:30:03.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9bbdba9640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bb80afb70 0x7f9bb80aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:30:03.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9bbebab640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bb80af020 0x7f9bb8137840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:30:03.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9bbe3aa640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bb8071c50 0x7f9bb80708f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400d800 tx=0x7f9bb400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9baeffd640 1 -- 172.21.15.134:0/1479830455 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400b6c0 con 0x7f9bb8071c50 2024-02-17T14:30:03.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9baeffd640 1 -- 172.21.15.134:0/1479830455 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb400b820 con 0x7f9bb8071c50 2024-02-17T14:30:03.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9bc060e640 1 -- 172.21.15.134:0/1479830455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb80acb90 con 0x7f9bb8071c50 2024-02-17T14:30:03.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9baeffd640 1 -- 172.21.15.134:0/1479830455 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400bbb0 con 0x7f9bb8071c50 2024-02-17T14:30:03.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.981+0000 7f9bc060e640 1 -- 172.21.15.134:0/1479830455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb80ad150 con 0x7f9bb8071c50 2024-02-17T14:30:03.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.982+0000 7f9bc060e640 1 -- 172.21.15.134:0/1479830455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9bb806e330 con 0x7f9bb8071c50 2024-02-17T14:30:03.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.983+0000 7f9baeffd640 1 -- 172.21.15.134:0/1479830455 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9bb400bd10 con 0x7f9bb8071c50 2024-02-17T14:30:03.994 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.983+0000 7f9baeffd640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f9b9c06b810 0x7f9b9c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.983+0000 7f9baeffd640 1 -- 172.21.15.134:0/1479830455 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9bb408ab60 con 0x7f9bb8071c50 2024-02-17T14:30:03.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.983+0000 7f9bbdba9640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f9b9c06b810 0x7f9b9c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.983+0000 7f9baeffd640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] conn(0x7f9b9c075220 0x7f9b9c0776c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:03.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.983+0000 7f9baeffd640 1 -- 172.21.15.134:0/1479830455 --> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b9c077d90 con 0x7f9b9c075220 2024-02-17T14:30:03.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.983+0000 7f9baeffd640 1 -- 172.21.15.134:0/1479830455 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bb408f240 con 0x7f9bb8071c50 2024-02-17T14:30:03.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.983+0000 7f9bbebab640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] conn(0x7f9b9c075220 0x7f9b9c0776c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:03.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.983+0000 7f9bbdba9640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f9b9c06b810 0x7f9b9c06dcd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8036000 tx=0x7f9ba803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.984+0000 7f9bbebab640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] conn(0x7f9b9c075220 0x7f9b9c0776c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:03.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.985+0000 7f9baeffd640 1 -- 172.21.15.134:0/1479830455 <== osd.6 v2:172.21.15.142:6816/756473126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9b9c077d90 con 0x7f9b9c075220 2024-02-17T14:30:03.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.997+0000 7f9bc060e640 1 -- 172.21.15.134:0/1479830455 --> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9bb80ad2e0 con 0x7f9b9c075220 2024-02-17T14:30:03.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.998+0000 7f9baeffd640 1 -- 172.21.15.134:0/1479830455 <== osd.6 v2:172.21.15.142:6816/756473126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9bb80ad2e0 con 0x7f9b9c075220 2024-02-17T14:30:03.998 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-17T14:30:03.998 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T14:30:03.998 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-17T14:30:03.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.998+0000 7f9bc060e640 1 -- 172.21.15.134:0/1479830455 >> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] conn(0x7f9b9c075220 msgr2=0x7f9b9c0776c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:03.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.998+0000 7f9bc060e640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.142:6816/756473126,v1:172.21.15.142:6817/756473126] conn(0x7f9b9c075220 0x7f9b9c0776c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.998+0000 7f9bc060e640 1 -- 172.21.15.134:0/1479830455 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f9b9c06b810 msgr2=0x7f9b9c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.998+0000 7f9bc060e640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f9b9c06b810 0x7f9b9c06dcd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8036000 tx=0x7f9ba803c040 comp rx=0 tx=0).stop 2024-02-17T14:30:04.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.998+0000 7f9bc060e640 1 -- 172.21.15.134:0/1479830455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bb8071c50 msgr2=0x7f9bb80708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.998+0000 7f9bc060e640 1 --2- 172.21.15.134:0/1479830455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bb8071c50 0x7f9bb80708f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400d800 tx=0x7f9bb400dcc0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.998+0000 7f9bbebab640 1 -- 172.21.15.134:0/1479830455 reap_dead start 2024-02-17T14:30:04.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.998+0000 7f9bc060e640 1 -- 172.21.15.134:0/1479830455 shutdown_connections 2024-02-17T14:30:04.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.998+0000 7f9bc060e640 1 -- 172.21.15.134:0/1479830455 >> 172.21.15.134:0/1479830455 conn(0x7f9bb806aba0 msgr2=0x7f9bb8142f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:04.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.998+0000 7f9bc060e640 1 -- 172.21.15.134:0/1479830455 shutdown_connections 2024-02-17T14:30:04.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:03.998+0000 7f9bc060e640 1 -- 172.21.15.134:0/1479830455 wait complete. 2024-02-17T14:30:04.009 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-02-17T14:30:04.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.111+0000 7f495c713640 1 Processor -- start 2024-02-17T14:30:04.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.112+0000 7f495c713640 1 -- start start 2024-02-17T14:30:04.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.112+0000 7f495c713640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f49540b1640 0x7f495413d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.112+0000 7f495c713640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49540b0ba0 0x7f495413da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.112+0000 7f495c713640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4954073040 con 0x7f49540b2e60 2024-02-17T14:30:04.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.112+0000 7f495c713640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49540b3240 con 0x7f49540b1640 2024-02-17T14:30:04.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.112+0000 7f495c713640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49540b1ad0 con 0x7f49540b0ba0 2024-02-17T14:30:04.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.112+0000 7f4959cae640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f49540b1640 0x7f495413d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.112+0000 7f495a4af640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f49540b2e60 0x7f49540b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47966/0 (socket says 172.21.15.134:47966) 2024-02-17T14:30:04.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.112+0000 7f495a4af640 1 -- 172.21.15.134:0/1145057194 learned_addr learned my addr 172.21.15.134:0/1145057194 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:04.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.113+0000 7f4959cae640 1 -- 172.21.15.134:0/1145057194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49540b0ba0 msgr2=0x7f495413da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:04.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.113+0000 7f495acb0640 1 --2- 172.21.15.134:0/1145057194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49540b0ba0 0x7f495413da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.113+0000 7f4959cae640 1 --2- 172.21.15.134:0/1145057194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49540b0ba0 0x7f495413da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.113+0000 7f4959cae640 1 -- 172.21.15.134:0/1145057194 >> v1:172.21.15.134:6789/0 conn(0x7f49540b2e60 legacy=0x7f49540b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.113+0000 7f49594ad640 1 -- 172.21.15.134:0/1145057194 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214981916 0 0) 0x7f4954073040 con 0x7f49540b2e60 2024-02-17T14:30:04.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.113+0000 7f4959cae640 1 -- 172.21.15.134:0/1145057194 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4954072b20 con 0x7f49540b1640 2024-02-17T14:30:04.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.113+0000 7f4959cae640 1 --2- 172.21.15.134:0/1145057194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49540b1640 0x7f495413d4d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f49480097d0 tx=0x7f494802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2e843a511c8a0c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:04.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.114+0000 7f49594ad640 1 -- 172.21.15.134:0/1145057194 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49480316f0 con 0x7f49540b1640 2024-02-17T14:30:04.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.114+0000 7f49594ad640 1 -- 172.21.15.134:0/1145057194 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4948031850 con 0x7f49540b1640 2024-02-17T14:30:04.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.114+0000 7f49594ad640 1 -- 172.21.15.134:0/1145057194 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948031be0 con 0x7f49540b1640 2024-02-17T14:30:04.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.114+0000 7f495c713640 1 -- 172.21.15.134:0/1145057194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49540b1640 msgr2=0x7f495413d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.114+0000 7f495c713640 1 --2- 172.21.15.134:0/1145057194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49540b1640 0x7f495413d4d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f49480097d0 tx=0x7f494802b790 comp rx=0 tx=0).stop 2024-02-17T14:30:04.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.114+0000 7f495c713640 1 -- 172.21.15.134:0/1145057194 shutdown_connections 2024-02-17T14:30:04.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.114+0000 7f495c713640 1 --2- 172.21.15.134:0/1145057194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49540b0ba0 0x7f495413da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.114+0000 7f495c713640 1 --2- 172.21.15.134:0/1145057194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49540b1640 0x7f495413d4d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.114+0000 7f495c713640 1 -- 172.21.15.134:0/1145057194 >> 172.21.15.134:0/1145057194 conn(0x7f49540b8270 msgr2=0x7f49540b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:04.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.114+0000 7f495c713640 1 -- 172.21.15.134:0/1145057194 shutdown_connections 2024-02-17T14:30:04.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.114+0000 7f495c713640 1 -- 172.21.15.134:0/1145057194 wait complete. 2024-02-17T14:30:04.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.115+0000 7f495c713640 1 Processor -- start 2024-02-17T14:30:04.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.115+0000 7f495c713640 1 -- start start 2024-02-17T14:30:04.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495c713640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49540b0ba0 0x7f4954138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495c713640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49540b2e60 0x7f49541dfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495c713640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4954139d90 0x7f49541e01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495c713640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49541371b0 con 0x7f49540b0ba0 2024-02-17T14:30:04.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495c713640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4954137fb0 con 0x7f4954139d90 2024-02-17T14:30:04.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495c713640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4954137680 con 0x7f49540b2e60 2024-02-17T14:30:04.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495a4af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49540b0ba0 0x7f4954138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495a4af640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49540b0ba0 0x7f4954138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38794/0 (socket says 172.21.15.134:38794) 2024-02-17T14:30:04.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495a4af640 1 -- 172.21.15.134:0/2536696762 learned_addr learned my addr 172.21.15.134:0/2536696762 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:04.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495acb0640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4954139d90 0x7f49541e01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f4959cae640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49540b2e60 0x7f49541dfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495a4af640 1 -- 172.21.15.134:0/2536696762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49540b2e60 msgr2=0x7f49541dfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495a4af640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49540b2e60 0x7f49541dfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495a4af640 1 -- 172.21.15.134:0/2536696762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4954139d90 msgr2=0x7f49541e01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495a4af640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4954139d90 0x7f49541e01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495a4af640 1 -- 172.21.15.134:0/2536696762 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4948009400 con 0x7f49540b0ba0 2024-02-17T14:30:04.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f495a4af640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49540b0ba0 0x7f4954138fd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f494c00c460 tx=0x7f494c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:04.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.116+0000 7f4952ffd640 1 -- 172.21.15.134:0/2536696762 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c0074e0 con 0x7f49540b0ba0 2024-02-17T14:30:04.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.117+0000 7f4952ffd640 1 -- 172.21.15.134:0/2536696762 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c007660 con 0x7f49540b0ba0 2024-02-17T14:30:04.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.117+0000 7f495c713640 1 -- 172.21.15.134:0/2536696762 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4954137960 con 0x7f49540b0ba0 2024-02-17T14:30:04.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.117+0000 7f4952ffd640 1 -- 172.21.15.134:0/2536696762 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c004a20 con 0x7f49540b0ba0 2024-02-17T14:30:04.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.117+0000 7f495c713640 1 -- 172.21.15.134:0/2536696762 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49540b3f50 con 0x7f49540b0ba0 2024-02-17T14:30:04.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.117+0000 7f495c713640 1 -- 172.21.15.134:0/2536696762 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4954067b70 con 0x7f49540b0ba0 2024-02-17T14:30:04.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.118+0000 7f4952ffd640 1 -- 172.21.15.134:0/2536696762 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f494c004b80 con 0x7f49540b0ba0 2024-02-17T14:30:04.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.118+0000 7f4952ffd640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f494006b810 0x7f494006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.118+0000 7f4952ffd640 1 -- 172.21.15.134:0/2536696762 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f494c089900 con 0x7f49540b0ba0 2024-02-17T14:30:04.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.118+0000 7f4959cae640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f494006b810 0x7f494006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.119+0000 7f4959cae640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f494006b810 0x7f494006dcd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4948036000 tx=0x7f4948008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:04.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.123+0000 7f4952ffd640 1 -- 172.21.15.134:0/2536696762 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f494c054060 con 0x7f49540b0ba0 2024-02-17T14:30:04.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.293+0000 7f495c713640 1 -- 172.21.15.134:0/2536696762 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f49540b4a30 con 0x7f494006b810 2024-02-17T14:30:04.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.293+0000 7f4952ffd640 1 -- 172.21.15.134:0/2536696762 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4948042070 con 0x7f494006b810 2024-02-17T14:30:04.293 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 6 to deep-scrub 2024-02-17T14:30:04.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.295+0000 7f495c713640 1 -- 172.21.15.134:0/2536696762 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f494006b810 msgr2=0x7f494006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.295+0000 7f495c713640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f494006b810 0x7f494006dcd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4948036000 tx=0x7f4948008030 comp rx=0 tx=0).stop 2024-02-17T14:30:04.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.295+0000 7f495c713640 1 -- 172.21.15.134:0/2536696762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49540b0ba0 msgr2=0x7f4954138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.295+0000 7f495c713640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49540b0ba0 0x7f4954138fd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f494c00c460 tx=0x7f494c00c920 comp rx=0 tx=0).stop 2024-02-17T14:30:04.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.295+0000 7f495c713640 1 -- 172.21.15.134:0/2536696762 shutdown_connections 2024-02-17T14:30:04.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.295+0000 7f495c713640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4954139d90 0x7f49541e01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.295+0000 7f495c713640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49540b2e60 0x7f49541dfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.295+0000 7f495c713640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f494006b810 0x7f494006dcd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.295+0000 7f495c713640 1 --2- 172.21.15.134:0/2536696762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49540b0ba0 0x7f4954138fd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.295+0000 7f495c713640 1 -- 172.21.15.134:0/2536696762 >> 172.21.15.134:0/2536696762 conn(0x7f49540b8270 msgr2=0x7f49540b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:04.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.295+0000 7f495c713640 1 -- 172.21.15.134:0/2536696762 shutdown_connections 2024-02-17T14:30:04.297 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.295+0000 7f495c713640 1 -- 172.21.15.134:0/2536696762 wait complete. 2024-02-17T14:30:04.306 INFO:tasks.ceph:Scrubbing osd.7 2024-02-17T14:30:04.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-02-17T14:30:04.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.411+0000 7f41535b5640 1 Processor -- start 2024-02-17T14:30:04.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.411+0000 7f41535b5640 1 -- start start 2024-02-17T14:30:04.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.412+0000 7f41535b5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f414c0af720 0x7f414c141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.412+0000 7f41535b5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f414c142400 0x7f414c14f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.412+0000 7f41535b5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c0b10c0 con 0x7f414c06be20 2024-02-17T14:30:04.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.412+0000 7f41535b5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c0b8950 con 0x7f414c0af720 2024-02-17T14:30:04.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.412+0000 7f41535b5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c0725b0 con 0x7f414c142400 2024-02-17T14:30:04.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.412+0000 7f4151351640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f414c06be20 0x7f414c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47968/0 (socket says 172.21.15.134:47968) 2024-02-17T14:30:04.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.412+0000 7f4151351640 1 -- 172.21.15.134:0/1934567912 learned_addr learned my addr 172.21.15.134:0/1934567912 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:04.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.412+0000 7f4150b50640 1 --2- 172.21.15.134:0/1934567912 >> v2:172.21.15.134:3300/0 conn(0x7f414c0af720 0x7f414c141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.412+0000 7f4151b52640 1 --2- 172.21.15.134:0/1934567912 >> v2:172.21.15.142:3300/0 conn(0x7f414c142400 0x7f414c14f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.412+0000 7f4150b50640 1 -- 172.21.15.134:0/1934567912 >> v2:172.21.15.142:3300/0 conn(0x7f414c142400 msgr2=0x7f414c14f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:04.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.412+0000 7f4150b50640 1 --2- 172.21.15.134:0/1934567912 >> v2:172.21.15.142:3300/0 conn(0x7f414c142400 0x7f414c14f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.412+0000 7f4150b50640 1 -- 172.21.15.134:0/1934567912 >> v1:172.21.15.134:6789/0 conn(0x7f414c06be20 legacy=0x7f414c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.412+0000 7f4150b50640 1 -- 172.21.15.134:0/1934567912 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c06c200 con 0x7f414c0af720 2024-02-17T14:30:04.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.413+0000 7f4150b50640 1 --2- 172.21.15.134:0/1934567912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c0af720 0x7f414c141ec0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f414c0b09f0 tx=0x7f413c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab5421ef93c5d9a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:04.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.413+0000 7f4143fff640 1 -- 172.21.15.134:0/1934567912 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c031830 con 0x7f414c0af720 2024-02-17T14:30:04.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.413+0000 7f4143fff640 1 -- 172.21.15.134:0/1934567912 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c031990 con 0x7f414c0af720 2024-02-17T14:30:04.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.413+0000 7f4143fff640 1 -- 172.21.15.134:0/1934567912 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c031d20 con 0x7f414c0af720 2024-02-17T14:30:04.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.413+0000 7f41535b5640 1 -- 172.21.15.134:0/1934567912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c0af720 msgr2=0x7f414c141ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.413+0000 7f41535b5640 1 --2- 172.21.15.134:0/1934567912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c0af720 0x7f414c141ec0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f414c0b09f0 tx=0x7f413c02b8d0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.414+0000 7f41535b5640 1 -- 172.21.15.134:0/1934567912 shutdown_connections 2024-02-17T14:30:04.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.414+0000 7f41535b5640 1 --2- 172.21.15.134:0/1934567912 >> v2:172.21.15.142:3300/0 conn(0x7f414c142400 0x7f414c14f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.414+0000 7f41535b5640 1 --2- 172.21.15.134:0/1934567912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c0af720 0x7f414c141ec0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.414+0000 7f41535b5640 1 -- 172.21.15.134:0/1934567912 >> 172.21.15.134:0/1934567912 conn(0x7f414c0b5520 msgr2=0x7f414c0b5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:04.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.414+0000 7f41535b5640 1 -- 172.21.15.134:0/1934567912 shutdown_connections 2024-02-17T14:30:04.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.414+0000 7f41535b5640 1 -- 172.21.15.134:0/1934567912 wait complete. 2024-02-17T14:30:04.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.415+0000 7f41535b5640 1 Processor -- start 2024-02-17T14:30:04.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.415+0000 7f41535b5640 1 -- start start 2024-02-17T14:30:04.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.415+0000 7f41535b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414c06be20 0x7f414c148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.415+0000 7f41535b5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c142400 0x7f414c147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.415+0000 7f41535b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414c146700 0x7f414c146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.415+0000 7f41535b5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c144920 con 0x7f414c142400 2024-02-17T14:30:04.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.415+0000 7f41535b5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c1470a0 con 0x7f414c146700 2024-02-17T14:30:04.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.415+0000 7f41535b5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c1458b0 con 0x7f414c06be20 2024-02-17T14:30:04.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.415+0000 7f4150b50640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c142400 0x7f414c147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.415+0000 7f4150b50640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c142400 0x7f414c147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38814/0 (socket says 172.21.15.134:38814) 2024-02-17T14:30:04.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.415+0000 7f4150b50640 1 -- 172.21.15.134:0/355828236 learned_addr learned my addr 172.21.15.134:0/355828236 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:04.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.416+0000 7f4150b50640 1 -- 172.21.15.134:0/355828236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414c06be20 msgr2=0x7f414c148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.416+0000 7f4151351640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414c06be20 0x7f414c148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.416+0000 7f4151b52640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414c146700 0x7f414c146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.416+0000 7f4150b50640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414c06be20 0x7f414c148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.416+0000 7f4150b50640 1 -- 172.21.15.134:0/355828236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414c146700 msgr2=0x7f414c146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.416+0000 7f4150b50640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f414c146700 0x7f414c146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.416+0000 7f4150b50640 1 -- 172.21.15.134:0/355828236 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c009400 con 0x7f414c142400 2024-02-17T14:30:04.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.416+0000 7f4150b50640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c142400 0x7f414c147810 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f413c009890 tx=0x7f413c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:04.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.416+0000 7f4141ffb640 1 -- 172.21.15.134:0/355828236 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c03a6f0 con 0x7f414c142400 2024-02-17T14:30:04.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.416+0000 7f4141ffb640 1 -- 172.21.15.134:0/355828236 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c03a870 con 0x7f414c142400 2024-02-17T14:30:04.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.416+0000 7f41535b5640 1 -- 172.21.15.134:0/355828236 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c148040 con 0x7f414c142400 2024-02-17T14:30:04.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.416+0000 7f4141ffb640 1 -- 172.21.15.134:0/355828236 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c03ac20 con 0x7f414c142400 2024-02-17T14:30:04.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.416+0000 7f41535b5640 1 -- 172.21.15.134:0/355828236 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c1455d0 con 0x7f414c142400 2024-02-17T14:30:04.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.417+0000 7f41535b5640 1 -- 172.21.15.134:0/355828236 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f414c0b2960 con 0x7f414c142400 2024-02-17T14:30:04.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.417+0000 7f4141ffb640 1 -- 172.21.15.134:0/355828236 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f413c043410 con 0x7f414c142400 2024-02-17T14:30:04.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.418+0000 7f4141ffb640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f413006b810 0x7f413006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.418+0000 7f4141ffb640 1 -- 172.21.15.134:0/355828236 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f413c0ac380 con 0x7f414c142400 2024-02-17T14:30:04.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.418+0000 7f4151351640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f413006b810 0x7f413006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.418+0000 7f4141ffb640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] conn(0x7f4130075220 0x7f41300776c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.418+0000 7f4141ffb640 1 -- 172.21.15.134:0/355828236 --> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4130077d90 con 0x7f4130075220 2024-02-17T14:30:04.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.418+0000 7f4141ffb640 1 -- 172.21.15.134:0/355828236 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f413c0aea40 con 0x7f414c142400 2024-02-17T14:30:04.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.418+0000 7f4151351640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f413006b810 0x7f413006dcd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4148000f60 tx=0x7f4148009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:04.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.418+0000 7f4151b52640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] conn(0x7f4130075220 0x7f41300776c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.419+0000 7f4151b52640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] conn(0x7f4130075220 0x7f41300776c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:04.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.419+0000 7f4141ffb640 1 -- 172.21.15.134:0/355828236 <== osd.7 v2:172.21.15.142:6808/2672906066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4130077d90 con 0x7f4130075220 2024-02-17T14:30:04.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.432+0000 7f41535b5640 1 -- 172.21.15.134:0/355828236 --> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f414c0b8430 con 0x7f4130075220 2024-02-17T14:30:04.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.433+0000 7f4141ffb640 1 -- 172.21.15.134:0/355828236 <== osd.7 v2:172.21.15.142:6808/2672906066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4144003990 con 0x7f4130075220 2024-02-17T14:30:04.433 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-02-17T14:30:04.433 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T14:30:04.433 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-02-17T14:30:04.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.433+0000 7f41535b5640 1 -- 172.21.15.134:0/355828236 >> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] conn(0x7f4130075220 msgr2=0x7f41300776c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.433+0000 7f41535b5640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.142:6808/2672906066,v1:172.21.15.142:6809/2672906066] conn(0x7f4130075220 0x7f41300776c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.433+0000 7f41535b5640 1 -- 172.21.15.134:0/355828236 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f413006b810 msgr2=0x7f413006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.433+0000 7f41535b5640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f413006b810 0x7f413006dcd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4148000f60 tx=0x7f4148009040 comp rx=0 tx=0).stop 2024-02-17T14:30:04.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.433+0000 7f41535b5640 1 -- 172.21.15.134:0/355828236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c142400 msgr2=0x7f414c147810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.433+0000 7f41535b5640 1 --2- 172.21.15.134:0/355828236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f414c142400 0x7f414c147810 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f413c009890 tx=0x7f413c0046c0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.433+0000 7f4151b52640 1 -- 172.21.15.134:0/355828236 reap_dead start 2024-02-17T14:30:04.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.433+0000 7f41535b5640 1 -- 172.21.15.134:0/355828236 shutdown_connections 2024-02-17T14:30:04.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.433+0000 7f41535b5640 1 -- 172.21.15.134:0/355828236 >> 172.21.15.134:0/355828236 conn(0x7f414c0b5520 msgr2=0x7f414c073a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:04.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.433+0000 7f41535b5640 1 -- 172.21.15.134:0/355828236 shutdown_connections 2024-02-17T14:30:04.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.433+0000 7f41535b5640 1 -- 172.21.15.134:0/355828236 wait complete. 2024-02-17T14:30:04.445 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-02-17T14:30:04.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.547+0000 7fbf4e58c640 1 Processor -- start 2024-02-17T14:30:04.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.547+0000 7fbf4e58c640 1 -- start start 2024-02-17T14:30:04.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.547+0000 7fbf4e58c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf480b2e60 0x7fbf480b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.547+0000 7fbf4e58c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbf480b1640 0x7fbf480af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.547+0000 7fbf4e58c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf48073040 con 0x7fbf480b2460 2024-02-17T14:30:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.547+0000 7fbf4e58c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf480b3240 con 0x7fbf480b1640 2024-02-17T14:30:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.547+0000 7fbf4e58c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480b1ad0 con 0x7fbf480b2e60 2024-02-17T14:30:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.548+0000 7fbf477fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbf480b1640 0x7fbf480af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.548+0000 7fbf4cb29640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fbf480b2460 0x7fbf480afc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:47972/0 (socket says 172.21.15.134:47972) 2024-02-17T14:30:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.548+0000 7fbf4cb29640 1 -- 172.21.15.134:0/2607853289 learned_addr learned my addr 172.21.15.134:0/2607853289 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.548+0000 7fbf477fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbf480b1640 0x7fbf480af6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38826/0 (socket says 172.21.15.134:38826) 2024-02-17T14:30:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.548+0000 7fbf47fff640 1 --2- 172.21.15.134:0/2607853289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf480b2e60 0x7fbf480b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.548+0000 7fbf477fe640 1 -- 172.21.15.134:0/2607853289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf480b2e60 msgr2=0x7fbf480b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.548+0000 7fbf477fe640 1 --2- 172.21.15.134:0/2607853289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf480b2e60 0x7fbf480b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.548+0000 7fbf477fe640 1 -- 172.21.15.134:0/2607853289 >> v1:172.21.15.134:6789/0 conn(0x7fbf480b2460 legacy=0x7fbf480afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.548+0000 7fbf477fe640 1 -- 172.21.15.134:0/2607853289 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf48072b20 con 0x7fbf480b1640 2024-02-17T14:30:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.548+0000 7fbf46ffd640 1 -- 172.21.15.134:0/2607853289 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885168270 0 0) 0x7fbf48073040 con 0x7fbf480b2460 2024-02-17T14:30:04.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.548+0000 7fbf47fff640 1 --2- 172.21.15.134:0/2607853289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf480b2e60 0x7fbf480b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:30:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.549+0000 7fbf477fe640 1 --2- 172.21.15.134:0/2607853289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf480b1640 0x7fbf480af6d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0097a0 tx=0x7fbf3c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a009bd773ed012d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.549+0000 7fbf46ffd640 1 -- 172.21.15.134:0/2607853289 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c02f050 con 0x7fbf480b1640 2024-02-17T14:30:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.549+0000 7fbf46ffd640 1 -- 172.21.15.134:0/2607853289 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c031700 con 0x7fbf480b1640 2024-02-17T14:30:04.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.549+0000 7fbf46ffd640 1 -- 172.21.15.134:0/2607853289 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c031a90 con 0x7fbf480b1640 2024-02-17T14:30:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.549+0000 7fbf4e58c640 1 -- 172.21.15.134:0/2607853289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf480b1640 msgr2=0x7fbf480af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.549+0000 7fbf4e58c640 1 --2- 172.21.15.134:0/2607853289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf480b1640 0x7fbf480af6d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0097a0 tx=0x7fbf3c02b7a0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.549+0000 7fbf4e58c640 1 -- 172.21.15.134:0/2607853289 shutdown_connections 2024-02-17T14:30:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.549+0000 7fbf4e58c640 1 --2- 172.21.15.134:0/2607853289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf480b1640 0x7fbf480af6d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.549+0000 7fbf4e58c640 1 --2- 172.21.15.134:0/2607853289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf480b2e60 0x7fbf480b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.549+0000 7fbf4e58c640 1 -- 172.21.15.134:0/2607853289 >> 172.21.15.134:0/2607853289 conn(0x7fbf480b8270 msgr2=0x7fbf480b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.549+0000 7fbf4e58c640 1 -- 172.21.15.134:0/2607853289 shutdown_connections 2024-02-17T14:30:04.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.549+0000 7fbf4e58c640 1 -- 172.21.15.134:0/2607853289 wait complete. 2024-02-17T14:30:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.550+0000 7fbf4e58c640 1 Processor -- start 2024-02-17T14:30:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.550+0000 7fbf4e58c640 1 -- start start 2024-02-17T14:30:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4e58c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf480b2460 0x7fbf481395a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4e58c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf480b2e60 0x7fbf48140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4e58c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf481dda10 0x7fbf481ddea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4e58c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf481405c0 con 0x7fbf481dda10 2024-02-17T14:30:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4e58c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf481de3e0 con 0x7fbf480b2e60 2024-02-17T14:30:04.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4e58c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf48141180 con 0x7fbf480b2460 2024-02-17T14:30:04.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4cb29640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf481dda10 0x7fbf481ddea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4cb29640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf481dda10 0x7fbf481ddea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38834/0 (socket says 172.21.15.134:38834) 2024-02-17T14:30:04.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4cb29640 1 -- 172.21.15.134:0/1628796856 learned_addr learned my addr 172.21.15.134:0/1628796856 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:04.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf47fff640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf480b2460 0x7fbf481395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf477fe640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf480b2e60 0x7fbf48140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4cb29640 1 -- 172.21.15.134:0/1628796856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf480b2460 msgr2=0x7fbf481395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4cb29640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf480b2460 0x7fbf481395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4cb29640 1 -- 172.21.15.134:0/1628796856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf480b2e60 msgr2=0x7fbf48140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4cb29640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf480b2e60 0x7fbf48140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.551+0000 7fbf4cb29640 1 -- 172.21.15.134:0/1628796856 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c009400 con 0x7fbf481dda10 2024-02-17T14:30:04.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.552+0000 7fbf4cb29640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf481dda10 0x7fbf481ddea0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000c7e0 tx=0x7fbf4000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:04.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.552+0000 7fbf44ff9640 1 -- 172.21.15.134:0/1628796856 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000a640 con 0x7fbf481dda10 2024-02-17T14:30:04.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.552+0000 7fbf44ff9640 1 -- 172.21.15.134:0/1628796856 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4000a7a0 con 0x7fbf481dda10 2024-02-17T14:30:04.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.552+0000 7fbf4e58c640 1 -- 172.21.15.134:0/1628796856 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4813fcd0 con 0x7fbf481dda10 2024-02-17T14:30:04.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.552+0000 7fbf44ff9640 1 -- 172.21.15.134:0/1628796856 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000ab50 con 0x7fbf481dda10 2024-02-17T14:30:04.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.552+0000 7fbf4e58c640 1 -- 172.21.15.134:0/1628796856 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf481416e0 con 0x7fbf481dda10 2024-02-17T14:30:04.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.553+0000 7fbf4e58c640 1 -- 172.21.15.134:0/1628796856 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf48067b70 con 0x7fbf481dda10 2024-02-17T14:30:04.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.553+0000 7fbf44ff9640 1 -- 172.21.15.134:0/1628796856 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fbf4000acb0 con 0x7fbf481dda10 2024-02-17T14:30:04.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.554+0000 7fbf44ff9640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbf3406b840 0x7fbf3406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.554+0000 7fbf44ff9640 1 -- 172.21.15.134:0/1628796856 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbf40089cd0 con 0x7fbf481dda10 2024-02-17T14:30:04.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.554+0000 7fbf47fff640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbf3406b840 0x7fbf3406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.554+0000 7fbf47fff640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbf3406b840 0x7fbf3406dd00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbf38006fd0 tx=0x7fbf38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:04.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.558+0000 7fbf44ff9640 1 -- 172.21.15.134:0/1628796856 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbf40054380 con 0x7fbf481dda10 2024-02-17T14:30:04.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.729+0000 7fbf4e58c640 1 -- 172.21.15.134:0/1628796856 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf480b0ba0 con 0x7fbf3406b840 2024-02-17T14:30:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.730+0000 7fbf44ff9640 1 -- 172.21.15.134:0/1628796856 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbf3800b140 con 0x7fbf3406b840 2024-02-17T14:30:04.730 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 7 to deep-scrub 2024-02-17T14:30:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.732+0000 7fbf4e58c640 1 -- 172.21.15.134:0/1628796856 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbf3406b840 msgr2=0x7fbf3406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.732+0000 7fbf4e58c640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbf3406b840 0x7fbf3406dd00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbf38006fd0 tx=0x7fbf38008040 comp rx=0 tx=0).stop 2024-02-17T14:30:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.732+0000 7fbf4e58c640 1 -- 172.21.15.134:0/1628796856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf481dda10 msgr2=0x7fbf481ddea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.732+0000 7fbf4e58c640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf481dda10 0x7fbf481ddea0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000c7e0 tx=0x7fbf4000cca0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.732+0000 7fbf4e58c640 1 -- 172.21.15.134:0/1628796856 shutdown_connections 2024-02-17T14:30:04.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.732+0000 7fbf4e58c640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fbf3406b840 0x7fbf3406dd00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.732+0000 7fbf4e58c640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf481dda10 0x7fbf481ddea0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.732+0000 7fbf4e58c640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf480b2e60 0x7fbf48140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.732+0000 7fbf4e58c640 1 --2- 172.21.15.134:0/1628796856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf480b2460 0x7fbf481395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.732+0000 7fbf4e58c640 1 -- 172.21.15.134:0/1628796856 >> 172.21.15.134:0/1628796856 conn(0x7fbf480b8270 msgr2=0x7fbf48143cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:04.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.732+0000 7fbf4e58c640 1 -- 172.21.15.134:0/1628796856 shutdown_connections 2024-02-17T14:30:04.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.732+0000 7fbf4e58c640 1 -- 172.21.15.134:0/1628796856 wait complete. 2024-02-17T14:30:04.743 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T14:30:04.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.843+0000 7f267be23640 1 Processor -- start 2024-02-17T14:30:04.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.843+0000 7f267be23640 1 -- start start 2024-02-17T14:30:04.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f267be23640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2674066b20 0x7f26740b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f267be23640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f26740b8180 0x7f2674140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f267be23640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2674141310 0x7f267414a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f267be23640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26741417a0 con 0x7f2674066b20 2024-02-17T14:30:04.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f267be23640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2674072960 con 0x7f26740b8180 2024-02-17T14:30:04.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f267be23640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2674072210 con 0x7f2674141310 2024-02-17T14:30:04.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f2679bbf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2674066b20 0x7f26740b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f2679bbf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2674066b20 0x7f26740b7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38850/0 (socket says 172.21.15.134:38850) 2024-02-17T14:30:04.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f2679bbf640 1 -- 172.21.15.134:0/3215049656 learned_addr learned my addr 172.21.15.134:0/3215049656 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:04.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f2679bbf640 1 -- 172.21.15.134:0/3215049656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2674141310 msgr2=0x7f267414a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:04.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f267a3c0640 1 --2- 172.21.15.134:0/3215049656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2674141310 0x7f267414a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f26793be640 1 --2- 172.21.15.134:0/3215049656 >> v2:172.21.15.142:3300/0 conn(0x7f26740b8180 0x7f2674140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f2679bbf640 1 --2- 172.21.15.134:0/3215049656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2674141310 0x7f267414a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f2679bbf640 1 -- 172.21.15.134:0/3215049656 >> v2:172.21.15.142:3300/0 conn(0x7f26740b8180 msgr2=0x7f2674140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:04.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f2679bbf640 1 --2- 172.21.15.134:0/3215049656 >> v2:172.21.15.142:3300/0 conn(0x7f26740b8180 0x7f2674140dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.844+0000 7f2679bbf640 1 -- 172.21.15.134:0/3215049656 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2674071aa0 con 0x7f2674066b20 2024-02-17T14:30:04.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.845+0000 7f2679bbf640 1 --2- 172.21.15.134:0/3215049656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2674066b20 0x7f26740b7c40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2674072da0 tx=0x7f267002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c784c1069b31f2f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:04.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.845+0000 7f2678bbd640 1 -- 172.21.15.134:0/3215049656 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26700317c0 con 0x7f2674066b20 2024-02-17T14:30:04.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.845+0000 7f2678bbd640 1 -- 172.21.15.134:0/3215049656 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2670031920 con 0x7f2674066b20 2024-02-17T14:30:04.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.845+0000 7f2678bbd640 1 -- 172.21.15.134:0/3215049656 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670031cb0 con 0x7f2674066b20 2024-02-17T14:30:04.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.846+0000 7f267be23640 1 -- 172.21.15.134:0/3215049656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2674066b20 msgr2=0x7f26740b7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.846+0000 7f267be23640 1 --2- 172.21.15.134:0/3215049656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2674066b20 0x7f26740b7c40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2674072da0 tx=0x7f267002b860 comp rx=0 tx=0).stop 2024-02-17T14:30:04.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.846+0000 7f267be23640 1 -- 172.21.15.134:0/3215049656 shutdown_connections 2024-02-17T14:30:04.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.846+0000 7f267be23640 1 --2- 172.21.15.134:0/3215049656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2674141310 0x7f267414a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.846+0000 7f267be23640 1 --2- 172.21.15.134:0/3215049656 >> v2:172.21.15.142:3300/0 conn(0x7f26740b8180 0x7f2674140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.846+0000 7f267be23640 1 --2- 172.21.15.134:0/3215049656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2674066b20 0x7f26740b7c40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.846+0000 7f267be23640 1 -- 172.21.15.134:0/3215049656 >> 172.21.15.134:0/3215049656 conn(0x7f26740b5fe0 msgr2=0x7f26740b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:04.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.846+0000 7f267be23640 1 -- 172.21.15.134:0/3215049656 shutdown_connections 2024-02-17T14:30:04.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.846+0000 7f267be23640 1 -- 172.21.15.134:0/3215049656 wait complete. 2024-02-17T14:30:04.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.847+0000 7f267be23640 1 Processor -- start 2024-02-17T14:30:04.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.847+0000 7f267be23640 1 -- start start 2024-02-17T14:30:04.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.847+0000 7f267be23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2674066b20 0x7f26740b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.847+0000 7f267be23640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26740b8180 0x7f2674147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.847+0000 7f267be23640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2674141310 0x7f26741476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.847+0000 7f267be23640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2674145990 con 0x7f2674066b20 2024-02-17T14:30:04.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.847+0000 7f267be23640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2674147be0 con 0x7f2674141310 2024-02-17T14:30:04.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.847+0000 7f267be23640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26741469f0 con 0x7f26740b8180 2024-02-17T14:30:04.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f2679bbf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2674066b20 0x7f26740b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f2679bbf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2674066b20 0x7f26740b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38864/0 (socket says 172.21.15.134:38864) 2024-02-17T14:30:04.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f2679bbf640 1 -- 172.21.15.134:0/4092402653 learned_addr learned my addr 172.21.15.134:0/4092402653 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:04.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f26793be640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26740b8180 0x7f2674147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f267a3c0640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2674141310 0x7f26741476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f2679bbf640 1 -- 172.21.15.134:0/4092402653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26740b8180 msgr2=0x7f2674147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f2679bbf640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26740b8180 0x7f2674147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f2679bbf640 1 -- 172.21.15.134:0/4092402653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2674141310 msgr2=0x7f26741476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:04.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f2679bbf640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2674141310 0x7f26741476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:04.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f2679bbf640 1 -- 172.21.15.134:0/4092402653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26700094d0 con 0x7f2674066b20 2024-02-17T14:30:04.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f2679bbf640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2674066b20 0x7f26740b1bc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f267002b8a0 tx=0x7f26700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:04.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f266a7fc640 1 -- 172.21.15.134:0/4092402653 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26700329a0 con 0x7f2674066b20 2024-02-17T14:30:04.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f266a7fc640 1 -- 172.21.15.134:0/4092402653 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2670032b40 con 0x7f2674066b20 2024-02-17T14:30:04.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f267be23640 1 -- 172.21.15.134:0/4092402653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2674146cd0 con 0x7f2674066b20 2024-02-17T14:30:04.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f266a7fc640 1 -- 172.21.15.134:0/4092402653 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26700453f0 con 0x7f2674066b20 2024-02-17T14:30:04.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.848+0000 7f267be23640 1 -- 172.21.15.134:0/4092402653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26741455b0 con 0x7f2674066b20 2024-02-17T14:30:04.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.849+0000 7f267be23640 1 -- 172.21.15.134:0/4092402653 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26740b2ff0 con 0x7f2674066b20 2024-02-17T14:30:04.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.849+0000 7f266a7fc640 1 -- 172.21.15.134:0/4092402653 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f267004e450 con 0x7f2674066b20 2024-02-17T14:30:04.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.850+0000 7f266a7fc640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f265806b810 0x7f265806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:04.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.850+0000 7f266a7fc640 1 -- 172.21.15.134:0/4092402653 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f26700ac950 con 0x7f2674066b20 2024-02-17T14:30:04.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.850+0000 7f26793be640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f265806b810 0x7f265806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:04.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.850+0000 7f26793be640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f265806b810 0x7f265806dcd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2674148000 tx=0x7f2664008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:04.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:04.854+0000 7f266a7fc640 1 -- 172.21.15.134:0/4092402653 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2670076f70 con 0x7f2674066b20 2024-02-17T14:30:05.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.024+0000 7f267be23640 1 -- 172.21.15.134:0/4092402653 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2674071d80 con 0x7f265806b810 2024-02-17T14:30:05.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.032+0000 7f266a7fc640 1 -- 172.21.15.134:0/4092402653 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369556 (secure 0 0 0) 0x7f266400c050 con 0x7f265806b810 2024-02-17T14:30:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:30:05.038 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-02-17T14:30:05.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.036+0000 7f267be23640 1 -- 172.21.15.134:0/4092402653 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f265806b810 msgr2=0x7f265806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:05.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.036+0000 7f267be23640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f265806b810 0x7f265806dcd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2674148000 tx=0x7f2664008040 comp rx=0 tx=0).stop 2024-02-17T14:30:05.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.036+0000 7f267be23640 1 -- 172.21.15.134:0/4092402653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2674066b20 msgr2=0x7f26740b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:05.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.036+0000 7f267be23640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2674066b20 0x7f26740b1bc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f267002b8a0 tx=0x7f26700046c0 comp rx=0 tx=0).stop 2024-02-17T14:30:05.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.036+0000 7f267be23640 1 -- 172.21.15.134:0/4092402653 shutdown_connections 2024-02-17T14:30:05.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.036+0000 7f267be23640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2674141310 0x7f26741476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:05.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.036+0000 7f267be23640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26740b8180 0x7f2674147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:05.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.036+0000 7f267be23640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f265806b810 0x7f265806dcd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:05.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.036+0000 7f267be23640 1 --2- 172.21.15.134:0/4092402653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2674066b20 0x7f26740b1bc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:05.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.036+0000 7f267be23640 1 -- 172.21.15.134:0/4092402653 >> 172.21.15.134:0/4092402653 conn(0x7f26740b5fe0 msgr2=0x7f267413fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:05.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.036+0000 7f267be23640 1 -- 172.21.15.134:0/4092402653 shutdown_connections 2024-02-17T14:30:05.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:05.036+0000 7f267be23640 1 -- 172.21.15.134:0/4092402653 wait complete. 2024-02-17T14:30:05.047 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-02-17T14:30:04.594593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599291,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":219,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218624,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756096,"statfs":{"total":773094113280,"available":772870242304,"internally_reserved":0,"allocated":2531328,"data_stored":2150902,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":157,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002855"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877285+0000","last_change":"2024-02-17T14:28:03.069069+0000","last_active":"2024-02-17T14:28:51.877285+0000","last_peered":"2024-02-17T14:28:51.877285+0000","last_clean":"2024-02-17T14:28:51.877285+0000","last_became_active":"2024-02-17T14:28:03.068714+0000","last_became_peered":"2024-02-17T14:28:03.068714+0000","last_unstale":"2024-02-17T14:28:51.877285+0000","last_undegraded":"2024-02-17T14:28:51.877285+0000","last_fullsized":"2024-02-17T14:28:51.877285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766915+0000","last_change":"2024-02-17T14:28:03.633277+0000","last_active":"2024-02-17T14:28:51.766915+0000","last_peered":"2024-02-17T14:28:51.766915+0000","last_clean":"2024-02-17T14:28:51.766915+0000","last_became_active":"2024-02-17T14:28:03.631462+0000","last_became_peered":"2024-02-17T14:28:03.631462+0000","last_unstale":"2024-02-17T14:28:51.766915+0000","last_undegraded":"2024-02-17T14:28:51.766915+0000","last_fullsized":"2024-02-17T14:28:51.766915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766084+0000","last_change":"2024-02-17T14:28:07.850214+0000","last_active":"2024-02-17T14:28:51.766084+0000","last_peered":"2024-02-17T14:28:51.766084+0000","last_clean":"2024-02-17T14:28:51.766084+0000","last_became_active":"2024-02-17T14:28:07.849871+0000","last_became_peered":"2024-02-17T14:28:07.849871+0000","last_unstale":"2024-02-17T14:28:51.766084+0000","last_undegraded":"2024-02-17T14:28:51.766084+0000","last_fullsized":"2024-02-17T14:28:51.766084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:46:12.614434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767140+0000","last_change":"2024-02-17T14:28:03.069234+0000","last_active":"2024-02-17T14:28:51.767140+0000","last_peered":"2024-02-17T14:28:51.767140+0000","last_clean":"2024-02-17T14:28:51.767140+0000","last_became_active":"2024-02-17T14:28:03.068978+0000","last_became_peered":"2024-02-17T14:28:03.068978+0000","last_unstale":"2024-02-17T14:28:51.767140+0000","last_undegraded":"2024-02-17T14:28:51.767140+0000","last_fullsized":"2024-02-17T14:28:51.767140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877082+0000","last_change":"2024-02-17T14:28:03.630763+0000","last_active":"2024-02-17T14:28:51.877082+0000","last_peered":"2024-02-17T14:28:51.877082+0000","last_clean":"2024-02-17T14:28:51.877082+0000","last_became_active":"2024-02-17T14:28:03.630517+0000","last_became_peered":"2024-02-17T14:28:03.630517+0000","last_unstale":"2024-02-17T14:28:51.877082+0000","last_undegraded":"2024-02-17T14:28:51.877082+0000","last_fullsized":"2024-02-17T14:28:51.877082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767213+0000","last_change":"2024-02-17T14:28:07.644982+0000","last_active":"2024-02-17T14:28:51.767213+0000","last_peered":"2024-02-17T14:28:51.767213+0000","last_clean":"2024-02-17T14:28:51.767213+0000","last_became_active":"2024-02-17T14:28:07.644458+0000","last_became_peered":"2024-02-17T14:28:07.644458+0000","last_unstale":"2024-02-17T14:28:51.767213+0000","last_undegraded":"2024-02-17T14:28:51.767213+0000","last_fullsized":"2024-02-17T14:28:51.767213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:42.133618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061064+0000","last_change":"2024-02-17T14:28:03.071236+0000","last_active":"2024-02-17T14:28:52.061064+0000","last_peered":"2024-02-17T14:28:52.061064+0000","last_clean":"2024-02-17T14:28:52.061064+0000","last_became_active":"2024-02-17T14:28:03.070955+0000","last_became_peered":"2024-02-17T14:28:03.070955+0000","last_unstale":"2024-02-17T14:28:52.061064+0000","last_undegraded":"2024-02-17T14:28:52.061064+0000","last_fullsized":"2024-02-17T14:28:52.061064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:11.889877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768896+0000","last_change":"2024-02-17T14:28:03.628182+0000","last_active":"2024-02-17T14:28:51.768896+0000","last_peered":"2024-02-17T14:28:51.768896+0000","last_clean":"2024-02-17T14:28:51.768896+0000","last_became_active":"2024-02-17T14:28:03.627865+0000","last_became_peered":"2024-02-17T14:28:03.627865+0000","last_unstale":"2024-02-17T14:28:51.768896+0000","last_undegraded":"2024-02-17T14:28:51.768896+0000","last_fullsized":"2024-02-17T14:28:51.768896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767499+0000","last_change":"2024-02-17T14:28:07.649384+0000","last_active":"2024-02-17T14:28:51.767499+0000","last_peered":"2024-02-17T14:28:51.767499+0000","last_clean":"2024-02-17T14:28:51.767499+0000","last_became_active":"2024-02-17T14:28:07.648936+0000","last_became_peered":"2024-02-17T14:28:07.648936+0000","last_unstale":"2024-02-17T14:28:51.767499+0000","last_undegraded":"2024-02-17T14:28:51.767499+0000","last_fullsized":"2024-02-17T14:28:51.767499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:13.199365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060828+0000","last_change":"2024-02-17T14:28:03.074776+0000","last_active":"2024-02-17T14:28:52.060828+0000","last_peered":"2024-02-17T14:28:52.060828+0000","last_clean":"2024-02-17T14:28:52.060828+0000","last_became_active":"2024-02-17T14:28:03.074490+0000","last_became_peered":"2024-02-17T14:28:03.074490+0000","last_unstale":"2024-02-17T14:28:52.060828+0000","last_undegraded":"2024-02-17T14:28:52.060828+0000","last_fullsized":"2024-02-17T14:28:52.060828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769046+0000","last_change":"2024-02-17T14:28:03.627957+0000","last_active":"2024-02-17T14:28:51.769046+0000","last_peered":"2024-02-17T14:28:51.769046+0000","last_clean":"2024-02-17T14:28:51.769046+0000","last_became_active":"2024-02-17T14:28:03.627675+0000","last_became_peered":"2024-02-17T14:28:03.627675+0000","last_unstale":"2024-02-17T14:28:51.769046+0000","last_undegraded":"2024-02-17T14:28:51.769046+0000","last_fullsized":"2024-02-17T14:28:51.769046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767195+0000","last_change":"2024-02-17T14:28:07.652422+0000","last_active":"2024-02-17T14:28:51.767195+0000","last_peered":"2024-02-17T14:28:51.767195+0000","last_clean":"2024-02-17T14:28:51.767195+0000","last_became_active":"2024-02-17T14:28:07.651946+0000","last_became_peered":"2024-02-17T14:28:07.651946+0000","last_unstale":"2024-02-17T14:28:51.767195+0000","last_undegraded":"2024-02-17T14:28:51.767195+0000","last_fullsized":"2024-02-17T14:28:51.767195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:21.967845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764800+0000","last_change":"2024-02-17T14:28:03.635059+0000","last_active":"2024-02-17T14:28:51.764800+0000","last_peered":"2024-02-17T14:28:51.764800+0000","last_clean":"2024-02-17T14:28:51.764800+0000","last_became_active":"2024-02-17T14:28:03.634759+0000","last_became_peered":"2024-02-17T14:28:03.634759+0000","last_unstale":"2024-02-17T14:28:51.764800+0000","last_undegraded":"2024-02-17T14:28:51.764800+0000","last_fullsized":"2024-02-17T14:28:51.764800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060724+0000","last_change":"2024-02-17T14:28:03.075604+0000","last_active":"2024-02-17T14:28:52.060724+0000","last_peered":"2024-02-17T14:28:52.060724+0000","last_clean":"2024-02-17T14:28:52.060724+0000","last_became_active":"2024-02-17T14:28:03.075329+0000","last_became_peered":"2024-02-17T14:28:03.075329+0000","last_unstale":"2024-02-17T14:28:52.060724+0000","last_undegraded":"2024-02-17T14:28:52.060724+0000","last_fullsized":"2024-02-17T14:28:52.060724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767399+0000","last_change":"2024-02-17T14:28:07.645791+0000","last_active":"2024-02-17T14:28:51.767399+0000","last_peered":"2024-02-17T14:28:51.767399+0000","last_clean":"2024-02-17T14:28:51.767399+0000","last_became_active":"2024-02-17T14:28:07.645418+0000","last_became_peered":"2024-02-17T14:28:07.645418+0000","last_unstale":"2024-02-17T14:28:51.767399+0000","last_undegraded":"2024-02-17T14:28:51.767399+0000","last_fullsized":"2024-02-17T14:28:51.767399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:26.642214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766726+0000","last_change":"2024-02-17T14:28:03.629378+0000","last_active":"2024-02-17T14:28:51.766726+0000","last_peered":"2024-02-17T14:28:51.766726+0000","last_clean":"2024-02-17T14:28:51.766726+0000","last_became_active":"2024-02-17T14:28:03.629097+0000","last_became_peered":"2024-02-17T14:28:03.629097+0000","last_unstale":"2024-02-17T14:28:51.766726+0000","last_undegraded":"2024-02-17T14:28:51.766726+0000","last_fullsized":"2024-02-17T14:28:51.766726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765031+0000","last_change":"2024-02-17T14:28:03.073579+0000","last_active":"2024-02-17T14:28:51.765031+0000","last_peered":"2024-02-17T14:28:51.765031+0000","last_clean":"2024-02-17T14:28:51.765031+0000","last_became_active":"2024-02-17T14:28:03.073167+0000","last_became_peered":"2024-02-17T14:28:03.073167+0000","last_unstale":"2024-02-17T14:28:51.765031+0000","last_undegraded":"2024-02-17T14:28:51.765031+0000","last_fullsized":"2024-02-17T14:28:51.765031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.773726+0000","last_change":"2024-02-17T14:28:51.773726+0000","last_active":"2024-02-17T14:28:51.773726+0000","last_peered":"2024-02-17T14:28:51.773726+0000","last_clean":"2024-02-17T14:28:51.773726+0000","last_became_active":"2024-02-17T14:28:51.773241+0000","last_became_peered":"2024-02-17T14:28:51.773241+0000","last_unstale":"2024-02-17T14:28:51.773726+0000","last_undegraded":"2024-02-17T14:28:51.773726+0000","last_fullsized":"2024-02-17T14:28:51.773726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:52.959315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766643+0000","last_change":"2024-02-17T14:28:03.628527+0000","last_active":"2024-02-17T14:28:51.766643+0000","last_peered":"2024-02-17T14:28:51.766643+0000","last_clean":"2024-02-17T14:28:51.766643+0000","last_became_active":"2024-02-17T14:28:03.628274+0000","last_became_peered":"2024-02-17T14:28:03.628274+0000","last_unstale":"2024-02-17T14:28:51.766643+0000","last_undegraded":"2024-02-17T14:28:51.766643+0000","last_fullsized":"2024-02-17T14:28:51.766643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765201+0000","last_change":"2024-02-17T14:28:03.072317+0000","last_active":"2024-02-17T14:28:51.765201+0000","last_peered":"2024-02-17T14:28:51.765201+0000","last_clean":"2024-02-17T14:28:51.765201+0000","last_became_active":"2024-02-17T14:28:03.072016+0000","last_became_peered":"2024-02-17T14:28:03.072016+0000","last_unstale":"2024-02-17T14:28:51.765201+0000","last_undegraded":"2024-02-17T14:28:51.765201+0000","last_fullsized":"2024-02-17T14:28:51.765201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764270+0000","last_change":"2024-02-17T14:28:07.851022+0000","last_active":"2024-02-17T14:28:51.764270+0000","last_peered":"2024-02-17T14:28:51.764270+0000","last_clean":"2024-02-17T14:28:51.764270+0000","last_became_active":"2024-02-17T14:28:07.850379+0000","last_became_peered":"2024-02-17T14:28:07.850379+0000","last_unstale":"2024-02-17T14:28:51.764270+0000","last_undegraded":"2024-02-17T14:28:51.764270+0000","last_fullsized":"2024-02-17T14:28:51.764270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768008+0000","last_change":"2024-02-17T14:28:03.624798+0000","last_active":"2024-02-17T14:28:51.768008+0000","last_peered":"2024-02-17T14:28:51.768008+0000","last_clean":"2024-02-17T14:28:51.768008+0000","last_became_active":"2024-02-17T14:28:03.624517+0000","last_became_peered":"2024-02-17T14:28:03.624517+0000","last_unstale":"2024-02-17T14:28:51.768008+0000","last_undegraded":"2024-02-17T14:28:51.768008+0000","last_fullsized":"2024-02-17T14:28:51.768008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:40.637145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060517+0000","last_change":"2024-02-17T14:28:03.072806+0000","last_active":"2024-02-17T14:28:52.060517+0000","last_peered":"2024-02-17T14:28:52.060517+0000","last_clean":"2024-02-17T14:28:52.060517+0000","last_became_active":"2024-02-17T14:28:03.072490+0000","last_became_peered":"2024-02-17T14:28:03.072490+0000","last_unstale":"2024-02-17T14:28:52.060517+0000","last_undegraded":"2024-02-17T14:28:52.060517+0000","last_fullsized":"2024-02-17T14:28:52.060517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.774116+0000","last_change":"2024-02-17T14:28:51.774116+0000","last_active":"2024-02-17T14:28:51.774116+0000","last_peered":"2024-02-17T14:28:51.774116+0000","last_clean":"2024-02-17T14:28:51.774116+0000","last_became_active":"2024-02-17T14:28:51.773478+0000","last_became_peered":"2024-02-17T14:28:51.773478+0000","last_unstale":"2024-02-17T14:28:51.774116+0000","last_undegraded":"2024-02-17T14:28:51.774116+0000","last_fullsized":"2024-02-17T14:28:51.774116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:00.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877361+0000","last_change":"2024-02-17T14:28:03.629190+0000","last_active":"2024-02-17T14:28:51.877361+0000","last_peered":"2024-02-17T14:28:51.877361+0000","last_clean":"2024-02-17T14:28:51.877361+0000","last_became_active":"2024-02-17T14:28:03.628777+0000","last_became_peered":"2024-02-17T14:28:03.628777+0000","last_unstale":"2024-02-17T14:28:51.877361+0000","last_undegraded":"2024-02-17T14:28:51.877361+0000","last_fullsized":"2024-02-17T14:28:51.877361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766033+0000","last_change":"2024-02-17T14:28:03.071097+0000","last_active":"2024-02-17T14:28:51.766033+0000","last_peered":"2024-02-17T14:28:51.766033+0000","last_clean":"2024-02-17T14:28:51.766033+0000","last_became_active":"2024-02-17T14:28:03.070790+0000","last_became_peered":"2024-02-17T14:28:03.070790+0000","last_unstale":"2024-02-17T14:28:51.766033+0000","last_undegraded":"2024-02-17T14:28:51.766033+0000","last_fullsized":"2024-02-17T14:28:51.766033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:15:06.754020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767459+0000","last_change":"2024-02-17T14:28:07.849764+0000","last_active":"2024-02-17T14:28:51.767459+0000","last_peered":"2024-02-17T14:28:51.767459+0000","last_clean":"2024-02-17T14:28:51.767459+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:51.767459+0000","last_undegraded":"2024-02-17T14:28:51.767459+0000","last_fullsized":"2024-02-17T14:28:51.767459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767308+0000","last_change":"2024-02-17T14:28:03.641818+0000","last_active":"2024-02-17T14:28:51.767308+0000","last_peered":"2024-02-17T14:28:51.767308+0000","last_clean":"2024-02-17T14:28:51.767308+0000","last_became_active":"2024-02-17T14:28:03.641577+0000","last_became_peered":"2024-02-17T14:28:03.641577+0000","last_unstale":"2024-02-17T14:28:51.767308+0000","last_undegraded":"2024-02-17T14:28:51.767308+0000","last_fullsized":"2024-02-17T14:28:51.767308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:29:59.078792+0000","last_change":"2024-02-17T14:28:03.072074+0000","last_active":"2024-02-17T14:29:59.078792+0000","last_peered":"2024-02-17T14:29:59.078792+0000","last_clean":"2024-02-17T14:29:59.078792+0000","last_became_active":"2024-02-17T14:28:03.071850+0000","last_became_peered":"2024-02-17T14:28:03.071850+0000","last_unstale":"2024-02-17T14:29:59.078792+0000","last_undegraded":"2024-02-17T14:29:59.078792+0000","last_fullsized":"2024-02-17T14:29:59.078792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.062350+0000","last_change":"2024-02-17T14:28:52.062350+0000","last_active":"2024-02-17T14:28:52.062350+0000","last_peered":"2024-02-17T14:28:52.062350+0000","last_clean":"2024-02-17T14:28:52.062350+0000","last_became_active":"2024-02-17T14:28:52.061827+0000","last_became_peered":"2024-02-17T14:28:52.061827+0000","last_unstale":"2024-02-17T14:28:52.062350+0000","last_undegraded":"2024-02-17T14:28:52.062350+0000","last_fullsized":"2024-02-17T14:28:52.062350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:55:43.813329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:02.116823+0000","last_change":"2024-02-17T14:30:02.116846+0000","last_active":"2024-02-17T14:30:02.116823+0000","last_peered":"2024-02-17T14:30:02.116823+0000","last_clean":"2024-02-17T14:30:02.116823+0000","last_became_active":"2024-02-17T14:28:03.632020+0000","last_became_peered":"2024-02-17T14:28:03.632020+0000","last_unstale":"2024-02-17T14:30:02.116823+0000","last_undegraded":"2024-02-17T14:30:02.116823+0000","last_fullsized":"2024-02-17T14:30:02.116823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:02.116747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:02.116747+0000","last_clean_scrub_stamp":"2024-02-17T14:30:02.116747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:25:54.637354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061173+0000","last_change":"2024-02-17T14:28:03.072252+0000","last_active":"2024-02-17T14:28:52.061173+0000","last_peered":"2024-02-17T14:28:52.061173+0000","last_clean":"2024-02-17T14:28:52.061173+0000","last_became_active":"2024-02-17T14:28:03.071830+0000","last_became_peered":"2024-02-17T14:28:03.071830+0000","last_unstale":"2024-02-17T14:28:52.061173+0000","last_undegraded":"2024-02-17T14:28:52.061173+0000","last_fullsized":"2024-02-17T14:28:52.061173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:24.870956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876995+0000","last_change":"2024-02-17T14:28:07.849579+0000","last_active":"2024-02-17T14:28:51.876995+0000","last_peered":"2024-02-17T14:28:51.876995+0000","last_clean":"2024-02-17T14:28:51.876995+0000","last_became_active":"2024-02-17T14:28:07.849212+0000","last_became_peered":"2024-02-17T14:28:07.849212+0000","last_unstale":"2024-02-17T14:28:51.876995+0000","last_undegraded":"2024-02-17T14:28:51.876995+0000","last_fullsized":"2024-02-17T14:28:51.876995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769189+0000","last_change":"2024-02-17T14:28:03.626429+0000","last_active":"2024-02-17T14:28:51.769189+0000","last_peered":"2024-02-17T14:28:51.769189+0000","last_clean":"2024-02-17T14:28:51.769189+0000","last_became_active":"2024-02-17T14:28:03.626174+0000","last_became_peered":"2024-02-17T14:28:03.626174+0000","last_unstale":"2024-02-17T14:28:51.769189+0000","last_undegraded":"2024-02-17T14:28:51.769189+0000","last_fullsized":"2024-02-17T14:28:51.769189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765054+0000","last_change":"2024-02-17T14:28:03.068443+0000","last_active":"2024-02-17T14:28:51.765054+0000","last_peered":"2024-02-17T14:28:51.765054+0000","last_clean":"2024-02-17T14:28:51.765054+0000","last_became_active":"2024-02-17T14:28:03.068179+0000","last_became_peered":"2024-02-17T14:28:03.068179+0000","last_unstale":"2024-02-17T14:28:51.765054+0000","last_undegraded":"2024-02-17T14:28:51.765054+0000","last_fullsized":"2024-02-17T14:28:51.765054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764255+0000","last_change":"2024-02-17T14:28:07.650015+0000","last_active":"2024-02-17T14:28:51.764255+0000","last_peered":"2024-02-17T14:28:51.764255+0000","last_clean":"2024-02-17T14:28:51.764255+0000","last_became_active":"2024-02-17T14:28:07.647918+0000","last_became_peered":"2024-02-17T14:28:07.647918+0000","last_unstale":"2024-02-17T14:28:51.764255+0000","last_undegraded":"2024-02-17T14:28:51.764255+0000","last_fullsized":"2024-02-17T14:28:51.764255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767904+0000","last_change":"2024-02-17T14:28:03.629343+0000","last_active":"2024-02-17T14:28:51.767904+0000","last_peered":"2024-02-17T14:28:51.767904+0000","last_clean":"2024-02-17T14:28:51.767904+0000","last_became_active":"2024-02-17T14:28:03.629077+0000","last_became_peered":"2024-02-17T14:28:03.629077+0000","last_unstale":"2024-02-17T14:28:51.767904+0000","last_undegraded":"2024-02-17T14:28:51.767904+0000","last_fullsized":"2024-02-17T14:28:51.767904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:36.441335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769239+0000","last_change":"2024-02-17T14:28:03.069178+0000","last_active":"2024-02-17T14:28:51.769239+0000","last_peered":"2024-02-17T14:28:51.769239+0000","last_clean":"2024-02-17T14:28:51.769239+0000","last_became_active":"2024-02-17T14:28:03.068923+0000","last_became_peered":"2024-02-17T14:28:03.068923+0000","last_unstale":"2024-02-17T14:28:51.769239+0000","last_undegraded":"2024-02-17T14:28:51.769239+0000","last_fullsized":"2024-02-17T14:28:51.769239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764872+0000","last_change":"2024-02-17T14:28:07.648757+0000","last_active":"2024-02-17T14:28:51.764872+0000","last_peered":"2024-02-17T14:28:51.764872+0000","last_clean":"2024-02-17T14:28:51.764872+0000","last_became_active":"2024-02-17T14:28:07.645156+0000","last_became_peered":"2024-02-17T14:28:07.645156+0000","last_unstale":"2024-02-17T14:28:51.764872+0000","last_undegraded":"2024-02-17T14:28:51.764872+0000","last_fullsized":"2024-02-17T14:28:51.764872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764331+0000","last_change":"2024-02-17T14:28:03.627479+0000","last_active":"2024-02-17T14:28:51.764331+0000","last_peered":"2024-02-17T14:28:51.764331+0000","last_clean":"2024-02-17T14:28:51.764331+0000","last_became_active":"2024-02-17T14:28:03.627165+0000","last_became_peered":"2024-02-17T14:28:03.627165+0000","last_unstale":"2024-02-17T14:28:51.764331+0000","last_undegraded":"2024-02-17T14:28:51.764331+0000","last_fullsized":"2024-02-17T14:28:51.764331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.763800+0000","last_change":"2024-02-17T14:28:03.066452+0000","last_active":"2024-02-17T14:28:51.763800+0000","last_peered":"2024-02-17T14:28:51.763800+0000","last_clean":"2024-02-17T14:28:51.763800+0000","last_became_active":"2024-02-17T14:28:03.066156+0000","last_became_peered":"2024-02-17T14:28:03.066156+0000","last_unstale":"2024-02-17T14:28:51.763800+0000","last_undegraded":"2024-02-17T14:28:51.763800+0000","last_fullsized":"2024-02-17T14:28:51.763800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764357+0000","last_change":"2024-02-17T14:28:07.649765+0000","last_active":"2024-02-17T14:28:51.764357+0000","last_peered":"2024-02-17T14:28:51.764357+0000","last_clean":"2024-02-17T14:28:51.764357+0000","last_became_active":"2024-02-17T14:28:07.649403+0000","last_became_peered":"2024-02-17T14:28:07.649403+0000","last_unstale":"2024-02-17T14:28:51.764357+0000","last_undegraded":"2024-02-17T14:28:51.764357+0000","last_fullsized":"2024-02-17T14:28:51.764357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876651+0000","last_change":"2024-02-17T14:28:03.629628+0000","last_active":"2024-02-17T14:28:51.876651+0000","last_peered":"2024-02-17T14:28:51.876651+0000","last_clean":"2024-02-17T14:28:51.876651+0000","last_became_active":"2024-02-17T14:28:03.629247+0000","last_became_peered":"2024-02-17T14:28:03.629247+0000","last_unstale":"2024-02-17T14:28:51.876651+0000","last_undegraded":"2024-02-17T14:28:51.876651+0000","last_fullsized":"2024-02-17T14:28:51.876651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060628+0000","last_change":"2024-02-17T14:28:03.072090+0000","last_active":"2024-02-17T14:28:52.060628+0000","last_peered":"2024-02-17T14:28:52.060628+0000","last_clean":"2024-02-17T14:28:52.060628+0000","last_became_active":"2024-02-17T14:28:03.071778+0000","last_became_peered":"2024-02-17T14:28:03.071778+0000","last_unstale":"2024-02-17T14:28:52.060628+0000","last_undegraded":"2024-02-17T14:28:52.060628+0000","last_fullsized":"2024-02-17T14:28:52.060628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877227+0000","last_change":"2024-02-17T14:28:07.850472+0000","last_active":"2024-02-17T14:28:51.877227+0000","last_peered":"2024-02-17T14:28:51.877227+0000","last_clean":"2024-02-17T14:28:51.877227+0000","last_became_active":"2024-02-17T14:28:07.850106+0000","last_became_peered":"2024-02-17T14:28:07.850106+0000","last_unstale":"2024-02-17T14:28:51.877227+0000","last_undegraded":"2024-02-17T14:28:51.877227+0000","last_fullsized":"2024-02-17T14:28:51.877227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766517+0000","last_change":"2024-02-17T14:28:03.635109+0000","last_active":"2024-02-17T14:28:51.766517+0000","last_peered":"2024-02-17T14:28:51.766517+0000","last_clean":"2024-02-17T14:28:51.766517+0000","last_became_active":"2024-02-17T14:28:03.634570+0000","last_became_peered":"2024-02-17T14:28:03.634570+0000","last_unstale":"2024-02-17T14:28:51.766517+0000","last_undegraded":"2024-02-17T14:28:51.766517+0000","last_fullsized":"2024-02-17T14:28:51.766517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768818+0000","last_change":"2024-02-17T14:28:03.061647+0000","last_active":"2024-02-17T14:28:51.768818+0000","last_peered":"2024-02-17T14:28:51.768818+0000","last_clean":"2024-02-17T14:28:51.768818+0000","last_became_active":"2024-02-17T14:28:03.061026+0000","last_became_peered":"2024-02-17T14:28:03.061026+0000","last_unstale":"2024-02-17T14:28:51.768818+0000","last_undegraded":"2024-02-17T14:28:51.768818+0000","last_fullsized":"2024-02-17T14:28:51.768818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060779+0000","last_change":"2024-02-17T14:28:00.253131+0000","last_active":"2024-02-17T14:28:52.060779+0000","last_peered":"2024-02-17T14:28:52.060779+0000","last_clean":"2024-02-17T14:28:52.060779+0000","last_became_active":"2024-02-17T14:28:00.252180+0000","last_became_peered":"2024-02-17T14:28:00.252180+0000","last_unstale":"2024-02-17T14:28:52.060779+0000","last_undegraded":"2024-02-17T14:28:52.060779+0000","last_fullsized":"2024-02-17T14:28:52.060779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:27:59.037303+0000","last_clean_scrub_stamp":"2024-02-17T14:27:59.037303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:48.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764838+0000","last_change":"2024-02-17T14:28:07.849676+0000","last_active":"2024-02-17T14:28:51.764838+0000","last_peered":"2024-02-17T14:28:51.764838+0000","last_clean":"2024-02-17T14:28:51.764838+0000","last_became_active":"2024-02-17T14:28:07.849264+0000","last_became_peered":"2024-02-17T14:28:07.849264+0000","last_unstale":"2024-02-17T14:28:51.764838+0000","last_undegraded":"2024-02-17T14:28:51.764838+0000","last_fullsized":"2024-02-17T14:28:51.764838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:54.317730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060912+0000","last_change":"2024-02-17T14:28:03.642433+0000","last_active":"2024-02-17T14:28:52.060912+0000","last_peered":"2024-02-17T14:28:52.060912+0000","last_clean":"2024-02-17T14:28:52.060912+0000","last_became_active":"2024-02-17T14:28:03.641815+0000","last_became_peered":"2024-02-17T14:28:03.641815+0000","last_unstale":"2024-02-17T14:28:52.060912+0000","last_undegraded":"2024-02-17T14:28:52.060912+0000","last_fullsized":"2024-02-17T14:28:52.060912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:38.398272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764521+0000","last_change":"2024-02-17T14:28:03.066483+0000","last_active":"2024-02-17T14:28:51.764521+0000","last_peered":"2024-02-17T14:28:51.764521+0000","last_clean":"2024-02-17T14:28:51.764521+0000","last_became_active":"2024-02-17T14:28:03.066169+0000","last_became_peered":"2024-02-17T14:28:03.066169+0000","last_unstale":"2024-02-17T14:28:51.764521+0000","last_undegraded":"2024-02-17T14:28:51.764521+0000","last_fullsized":"2024-02-17T14:28:51.764521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764767+0000","last_change":"2024-02-17T14:28:07.846685+0000","last_active":"2024-02-17T14:28:51.764767+0000","last_peered":"2024-02-17T14:28:51.764767+0000","last_clean":"2024-02-17T14:28:51.764767+0000","last_became_active":"2024-02-17T14:28:07.846265+0000","last_became_peered":"2024-02-17T14:28:07.846265+0000","last_unstale":"2024-02-17T14:28:51.764767+0000","last_undegraded":"2024-02-17T14:28:51.764767+0000","last_fullsized":"2024-02-17T14:28:51.764767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769117+0000","last_change":"2024-02-17T14:28:03.634574+0000","last_active":"2024-02-17T14:28:51.769117+0000","last_peered":"2024-02-17T14:28:51.769117+0000","last_clean":"2024-02-17T14:28:51.769117+0000","last_became_active":"2024-02-17T14:28:03.634290+0000","last_became_peered":"2024-02-17T14:28:03.634290+0000","last_unstale":"2024-02-17T14:28:51.769117+0000","last_undegraded":"2024-02-17T14:28:51.769117+0000","last_fullsized":"2024-02-17T14:28:51.769117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765122+0000","last_change":"2024-02-17T14:28:03.072793+0000","last_active":"2024-02-17T14:28:51.765122+0000","last_peered":"2024-02-17T14:28:51.765122+0000","last_clean":"2024-02-17T14:28:51.765122+0000","last_became_active":"2024-02-17T14:28:03.072497+0000","last_became_peered":"2024-02-17T14:28:03.072497+0000","last_unstale":"2024-02-17T14:28:51.765122+0000","last_undegraded":"2024-02-17T14:28:51.765122+0000","last_fullsized":"2024-02-17T14:28:51.765122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877012+0000","last_change":"2024-02-17T14:28:07.651730+0000","last_active":"2024-02-17T14:28:51.877012+0000","last_peered":"2024-02-17T14:28:51.877012+0000","last_clean":"2024-02-17T14:28:51.877012+0000","last_became_active":"2024-02-17T14:28:07.651144+0000","last_became_peered":"2024-02-17T14:28:07.651144+0000","last_unstale":"2024-02-17T14:28:51.877012+0000","last_undegraded":"2024-02-17T14:28:51.877012+0000","last_fullsized":"2024-02-17T14:28:51.877012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061174+0000","last_change":"2024-02-17T14:28:03.643461+0000","last_active":"2024-02-17T14:28:52.061174+0000","last_peered":"2024-02-17T14:28:52.061174+0000","last_clean":"2024-02-17T14:28:52.061174+0000","last_became_active":"2024-02-17T14:28:03.643033+0000","last_became_peered":"2024-02-17T14:28:03.643033+0000","last_unstale":"2024-02-17T14:28:52.061174+0000","last_undegraded":"2024-02-17T14:28:52.061174+0000","last_fullsized":"2024-02-17T14:28:52.061174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:40:01.946139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764412+0000","last_change":"2024-02-17T14:28:03.067046+0000","last_active":"2024-02-17T14:28:51.764412+0000","last_peered":"2024-02-17T14:28:51.764412+0000","last_clean":"2024-02-17T14:28:51.764412+0000","last_became_active":"2024-02-17T14:28:03.066797+0000","last_became_peered":"2024-02-17T14:28:03.066797+0000","last_unstale":"2024-02-17T14:28:51.764412+0000","last_undegraded":"2024-02-17T14:28:51.764412+0000","last_fullsized":"2024-02-17T14:28:51.764412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768577+0000","last_change":"2024-02-17T14:28:07.850145+0000","last_active":"2024-02-17T14:28:51.768577+0000","last_peered":"2024-02-17T14:28:51.768577+0000","last_clean":"2024-02-17T14:28:51.768577+0000","last_became_active":"2024-02-17T14:28:07.849280+0000","last_became_peered":"2024-02-17T14:28:07.849280+0000","last_unstale":"2024-02-17T14:28:51.768577+0000","last_undegraded":"2024-02-17T14:28:51.768577+0000","last_fullsized":"2024-02-17T14:28:51.768577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061064+0000","last_change":"2024-02-17T14:28:03.641357+0000","last_active":"2024-02-17T14:28:52.061064+0000","last_peered":"2024-02-17T14:28:52.061064+0000","last_clean":"2024-02-17T14:28:52.061064+0000","last_became_active":"2024-02-17T14:28:03.640945+0000","last_became_peered":"2024-02-17T14:28:03.640945+0000","last_unstale":"2024-02-17T14:28:52.061064+0000","last_undegraded":"2024-02-17T14:28:52.061064+0000","last_fullsized":"2024-02-17T14:28:52.061064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:20:57.197363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767772+0000","last_change":"2024-02-17T14:28:03.066640+0000","last_active":"2024-02-17T14:28:51.767772+0000","last_peered":"2024-02-17T14:28:51.767772+0000","last_clean":"2024-02-17T14:28:51.767772+0000","last_became_active":"2024-02-17T14:28:03.066350+0000","last_became_peered":"2024-02-17T14:28:03.066350+0000","last_unstale":"2024-02-17T14:28:51.767772+0000","last_undegraded":"2024-02-17T14:28:51.767772+0000","last_fullsized":"2024-02-17T14:28:51.767772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:43.162911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767064+0000","last_change":"2024-02-17T14:28:07.652490+0000","last_active":"2024-02-17T14:28:51.767064+0000","last_peered":"2024-02-17T14:28:51.767064+0000","last_clean":"2024-02-17T14:28:51.767064+0000","last_became_active":"2024-02-17T14:28:07.652088+0000","last_became_peered":"2024-02-17T14:28:07.652088+0000","last_unstale":"2024-02-17T14:28:51.767064+0000","last_undegraded":"2024-02-17T14:28:51.767064+0000","last_fullsized":"2024-02-17T14:28:51.767064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:21:41.975941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.583733+0000","last_change":"2024-02-17T14:28:51.770495+0000","last_active":"2024-02-17T14:28:52.583733+0000","last_peered":"2024-02-17T14:28:52.583733+0000","last_clean":"2024-02-17T14:28:52.583733+0000","last_became_active":"2024-02-17T14:28:51.770241+0000","last_became_peered":"2024-02-17T14:28:51.770241+0000","last_unstale":"2024-02-17T14:28:52.583733+0000","last_undegraded":"2024-02-17T14:28:52.583733+0000","last_fullsized":"2024-02-17T14:28:52.583733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.763722+0000","last_change":"2024-02-17T14:28:03.070146+0000","last_active":"2024-02-17T14:28:51.763722+0000","last_peered":"2024-02-17T14:28:51.763722+0000","last_clean":"2024-02-17T14:28:51.763722+0000","last_became_active":"2024-02-17T14:28:03.069867+0000","last_became_peered":"2024-02-17T14:28:03.069867+0000","last_unstale":"2024-02-17T14:28:51.763722+0000","last_undegraded":"2024-02-17T14:28:51.763722+0000","last_fullsized":"2024-02-17T14:28:51.763722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877124+0000","last_change":"2024-02-17T14:28:07.644792+0000","last_active":"2024-02-17T14:28:51.877124+0000","last_peered":"2024-02-17T14:28:51.877124+0000","last_clean":"2024-02-17T14:28:51.877124+0000","last_became_active":"2024-02-17T14:28:07.644452+0000","last_became_peered":"2024-02-17T14:28:07.644452+0000","last_unstale":"2024-02-17T14:28:51.877124+0000","last_undegraded":"2024-02-17T14:28:51.877124+0000","last_fullsized":"2024-02-17T14:28:51.877124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764787+0000","last_change":"2024-02-17T14:28:03.630962+0000","last_active":"2024-02-17T14:28:51.764787+0000","last_peered":"2024-02-17T14:28:51.764787+0000","last_clean":"2024-02-17T14:28:51.764787+0000","last_became_active":"2024-02-17T14:28:03.630239+0000","last_became_peered":"2024-02-17T14:28:03.630239+0000","last_unstale":"2024-02-17T14:28:51.764787+0000","last_undegraded":"2024-02-17T14:28:51.764787+0000","last_fullsized":"2024-02-17T14:28:51.764787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764895+0000","last_change":"2024-02-17T14:28:03.073091+0000","last_active":"2024-02-17T14:28:51.764895+0000","last_peered":"2024-02-17T14:28:51.764895+0000","last_clean":"2024-02-17T14:28:51.764895+0000","last_became_active":"2024-02-17T14:28:03.072801+0000","last_became_peered":"2024-02-17T14:28:03.072801+0000","last_unstale":"2024-02-17T14:28:51.764895+0000","last_undegraded":"2024-02-17T14:28:51.764895+0000","last_fullsized":"2024-02-17T14:28:51.764895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:00.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767224+0000","last_change":"2024-02-17T14:28:07.849362+0000","last_active":"2024-02-17T14:28:51.767224+0000","last_peered":"2024-02-17T14:28:51.767224+0000","last_clean":"2024-02-17T14:28:51.767224+0000","last_became_active":"2024-02-17T14:28:07.848991+0000","last_became_peered":"2024-02-17T14:28:07.848991+0000","last_unstale":"2024-02-17T14:28:51.767224+0000","last_undegraded":"2024-02-17T14:28:51.767224+0000","last_fullsized":"2024-02-17T14:28:51.767224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:52.959315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060690+0000","last_change":"2024-02-17T14:28:03.641810+0000","last_active":"2024-02-17T14:28:52.060690+0000","last_peered":"2024-02-17T14:28:52.060690+0000","last_clean":"2024-02-17T14:28:52.060690+0000","last_became_active":"2024-02-17T14:28:03.641501+0000","last_became_peered":"2024-02-17T14:28:03.641501+0000","last_unstale":"2024-02-17T14:28:52.060690+0000","last_undegraded":"2024-02-17T14:28:52.060690+0000","last_fullsized":"2024-02-17T14:28:52.060690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:50.740061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769153+0000","last_change":"2024-02-17T14:28:03.066989+0000","last_active":"2024-02-17T14:28:51.769153+0000","last_peered":"2024-02-17T14:28:51.769153+0000","last_clean":"2024-02-17T14:28:51.769153+0000","last_became_active":"2024-02-17T14:28:03.066538+0000","last_became_peered":"2024-02-17T14:28:03.066538+0000","last_unstale":"2024-02-17T14:28:51.769153+0000","last_undegraded":"2024-02-17T14:28:51.769153+0000","last_fullsized":"2024-02-17T14:28:51.769153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:19:39.634744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767019+0000","last_change":"2024-02-17T14:28:07.846885+0000","last_active":"2024-02-17T14:28:51.767019+0000","last_peered":"2024-02-17T14:28:51.767019+0000","last_clean":"2024-02-17T14:28:51.767019+0000","last_became_active":"2024-02-17T14:28:07.846413+0000","last_became_peered":"2024-02-17T14:28:07.846413+0000","last_unstale":"2024-02-17T14:28:51.767019+0000","last_undegraded":"2024-02-17T14:28:51.767019+0000","last_fullsized":"2024-02-17T14:28:51.767019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:00.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876905+0000","last_change":"2024-02-17T14:28:03.638054+0000","last_active":"2024-02-17T14:28:51.876905+0000","last_peered":"2024-02-17T14:28:51.876905+0000","last_clean":"2024-02-17T14:28:51.876905+0000","last_became_active":"2024-02-17T14:28:03.637831+0000","last_became_peered":"2024-02-17T14:28:03.637831+0000","last_unstale":"2024-02-17T14:28:51.876905+0000","last_undegraded":"2024-02-17T14:28:51.876905+0000","last_fullsized":"2024-02-17T14:28:51.876905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877207+0000","last_change":"2024-02-17T14:28:03.064510+0000","last_active":"2024-02-17T14:28:51.877207+0000","last_peered":"2024-02-17T14:28:51.877207+0000","last_clean":"2024-02-17T14:28:51.877207+0000","last_became_active":"2024-02-17T14:28:03.064226+0000","last_became_peered":"2024-02-17T14:28:03.064226+0000","last_unstale":"2024-02-17T14:28:51.877207+0000","last_undegraded":"2024-02-17T14:28:51.877207+0000","last_fullsized":"2024-02-17T14:28:51.877207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.769043+0000","last_change":"2024-02-17T14:28:07.849775+0000","last_active":"2024-02-17T14:28:51.769043+0000","last_peered":"2024-02-17T14:28:51.769043+0000","last_clean":"2024-02-17T14:28:51.769043+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:28:51.769043+0000","last_undegraded":"2024-02-17T14:28:51.769043+0000","last_fullsized":"2024-02-17T14:28:51.769043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060827+0000","last_change":"2024-02-17T14:28:03.642582+0000","last_active":"2024-02-17T14:28:52.060827+0000","last_peered":"2024-02-17T14:28:52.060827+0000","last_clean":"2024-02-17T14:28:52.060827+0000","last_became_active":"2024-02-17T14:28:03.642077+0000","last_became_peered":"2024-02-17T14:28:03.642077+0000","last_unstale":"2024-02-17T14:28:52.060827+0000","last_undegraded":"2024-02-17T14:28:52.060827+0000","last_fullsized":"2024-02-17T14:28:52.060827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:46:09.621696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'15","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:29:58.585773+0000","last_change":"2024-02-17T14:28:03.071791+0000","last_active":"2024-02-17T14:29:58.585773+0000","last_peered":"2024-02-17T14:29:58.585773+0000","last_clean":"2024-02-17T14:29:58.585773+0000","last_became_active":"2024-02-17T14:28:03.071303+0000","last_became_peered":"2024-02-17T14:28:03.071303+0000","last_unstale":"2024-02-17T14:29:58.585773+0000","last_undegraded":"2024-02-17T14:29:58.585773+0000","last_fullsized":"2024-02-17T14:29:58.585773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:06.793322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8125,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764850+0000","last_change":"2024-02-17T14:28:07.649531+0000","last_active":"2024-02-17T14:28:51.764850+0000","last_peered":"2024-02-17T14:28:51.764850+0000","last_clean":"2024-02-17T14:28:51.764850+0000","last_became_active":"2024-02-17T14:28:07.645313+0000","last_became_peered":"2024-02-17T14:28:07.645313+0000","last_unstale":"2024-02-17T14:28:51.764850+0000","last_undegraded":"2024-02-17T14:28:51.764850+0000","last_fullsized":"2024-02-17T14:28:51.764850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768488+0000","last_change":"2024-02-17T14:28:03.638812+0000","last_active":"2024-02-17T14:28:51.768488+0000","last_peered":"2024-02-17T14:28:51.768488+0000","last_clean":"2024-02-17T14:28:51.768488+0000","last_became_active":"2024-02-17T14:28:03.637937+0000","last_became_peered":"2024-02-17T14:28:03.637937+0000","last_unstale":"2024-02-17T14:28:51.768488+0000","last_undegraded":"2024-02-17T14:28:51.768488+0000","last_fullsized":"2024-02-17T14:28:51.768488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:12.892278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765035+0000","last_change":"2024-02-17T14:28:03.069972+0000","last_active":"2024-02-17T14:28:51.765035+0000","last_peered":"2024-02-17T14:28:51.765035+0000","last_clean":"2024-02-17T14:28:51.765035+0000","last_became_active":"2024-02-17T14:28:03.069690+0000","last_became_peered":"2024-02-17T14:28:03.069690+0000","last_unstale":"2024-02-17T14:28:51.765035+0000","last_undegraded":"2024-02-17T14:28:51.765035+0000","last_fullsized":"2024-02-17T14:28:51.765035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767677+0000","last_change":"2024-02-17T14:28:07.647825+0000","last_active":"2024-02-17T14:28:51.767677+0000","last_peered":"2024-02-17T14:28:51.767677+0000","last_clean":"2024-02-17T14:28:51.767677+0000","last_became_active":"2024-02-17T14:28:07.647420+0000","last_became_peered":"2024-02-17T14:28:07.647420+0000","last_unstale":"2024-02-17T14:28:51.767677+0000","last_undegraded":"2024-02-17T14:28:51.767677+0000","last_fullsized":"2024-02-17T14:28:51.767677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:25.213071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877228+0000","last_change":"2024-02-17T14:28:03.631000+0000","last_active":"2024-02-17T14:28:51.877228+0000","last_peered":"2024-02-17T14:28:51.877228+0000","last_clean":"2024-02-17T14:28:51.877228+0000","last_became_active":"2024-02-17T14:28:03.630169+0000","last_became_peered":"2024-02-17T14:28:03.630169+0000","last_unstale":"2024-02-17T14:28:51.877228+0000","last_undegraded":"2024-02-17T14:28:51.877228+0000","last_fullsized":"2024-02-17T14:28:51.877228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768929+0000","last_change":"2024-02-17T14:28:03.069911+0000","last_active":"2024-02-17T14:28:51.768929+0000","last_peered":"2024-02-17T14:28:51.768929+0000","last_clean":"2024-02-17T14:28:51.768929+0000","last_became_active":"2024-02-17T14:28:03.069617+0000","last_became_peered":"2024-02-17T14:28:03.069617+0000","last_unstale":"2024-02-17T14:28:51.768929+0000","last_undegraded":"2024-02-17T14:28:51.768929+0000","last_fullsized":"2024-02-17T14:28:51.768929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:02.240574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766539+0000","last_change":"2024-02-17T14:28:07.646742+0000","last_active":"2024-02-17T14:28:51.766539+0000","last_peered":"2024-02-17T14:28:51.766539+0000","last_clean":"2024-02-17T14:28:51.766539+0000","last_became_active":"2024-02-17T14:28:07.646403+0000","last_became_peered":"2024-02-17T14:28:07.646403+0000","last_unstale":"2024-02-17T14:28:51.766539+0000","last_undegraded":"2024-02-17T14:28:51.766539+0000","last_fullsized":"2024-02-17T14:28:51.766539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:22:56.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768969+0000","last_change":"2024-02-17T14:28:03.638522+0000","last_active":"2024-02-17T14:28:51.768969+0000","last_peered":"2024-02-17T14:28:51.768969+0000","last_clean":"2024-02-17T14:28:51.768969+0000","last_became_active":"2024-02-17T14:28:03.638281+0000","last_became_peered":"2024-02-17T14:28:03.638281+0000","last_unstale":"2024-02-17T14:28:51.768969+0000","last_undegraded":"2024-02-17T14:28:51.768969+0000","last_fullsized":"2024-02-17T14:28:51.768969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765890+0000","last_change":"2024-02-17T14:28:03.072855+0000","last_active":"2024-02-17T14:28:51.765890+0000","last_peered":"2024-02-17T14:28:51.765890+0000","last_clean":"2024-02-17T14:28:51.765890+0000","last_became_active":"2024-02-17T14:28:03.072571+0000","last_became_peered":"2024-02-17T14:28:03.072571+0000","last_unstale":"2024-02-17T14:28:51.765890+0000","last_undegraded":"2024-02-17T14:28:51.765890+0000","last_fullsized":"2024-02-17T14:28:51.765890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:35.438933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766155+0000","last_change":"2024-02-17T14:28:07.849448+0000","last_active":"2024-02-17T14:28:51.766155+0000","last_peered":"2024-02-17T14:28:51.766155+0000","last_clean":"2024-02-17T14:28:51.766155+0000","last_became_active":"2024-02-17T14:28:07.849096+0000","last_became_peered":"2024-02-17T14:28:07.849096+0000","last_unstale":"2024-02-17T14:28:51.766155+0000","last_undegraded":"2024-02-17T14:28:51.766155+0000","last_fullsized":"2024-02-17T14:28:51.766155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:31:43.113985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877267+0000","last_change":"2024-02-17T14:28:07.849485+0000","last_active":"2024-02-17T14:28:51.877267+0000","last_peered":"2024-02-17T14:28:51.877267+0000","last_clean":"2024-02-17T14:28:51.877267+0000","last_became_active":"2024-02-17T14:28:07.849053+0000","last_became_peered":"2024-02-17T14:28:07.849053+0000","last_unstale":"2024-02-17T14:28:51.877267+0000","last_undegraded":"2024-02-17T14:28:51.877267+0000","last_fullsized":"2024-02-17T14:28:51.877267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765348+0000","last_change":"2024-02-17T14:28:03.632467+0000","last_active":"2024-02-17T14:28:51.765348+0000","last_peered":"2024-02-17T14:28:51.765348+0000","last_clean":"2024-02-17T14:28:51.765348+0000","last_became_active":"2024-02-17T14:28:03.632204+0000","last_became_peered":"2024-02-17T14:28:03.632204+0000","last_unstale":"2024-02-17T14:28:51.765348+0000","last_undegraded":"2024-02-17T14:28:51.765348+0000","last_fullsized":"2024-02-17T14:28:51.765348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768859+0000","last_change":"2024-02-17T14:28:03.062682+0000","last_active":"2024-02-17T14:28:51.768859+0000","last_peered":"2024-02-17T14:28:51.768859+0000","last_clean":"2024-02-17T14:28:51.768859+0000","last_became_active":"2024-02-17T14:28:03.062390+0000","last_became_peered":"2024-02-17T14:28:03.062390+0000","last_unstale":"2024-02-17T14:28:51.768859+0000","last_undegraded":"2024-02-17T14:28:51.768859+0000","last_fullsized":"2024-02-17T14:28:51.768859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765690+0000","last_change":"2024-02-17T14:28:07.651004+0000","last_active":"2024-02-17T14:28:51.765690+0000","last_peered":"2024-02-17T14:28:51.765690+0000","last_clean":"2024-02-17T14:28:51.765690+0000","last_became_active":"2024-02-17T14:28:07.650627+0000","last_became_peered":"2024-02-17T14:28:07.650627+0000","last_unstale":"2024-02-17T14:28:51.765690+0000","last_undegraded":"2024-02-17T14:28:51.765690+0000","last_fullsized":"2024-02-17T14:28:51.765690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:31.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766582+0000","last_change":"2024-02-17T14:28:03.627978+0000","last_active":"2024-02-17T14:28:51.766582+0000","last_peered":"2024-02-17T14:28:51.766582+0000","last_clean":"2024-02-17T14:28:51.766582+0000","last_became_active":"2024-02-17T14:28:03.627708+0000","last_became_peered":"2024-02-17T14:28:03.627708+0000","last_unstale":"2024-02-17T14:28:51.766582+0000","last_undegraded":"2024-02-17T14:28:51.766582+0000","last_fullsized":"2024-02-17T14:28:51.766582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766317+0000","last_change":"2024-02-17T14:28:03.071479+0000","last_active":"2024-02-17T14:28:51.766317+0000","last_peered":"2024-02-17T14:28:51.766317+0000","last_clean":"2024-02-17T14:28:51.766317+0000","last_became_active":"2024-02-17T14:28:03.071170+0000","last_became_peered":"2024-02-17T14:28:03.071170+0000","last_unstale":"2024-02-17T14:28:51.766317+0000","last_undegraded":"2024-02-17T14:28:51.766317+0000","last_fullsized":"2024-02-17T14:28:51.766317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:03:44.733125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765220+0000","last_change":"2024-02-17T14:28:03.073225+0000","last_active":"2024-02-17T14:28:51.765220+0000","last_peered":"2024-02-17T14:28:51.765220+0000","last_clean":"2024-02-17T14:28:51.765220+0000","last_became_active":"2024-02-17T14:28:03.072928+0000","last_became_peered":"2024-02-17T14:28:03.072928+0000","last_unstale":"2024-02-17T14:28:51.765220+0000","last_undegraded":"2024-02-17T14:28:51.765220+0000","last_fullsized":"2024-02-17T14:28:51.765220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877113+0000","last_change":"2024-02-17T14:28:03.635534+0000","last_active":"2024-02-17T14:28:51.877113+0000","last_peered":"2024-02-17T14:28:51.877113+0000","last_clean":"2024-02-17T14:28:51.877113+0000","last_became_active":"2024-02-17T14:28:03.635362+0000","last_became_peered":"2024-02-17T14:28:03.635362+0000","last_unstale":"2024-02-17T14:28:51.877113+0000","last_undegraded":"2024-02-17T14:28:51.877113+0000","last_fullsized":"2024-02-17T14:28:51.877113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764371+0000","last_change":"2024-02-17T14:28:07.645087+0000","last_active":"2024-02-17T14:28:51.764371+0000","last_peered":"2024-02-17T14:28:51.764371+0000","last_clean":"2024-02-17T14:28:51.764371+0000","last_became_active":"2024-02-17T14:28:07.644637+0000","last_became_peered":"2024-02-17T14:28:07.644637+0000","last_unstale":"2024-02-17T14:28:51.764371+0000","last_undegraded":"2024-02-17T14:28:51.764371+0000","last_fullsized":"2024-02-17T14:28:51.764371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766840+0000","last_change":"2024-02-17T14:28:03.072162+0000","last_active":"2024-02-17T14:28:51.766840+0000","last_peered":"2024-02-17T14:28:51.766840+0000","last_clean":"2024-02-17T14:28:51.766840+0000","last_became_active":"2024-02-17T14:28:03.071112+0000","last_became_peered":"2024-02-17T14:28:03.071112+0000","last_unstale":"2024-02-17T14:28:51.766840+0000","last_undegraded":"2024-02-17T14:28:51.766840+0000","last_fullsized":"2024-02-17T14:28:51.766840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:02.044547+0000","last_clean_scrub_stamp":"2024-02-17T14:28:02.044547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:08:12.934257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767346+0000","last_change":"2024-02-17T14:28:03.628403+0000","last_active":"2024-02-17T14:28:51.767346+0000","last_peered":"2024-02-17T14:28:51.767346+0000","last_clean":"2024-02-17T14:28:51.767346+0000","last_became_active":"2024-02-17T14:28:03.628144+0000","last_became_peered":"2024-02-17T14:28:03.628144+0000","last_unstale":"2024-02-17T14:28:51.767346+0000","last_undegraded":"2024-02-17T14:28:51.767346+0000","last_fullsized":"2024-02-17T14:28:51.767346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:24:01.247136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766781+0000","last_change":"2024-02-17T14:28:07.648376+0000","last_active":"2024-02-17T14:28:51.766781+0000","last_peered":"2024-02-17T14:28:51.766781+0000","last_clean":"2024-02-17T14:28:51.766781+0000","last_became_active":"2024-02-17T14:28:07.647491+0000","last_became_peered":"2024-02-17T14:28:07.647491+0000","last_unstale":"2024-02-17T14:28:51.766781+0000","last_undegraded":"2024-02-17T14:28:51.766781+0000","last_fullsized":"2024-02-17T14:28:51.766781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:12.810441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764660+0000","last_change":"2024-02-17T14:28:03.631191+0000","last_active":"2024-02-17T14:28:51.764660+0000","last_peered":"2024-02-17T14:28:51.764660+0000","last_clean":"2024-02-17T14:28:51.764660+0000","last_became_active":"2024-02-17T14:28:03.630662+0000","last_became_peered":"2024-02-17T14:28:03.630662+0000","last_unstale":"2024-02-17T14:28:51.764660+0000","last_undegraded":"2024-02-17T14:28:51.764660+0000","last_fullsized":"2024-02-17T14:28:51.764660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.763773+0000","last_change":"2024-02-17T14:28:03.629028+0000","last_active":"2024-02-17T14:28:51.763773+0000","last_peered":"2024-02-17T14:28:51.763773+0000","last_clean":"2024-02-17T14:28:51.763773+0000","last_became_active":"2024-02-17T14:28:03.628781+0000","last_became_peered":"2024-02-17T14:28:03.628781+0000","last_unstale":"2024-02-17T14:28:51.763773+0000","last_undegraded":"2024-02-17T14:28:51.763773+0000","last_fullsized":"2024-02-17T14:28:51.763773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.773314+0000","last_change":"2024-02-17T14:28:51.773314+0000","last_active":"2024-02-17T14:28:51.773314+0000","last_peered":"2024-02-17T14:28:51.773314+0000","last_clean":"2024-02-17T14:28:51.773314+0000","last_became_active":"2024-02-17T14:28:51.772895+0000","last_became_peered":"2024-02-17T14:28:51.772895+0000","last_unstale":"2024-02-17T14:28:51.773314+0000","last_undegraded":"2024-02-17T14:28:51.773314+0000","last_fullsized":"2024-02-17T14:28:51.773314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:38:01.087874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.877102+0000","last_change":"2024-02-17T14:28:03.627122+0000","last_active":"2024-02-17T14:28:51.877102+0000","last_peered":"2024-02-17T14:28:51.877102+0000","last_clean":"2024-02-17T14:28:51.877102+0000","last_became_active":"2024-02-17T14:28:03.626738+0000","last_became_peered":"2024-02-17T14:28:03.626738+0000","last_unstale":"2024-02-17T14:28:51.877102+0000","last_undegraded":"2024-02-17T14:28:51.877102+0000","last_fullsized":"2024-02-17T14:28:51.877102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767120+0000","last_change":"2024-02-17T14:28:03.631182+0000","last_active":"2024-02-17T14:28:51.767120+0000","last_peered":"2024-02-17T14:28:51.767120+0000","last_clean":"2024-02-17T14:28:51.767120+0000","last_became_active":"2024-02-17T14:28:03.630705+0000","last_became_peered":"2024-02-17T14:28:03.630705+0000","last_unstale":"2024-02-17T14:28:51.767120+0000","last_undegraded":"2024-02-17T14:28:51.767120+0000","last_fullsized":"2024-02-17T14:28:51.767120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764896+0000","last_change":"2024-02-17T14:28:03.631731+0000","last_active":"2024-02-17T14:28:51.764896+0000","last_peered":"2024-02-17T14:28:51.764896+0000","last_clean":"2024-02-17T14:28:51.764896+0000","last_became_active":"2024-02-17T14:28:03.631476+0000","last_became_peered":"2024-02-17T14:28:03.631476+0000","last_unstale":"2024-02-17T14:28:51.764896+0000","last_undegraded":"2024-02-17T14:28:51.764896+0000","last_fullsized":"2024-02-17T14:28:51.764896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765932+0000","last_change":"2024-02-17T14:28:03.638716+0000","last_active":"2024-02-17T14:28:51.765932+0000","last_peered":"2024-02-17T14:28:51.765932+0000","last_clean":"2024-02-17T14:28:51.765932+0000","last_became_active":"2024-02-17T14:28:03.638442+0000","last_became_peered":"2024-02-17T14:28:03.638442+0000","last_unstale":"2024-02-17T14:28:51.765932+0000","last_undegraded":"2024-02-17T14:28:51.765932+0000","last_fullsized":"2024-02-17T14:28:51.765932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.767252+0000","last_change":"2024-02-17T14:28:03.630945+0000","last_active":"2024-02-17T14:28:51.767252+0000","last_peered":"2024-02-17T14:28:51.767252+0000","last_clean":"2024-02-17T14:28:51.767252+0000","last_became_active":"2024-02-17T14:28:03.630676+0000","last_became_peered":"2024-02-17T14:28:03.630676+0000","last_unstale":"2024-02-17T14:28:51.767252+0000","last_undegraded":"2024-02-17T14:28:51.767252+0000","last_fullsized":"2024-02-17T14:28:51.767252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768565+0000","last_change":"2024-02-17T14:28:03.627202+0000","last_active":"2024-02-17T14:28:51.768565+0000","last_peered":"2024-02-17T14:28:51.768565+0000","last_clean":"2024-02-17T14:28:51.768565+0000","last_became_active":"2024-02-17T14:28:03.626848+0000","last_became_peered":"2024-02-17T14:28:03.626848+0000","last_unstale":"2024-02-17T14:28:51.768565+0000","last_undegraded":"2024-02-17T14:28:51.768565+0000","last_fullsized":"2024-02-17T14:28:51.768565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:34:21.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766296+0000","last_change":"2024-02-17T14:28:03.627493+0000","last_active":"2024-02-17T14:28:51.766296+0000","last_peered":"2024-02-17T14:28:51.766296+0000","last_clean":"2024-02-17T14:28:51.766296+0000","last_became_active":"2024-02-17T14:28:03.626450+0000","last_became_peered":"2024-02-17T14:28:03.626450+0000","last_unstale":"2024-02-17T14:28:51.766296+0000","last_undegraded":"2024-02-17T14:28:51.766296+0000","last_fullsized":"2024-02-17T14:28:51.766296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:07.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768712+0000","last_change":"2024-02-17T14:28:03.639610+0000","last_active":"2024-02-17T14:28:51.768712+0000","last_peered":"2024-02-17T14:28:51.768712+0000","last_clean":"2024-02-17T14:28:51.768712+0000","last_became_active":"2024-02-17T14:28:03.639330+0000","last_became_peered":"2024-02-17T14:28:03.639330+0000","last_unstale":"2024-02-17T14:28:51.768712+0000","last_undegraded":"2024-02-17T14:28:51.768712+0000","last_fullsized":"2024-02-17T14:28:51.768712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:23.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876800+0000","last_change":"2024-02-17T14:28:03.641774+0000","last_active":"2024-02-17T14:28:51.876800+0000","last_peered":"2024-02-17T14:28:51.876800+0000","last_clean":"2024-02-17T14:28:51.876800+0000","last_became_active":"2024-02-17T14:28:03.641485+0000","last_became_peered":"2024-02-17T14:28:03.641485+0000","last_unstale":"2024-02-17T14:28:51.876800+0000","last_undegraded":"2024-02-17T14:28:51.876800+0000","last_fullsized":"2024-02-17T14:28:51.876800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765227+0000","last_change":"2024-02-17T14:28:03.630129+0000","last_active":"2024-02-17T14:28:51.765227+0000","last_peered":"2024-02-17T14:28:51.765227+0000","last_clean":"2024-02-17T14:28:51.765227+0000","last_became_active":"2024-02-17T14:28:03.629841+0000","last_became_peered":"2024-02-17T14:28:03.629841+0000","last_unstale":"2024-02-17T14:28:51.765227+0000","last_undegraded":"2024-02-17T14:28:51.765227+0000","last_fullsized":"2024-02-17T14:28:51.765227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061047+0000","last_change":"2024-02-17T14:28:03.642676+0000","last_active":"2024-02-17T14:28:52.061047+0000","last_peered":"2024-02-17T14:28:52.061047+0000","last_clean":"2024-02-17T14:28:52.061047+0000","last_became_active":"2024-02-17T14:28:03.642150+0000","last_became_peered":"2024-02-17T14:28:03.642150+0000","last_unstale":"2024-02-17T14:28:52.061047+0000","last_undegraded":"2024-02-17T14:28:52.061047+0000","last_fullsized":"2024-02-17T14:28:52.061047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:28.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764322+0000","last_change":"2024-02-17T14:28:03.632127+0000","last_active":"2024-02-17T14:28:51.764322+0000","last_peered":"2024-02-17T14:28:51.764322+0000","last_clean":"2024-02-17T14:28:51.764322+0000","last_became_active":"2024-02-17T14:28:03.631844+0000","last_became_peered":"2024-02-17T14:28:03.631844+0000","last_unstale":"2024-02-17T14:28:51.764322+0000","last_undegraded":"2024-02-17T14:28:51.764322+0000","last_fullsized":"2024-02-17T14:28:51.764322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.581819+0000","last_change":"2024-02-17T14:28:52.062031+0000","last_active":"2024-02-17T14:28:52.581819+0000","last_peered":"2024-02-17T14:28:52.581819+0000","last_clean":"2024-02-17T14:28:52.581819+0000","last_became_active":"2024-02-17T14:28:52.061682+0000","last_became_peered":"2024-02-17T14:28:52.061682+0000","last_unstale":"2024-02-17T14:28:52.581819+0000","last_undegraded":"2024-02-17T14:28:52.581819+0000","last_fullsized":"2024-02-17T14:28:52.581819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768418+0000","last_change":"2024-02-17T14:28:03.628626+0000","last_active":"2024-02-17T14:28:51.768418+0000","last_peered":"2024-02-17T14:28:51.768418+0000","last_clean":"2024-02-17T14:28:51.768418+0000","last_became_active":"2024-02-17T14:28:03.628343+0000","last_became_peered":"2024-02-17T14:28:03.628343+0000","last_unstale":"2024-02-17T14:28:51.768418+0000","last_undegraded":"2024-02-17T14:28:51.768418+0000","last_fullsized":"2024-02-17T14:28:51.768418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:43:38.555949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765119+0000","last_change":"2024-02-17T14:28:03.635610+0000","last_active":"2024-02-17T14:28:51.765119+0000","last_peered":"2024-02-17T14:28:51.765119+0000","last_clean":"2024-02-17T14:28:51.765119+0000","last_became_active":"2024-02-17T14:28:03.635340+0000","last_became_peered":"2024-02-17T14:28:03.635340+0000","last_unstale":"2024-02-17T14:28:51.765119+0000","last_undegraded":"2024-02-17T14:28:51.765119+0000","last_fullsized":"2024-02-17T14:28:51.765119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:02.574885+0000","last_change":"2024-02-17T14:30:02.574905+0000","last_active":"2024-02-17T14:30:02.574885+0000","last_peered":"2024-02-17T14:30:02.574885+0000","last_clean":"2024-02-17T14:30:02.574885+0000","last_became_active":"2024-02-17T14:28:03.632273+0000","last_became_peered":"2024-02-17T14:28:03.632273+0000","last_unstale":"2024-02-17T14:30:02.574885+0000","last_undegraded":"2024-02-17T14:30:02.574885+0000","last_fullsized":"2024-02-17T14:30:02.574885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:02.574820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:02.574820+0000","last_clean_scrub_stamp":"2024-02-17T14:30:02.574820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:00.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766633+0000","last_change":"2024-02-17T14:28:03.631678+0000","last_active":"2024-02-17T14:28:51.766633+0000","last_peered":"2024-02-17T14:28:51.766633+0000","last_clean":"2024-02-17T14:28:51.766633+0000","last_became_active":"2024-02-17T14:28:03.631431+0000","last_became_peered":"2024-02-17T14:28:03.631431+0000","last_unstale":"2024-02-17T14:28:51.766633+0000","last_undegraded":"2024-02-17T14:28:51.766633+0000","last_fullsized":"2024-02-17T14:28:51.766633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:37.145031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768398+0000","last_change":"2024-02-17T14:28:03.631661+0000","last_active":"2024-02-17T14:28:51.768398+0000","last_peered":"2024-02-17T14:28:51.768398+0000","last_clean":"2024-02-17T14:28:51.768398+0000","last_became_active":"2024-02-17T14:28:03.631379+0000","last_became_peered":"2024-02-17T14:28:03.631379+0000","last_unstale":"2024-02-17T14:28:51.768398+0000","last_undegraded":"2024-02-17T14:28:51.768398+0000","last_fullsized":"2024-02-17T14:28:51.768398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:03.242976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.764990+0000","last_change":"2024-02-17T14:28:03.635522+0000","last_active":"2024-02-17T14:28:51.764990+0000","last_peered":"2024-02-17T14:28:51.764990+0000","last_clean":"2024-02-17T14:28:51.764990+0000","last_became_active":"2024-02-17T14:28:03.635254+0000","last_became_peered":"2024-02-17T14:28:03.635254+0000","last_unstale":"2024-02-17T14:28:51.764990+0000","last_undegraded":"2024-02-17T14:28:51.764990+0000","last_fullsized":"2024-02-17T14:28:51.764990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:23.204305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765844+0000","last_change":"2024-02-17T14:28:03.635588+0000","last_active":"2024-02-17T14:28:51.765844+0000","last_peered":"2024-02-17T14:28:51.765844+0000","last_clean":"2024-02-17T14:28:51.765844+0000","last_became_active":"2024-02-17T14:28:03.635312+0000","last_became_peered":"2024-02-17T14:28:03.635312+0000","last_unstale":"2024-02-17T14:28:51.765844+0000","last_undegraded":"2024-02-17T14:28:51.765844+0000","last_fullsized":"2024-02-17T14:28:51.765844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:50:23.632990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061122+0000","last_change":"2024-02-17T14:28:03.646624+0000","last_active":"2024-02-17T14:28:52.061122+0000","last_peered":"2024-02-17T14:28:52.061122+0000","last_clean":"2024-02-17T14:28:52.061122+0000","last_became_active":"2024-02-17T14:28:03.646337+0000","last_became_peered":"2024-02-17T14:28:03.646337+0000","last_unstale":"2024-02-17T14:28:52.061122+0000","last_undegraded":"2024-02-17T14:28:52.061122+0000","last_fullsized":"2024-02-17T14:28:52.061122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:10.836577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.766486+0000","last_change":"2024-02-17T14:28:03.635018+0000","last_active":"2024-02-17T14:28:51.766486+0000","last_peered":"2024-02-17T14:28:51.766486+0000","last_clean":"2024-02-17T14:28:51.766486+0000","last_became_active":"2024-02-17T14:28:03.634751+0000","last_became_peered":"2024-02-17T14:28:03.634751+0000","last_unstale":"2024-02-17T14:28:51.766486+0000","last_undegraded":"2024-02-17T14:28:51.766486+0000","last_fullsized":"2024-02-17T14:28:51.766486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:55.385711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060492+0000","last_change":"2024-02-17T14:28:03.641708+0000","last_active":"2024-02-17T14:28:52.060492+0000","last_peered":"2024-02-17T14:28:52.060492+0000","last_clean":"2024-02-17T14:28:52.060492+0000","last_became_active":"2024-02-17T14:28:03.641260+0000","last_became_peered":"2024-02-17T14:28:03.641260+0000","last_unstale":"2024-02-17T14:28:52.060492+0000","last_undegraded":"2024-02-17T14:28:52.060492+0000","last_fullsized":"2024-02-17T14:28:52.060492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:53:18.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.768705+0000","last_change":"2024-02-17T14:28:03.628239+0000","last_active":"2024-02-17T14:28:51.768705+0000","last_peered":"2024-02-17T14:28:51.768705+0000","last_clean":"2024-02-17T14:28:51.768705+0000","last_became_active":"2024-02-17T14:28:03.627918+0000","last_became_peered":"2024-02-17T14:28:03.627918+0000","last_unstale":"2024-02-17T14:28:51.768705+0000","last_undegraded":"2024-02-17T14:28:51.768705+0000","last_fullsized":"2024-02-17T14:28:51.768705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:28:58.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.060535+0000","last_change":"2024-02-17T14:28:03.641192+0000","last_active":"2024-02-17T14:28:52.060535+0000","last_peered":"2024-02-17T14:28:52.060535+0000","last_clean":"2024-02-17T14:28:52.060535+0000","last_became_active":"2024-02-17T14:28:03.640873+0000","last_became_peered":"2024-02-17T14:28:03.640873+0000","last_unstale":"2024-02-17T14:28:52.060535+0000","last_undegraded":"2024-02-17T14:28:52.060535+0000","last_fullsized":"2024-02-17T14:28:52.060535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:59:21.635402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.581771+0000","last_change":"2024-02-17T14:28:51.768174+0000","last_active":"2024-02-17T14:28:52.581771+0000","last_peered":"2024-02-17T14:28:52.581771+0000","last_clean":"2024-02-17T14:28:52.581771+0000","last_became_active":"2024-02-17T14:28:51.767928+0000","last_became_peered":"2024-02-17T14:28:51.767928+0000","last_unstale":"2024-02-17T14:28:52.581771+0000","last_undegraded":"2024-02-17T14:28:52.581771+0000","last_fullsized":"2024-02-17T14:28:52.581771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.876953+0000","last_change":"2024-02-17T14:28:03.628223+0000","last_active":"2024-02-17T14:28:51.876953+0000","last_peered":"2024-02-17T14:28:51.876953+0000","last_clean":"2024-02-17T14:28:51.876953+0000","last_became_active":"2024-02-17T14:28:03.627978+0000","last_became_peered":"2024-02-17T14:28:03.627978+0000","last_unstale":"2024-02-17T14:28:51.876953+0000","last_undegraded":"2024-02-17T14:28:51.876953+0000","last_fullsized":"2024-02-17T14:28:51.876953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:51.765424+0000","last_change":"2024-02-17T14:28:03.631742+0000","last_active":"2024-02-17T14:28:51.765424+0000","last_peered":"2024-02-17T14:28:51.765424+0000","last_clean":"2024-02-17T14:28:51.765424+0000","last_became_active":"2024-02-17T14:28:03.631493+0000","last_became_peered":"2024-02-17T14:28:03.631493+0000","last_unstale":"2024-02-17T14:28:51.765424+0000","last_undegraded":"2024-02-17T14:28:51.765424+0000","last_fullsized":"2024-02-17T14:28:51.765424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:28:52.061037+0000","last_change":"2024-02-17T14:28:03.641525+0000","last_active":"2024-02-17T14:28:52.061037+0000","last_peered":"2024-02-17T14:28:52.061037+0000","last_clean":"2024-02-17T14:28:52.061037+0000","last_became_active":"2024-02-17T14:28:03.641154+0000","last_became_peered":"2024-02-17T14:28:03.641154+0000","last_unstale":"2024-02-17T14:28:52.061037+0000","last_undegraded":"2024-02-17T14:28:52.061037+0000","last_fullsized":"2024-02-17T14:28:52.061037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:03.046948+0000","last_clean_scrub_stamp":"2024-02-17T14:28:03.046948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:08.162837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8923,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":17846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":709990,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.39700000000000002}]},{"osd":1,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.48699999999999999}]},{"osd":2,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.54300000000000004}]},{"osd":3,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.42799999999999999}]},{"osd":4,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63300000000000001}]},{"osd":5,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Feb 17 14:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.66300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.755,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.443,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57999999999999996}]},{"osd":1,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73599999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.64100000000000001}]},{"osd":2,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.74099999999999999,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.67000000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.66100000000000003}]},{"osd":3,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.68799999999999994,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78100000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.55000000000000004}]},{"osd":4,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.32900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63800000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67300000000000004,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.498}]},{"osd":5,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69299999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73699999999999999,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.70499999999999996}]},{"osd":7,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71999999999999997,"5min":0.754,"15min":0.754},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68500000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.63100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.51800000000000002}]},{"osd":1,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56699999999999995}]},{"osd":3,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.499}]},{"osd":4,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.58499999999999996}]},{"osd":6,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.437},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.54400000000000004}]},{"osd":7,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":119166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.61299999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.432,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.66100000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65800000000000003,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.47999999999999998}]},{"osd":2,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66400000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.65500000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70099999999999996,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70399999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48799999999999999,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68799999999999994,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.376}]},{"osd":6,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.33700000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.64800000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.40400000000000003}]},{"osd":7,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76500000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.501},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70199999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.48999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39100000000000001,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50800000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.27500000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.433,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.311}]},{"osd":1,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.252},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.254,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56999999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.39400000000000002}]},{"osd":2,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.39700000000000002,"15min":0.39100000000000001},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60099999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.44,"15min":0.442},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59499999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77500000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76900000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35199999999999998}]},{"osd":5,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51400000000000001}]},{"osd":6,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.44900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.44800000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.72999999999999998,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.44800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":119040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.315}]},{"osd":1,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.29699999999999999}]},{"osd":4,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72199999999999998}]},{"osd":5,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.505}]},{"osd":6,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.74099999999999999}]},{"osd":7,"last update":"Sat Feb 17 14:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":119200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.307},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.28899999999999998}]},{"osd":2,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.37},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.34499999999999997}]},{"osd":4,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.48299999999999998}]},{"osd":5,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.44500000000000001}]},{"osd":6,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.432},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46000000000000002}]},{"osd":7,"last update":"Sat Feb 17 14:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":710046,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34799999999999998,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.34300000000000003,"15min":0.33900000000000002},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.34100000000000003}]},{"osd":2,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.35899999999999999,"15min":0.35299999999999998},"min":{"1min":0.28100000000000003,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.373},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35899999999999999,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.41899999999999998}]},{"osd":3,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.379},"min":{"1min":0.25900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39300000000000002},"min":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.39000000000000001}]},{"osd":4,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78900000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70999999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.623,"15min":0.628},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79700000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56399999999999995}]},{"osd":6,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.73499999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70799999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58499999999999996}]},{"osd":7,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.47399999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.76600000000000001,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63,"15min":0.628},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.752,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":8125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":8125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T14:30:05.056 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.056 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.056 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.056 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.057 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.057 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.057 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.057 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.057 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.057 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.057 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.058 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.058 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.058 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.058 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.058 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.058 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.059 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.059 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.059 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.059 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.059 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.059 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.059 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.060 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.060 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.060 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.060 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.060 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.060 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.061 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.061 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.061 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.061 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.061 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.061 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.062 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.062 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.062 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.062 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.062 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.062 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.062 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.063 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.063 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.063 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.063 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-17T14:27:59.037303+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.063 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.063 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.063 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.064 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.064 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.064 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.064 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.064 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.064 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.065 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.065 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.065 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.065 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.065 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.065 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.066 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.066 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.066 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.066 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.066 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.066 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.067 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.067 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.067 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.067 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.067 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.067 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.067 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.068 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.068 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.068 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.068 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.068 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.069 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.069 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.069 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.069 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.069 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.069 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.070 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.070 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.070 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.070 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.070 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.070 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.071 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.071 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-02-17T14:28:02.044547+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=2, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.071 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.071 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.071 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.071 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.071 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.072 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.072 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.072 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.072 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.072 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.073 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.073 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.073 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.073 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.073 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.073 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.073 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.074 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.074 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.074 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.074 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.074 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.074 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.075 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.075 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.075 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.075 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.075 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.075 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.075 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.076 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.076 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.076 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-17T14:28:03.046948+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=3, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:05.076 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-17T14:30:06.436 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:30:06.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:30:25.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T14:30:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.190+0000 7fa3a3d4f640 1 Processor -- start 2024-02-17T14:30:25.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.190+0000 7fa3a3d4f640 1 -- start start 2024-02-17T14:30:25.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a3d4f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c06f370 0x7fa39c150630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:25.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a3d4f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c0730f0 con 0x7fa39c0b1b50 2024-02-17T14:30:25.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a3d4f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c06f7a0 con 0x7fa39c0b3f90 2024-02-17T14:30:25.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a3d4f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0b1f30 con 0x7fa39c06f370 2024-02-17T14:30:25.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a1aeb640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa39c0b1b50 0x7fa39c0729e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:45620/0 (socket says 172.21.15.134:45620) 2024-02-17T14:30:25.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a1aeb640 1 -- 172.21.15.134:0/1356683780 learned_addr learned my addr 172.21.15.134:0/1356683780 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:25.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a22ec640 1 --2- 172.21.15.134:0/1356683780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c06f370 0x7fa39c150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:25.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313569107 0 0) 0x7fa398001110 con 0x7fa39c0b1b50 2024-02-17T14:30:25.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa388003520 con 0x7fa39c0b1b50 2024-02-17T14:30:25.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2741669631 0 0) 0x7fa388003520 con 0x7fa39c0b1b50 2024-02-17T14:30:25.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c06f370 msgr2=0x7fa39c150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:25.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a0ae9640 1 --2- 172.21.15.134:0/1356683780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c06f370 0x7fa39c150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:25.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 >> v1:172.21.15.142:6789/0 conn(0x7fa39c0b3f90 legacy=0x7fa39c13eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c06fc70 con 0x7fa39c0b1b50 2024-02-17T14:30:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7fa398001800 con 0x7fa39c0b1b50 2024-02-17T14:30:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 >> v1:172.21.15.134:6789/0 conn(0x7fa39c0b1b50 legacy=0x7fa39c0729e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a0ae9640 1 --2- 172.21.15.134:0/1356683780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c06f370 0x7fa3880039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.191+0000 7fa3a0ae9640 1 --2- 172.21.15.134:0/1356683780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa388003f20 0x7fa3880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.192+0000 7fa3a0ae9640 1 --2- 172.21.15.134:0/1356683780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa388004d00 0x7fa388005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:25.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.192+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0b1f30 con 0x7fa388004d00 2024-02-17T14:30:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.192+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38800bbc0 con 0x7fa388003f20 2024-02-17T14:30:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.192+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38800bd80 con 0x7fa39c06f370 2024-02-17T14:30:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.192+0000 7fa3a22ec640 1 --2- 172.21.15.134:0/1356683780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa388004d00 0x7fa388005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.192+0000 7fa3a1aeb640 1 --2- 172.21.15.134:0/1356683780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c06f370 0x7fa3880039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.192+0000 7fa3a12ea640 1 --2- 172.21.15.134:0/1356683780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa388003f20 0x7fa3880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.192+0000 7fa3a22ec640 1 -- 172.21.15.134:0/1356683780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c06f370 msgr2=0x7fa3880039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.192+0000 7fa3a22ec640 1 --2- 172.21.15.134:0/1356683780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c06f370 0x7fa3880039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.192+0000 7fa3a22ec640 1 -- 172.21.15.134:0/1356683780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa388003f20 msgr2=0x7fa3880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:25.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.192+0000 7fa3a22ec640 1 --2- 172.21.15.134:0/1356683780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa388003f20 0x7fa3880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.192+0000 7fa3a22ec640 1 -- 172.21.15.134:0/1356683780 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa388003520 con 0x7fa388004d00 2024-02-17T14:30:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.193+0000 7fa3a22ec640 1 --2- 172.21.15.134:0/1356683780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa388004d00 0x7fa388005180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa394009fc0 tx=0x7fa3880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4ae8cc22cb737b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.193+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39402cc20 con 0x7fa388004d00 2024-02-17T14:30:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.193+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39400f040 con 0x7fa388004d00 2024-02-17T14:30:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.193+0000 7fa3a0ae9640 1 -- 172.21.15.134:0/1356683780 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394034440 con 0x7fa388004d00 2024-02-17T14:30:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.193+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/1356683780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa388004d00 msgr2=0x7fa388005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.193+0000 7fa3a3d4f640 1 --2- 172.21.15.134:0/1356683780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa388004d00 0x7fa388005180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa394009fc0 tx=0x7fa3880057f0 comp rx=0 tx=0).stop 2024-02-17T14:30:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.193+0000 7fa3a22ec640 1 -- 172.21.15.134:0/1356683780 reap_dead start 2024-02-17T14:30:25.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.193+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/1356683780 shutdown_connections 2024-02-17T14:30:25.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.193+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/1356683780 >> 172.21.15.134:0/1356683780 conn(0x7fa39c0b8270 msgr2=0x7fa39c0b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:25.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.193+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/1356683780 shutdown_connections 2024-02-17T14:30:25.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.193+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/1356683780 wait complete. 2024-02-17T14:30:25.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.194+0000 7fa3a3d4f640 1 Processor -- start 2024-02-17T14:30:25.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.194+0000 7fa3a3d4f640 1 -- start start 2024-02-17T14:30:25.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a3d4f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa388004d00 0x7fa39c13d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:25.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a3d4f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c140620 0x7fa39c0b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:25.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a3d4f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa39c0b6970 0x7fa39c1e0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:25.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a3d4f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c140060 con 0x7fa39c0b6970 2024-02-17T14:30:25.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a3d4f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c13faa0 con 0x7fa388004d00 2024-02-17T14:30:25.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a3d4f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c1345a0 con 0x7fa39c140620 2024-02-17T14:30:25.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a22ec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa39c0b6970 0x7fa39c1e0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:25.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a22ec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa39c0b6970 0x7fa39c1e0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44242/0 (socket says 172.21.15.134:44242) 2024-02-17T14:30:25.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a22ec640 1 -- 172.21.15.134:0/2416350889 learned_addr learned my addr 172.21.15.134:0/2416350889 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:25.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a12ea640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c140620 0x7fa39c0b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:25.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a1aeb640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa388004d00 0x7fa39c13d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:25.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a22ec640 1 -- 172.21.15.134:0/2416350889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c140620 msgr2=0x7fa39c0b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:25.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a22ec640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c140620 0x7fa39c0b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:25.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a22ec640 1 -- 172.21.15.134:0/2416350889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa388004d00 msgr2=0x7fa39c13d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:25.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a22ec640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa388004d00 0x7fa39c13d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:25.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.195+0000 7fa3a22ec640 1 -- 172.21.15.134:0/2416350889 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c13fcf0 con 0x7fa39c0b6970 2024-02-17T14:30:25.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.196+0000 7fa3a12ea640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c140620 0x7fa39c0b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:30:25.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.196+0000 7fa3a22ec640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa39c0b6970 0x7fa39c1e0040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa394037040 tx=0x7fa394009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:25.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.196+0000 7fa3927fc640 1 -- 172.21.15.134:0/2416350889 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394034b50 con 0x7fa39c0b6970 2024-02-17T14:30:25.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.196+0000 7fa3927fc640 1 -- 172.21.15.134:0/2416350889 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa394034cb0 con 0x7fa39c0b6970 2024-02-17T14:30:25.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.196+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/2416350889 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c140d30 con 0x7fa39c0b6970 2024-02-17T14:30:25.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.196+0000 7fa3927fc640 1 -- 172.21.15.134:0/2416350889 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394003bd0 con 0x7fa39c0b6970 2024-02-17T14:30:25.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.196+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/2416350889 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c140a20 con 0x7fa39c0b6970 2024-02-17T14:30:25.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.197+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/2416350889 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39c067b70 con 0x7fa39c0b6970 2024-02-17T14:30:25.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.197+0000 7fa3927fc640 1 -- 172.21.15.134:0/2416350889 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa39403e440 con 0x7fa39c0b6970 2024-02-17T14:30:25.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.198+0000 7fa3927fc640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa38006b840 0x7fa38006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:25.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.198+0000 7fa3927fc640 1 -- 172.21.15.134:0/2416350889 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa3940ac480 con 0x7fa39c0b6970 2024-02-17T14:30:25.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.198+0000 7fa3a1aeb640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa38006b840 0x7fa38006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:25.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.198+0000 7fa3a1aeb640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa38006b840 0x7fa38006dd00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa3980016c0 tx=0x7fa398009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:25.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.202+0000 7fa3927fc640 1 -- 172.21.15.134:0/2416350889 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa394076b30 con 0x7fa39c0b6970 2024-02-17T14:30:25.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.369+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/2416350889 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa39c1382d0 con 0x7fa38006b840 2024-02-17T14:30:25.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.378+0000 7fa3927fc640 1 -- 172.21.15.134:0/2416350889 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371140 (secure 0 0 0) 0x7fa39c1382d0 con 0x7fa38006b840 2024-02-17T14:30:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:30:25.385 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-02-17T14:30:25.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.382+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/2416350889 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa38006b840 msgr2=0x7fa38006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:25.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.382+0000 7fa3a3d4f640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa38006b840 0x7fa38006dd00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa3980016c0 tx=0x7fa398009040 comp rx=0 tx=0).stop 2024-02-17T14:30:25.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.382+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/2416350889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa39c0b6970 msgr2=0x7fa39c1e0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:25.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.382+0000 7fa3a3d4f640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa39c0b6970 0x7fa39c1e0040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa394037040 tx=0x7fa394009750 comp rx=0 tx=0).stop 2024-02-17T14:30:25.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.382+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/2416350889 shutdown_connections 2024-02-17T14:30:25.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.382+0000 7fa3a3d4f640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa38006b840 0x7fa38006dd00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:25.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.382+0000 7fa3a3d4f640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa39c0b6970 0x7fa39c1e0040 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:25.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.382+0000 7fa3a3d4f640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa39c140620 0x7fa39c0b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:25.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.382+0000 7fa3a3d4f640 1 --2- 172.21.15.134:0/2416350889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa388004d00 0x7fa39c13d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:25.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.382+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/2416350889 >> 172.21.15.134:0/2416350889 conn(0x7fa39c0b8270 msgr2=0x7fa39c13e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:25.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.382+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/2416350889 shutdown_connections 2024-02-17T14:30:25.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:25.382+0000 7fa3a3d4f640 1 -- 172.21.15.134:0/2416350889 wait complete. 2024-02-17T14:30:25.393 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-02-17T14:30:24.600627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599291,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":219,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218600,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756120,"statfs":{"total":773094113280,"available":772870266880,"internally_reserved":0,"allocated":2531328,"data_stored":2150902,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003719"},"pg_stats":[{"pgid":"2.1f","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:04.510878+0000","last_change":"2024-02-17T14:30:04.510878+0000","last_active":"2024-02-17T14:30:04.510878+0000","last_peered":"2024-02-17T14:30:04.510878+0000","last_clean":"2024-02-17T14:30:04.510878+0000","last_became_active":"2024-02-17T14:28:03.068714+0000","last_became_peered":"2024-02-17T14:28:03.068714+0000","last_unstale":"2024-02-17T14:30:04.510878+0000","last_undegraded":"2024-02-17T14:30:04.510878+0000","last_fullsized":"2024-02-17T14:30:04.510878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-17T14:30:04.510740+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-17T14:30:04.510740+0000","last_clean_scrub_stamp":"2024-02-17T14:30:04.510740+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:22:37.125845+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:03.154590+0000","last_change":"2024-02-17T14:30:03.154590+0000","last_active":"2024-02-17T14:30:03.154590+0000","last_peered":"2024-02-17T14:30:03.154590+0000","last_clean":"2024-02-17T14:30:03.154590+0000","last_became_active":"2024-02-17T14:28:03.631462+0000","last_became_peered":"2024-02-17T14:28:03.631462+0000","last_unstale":"2024-02-17T14:30:03.154590+0000","last_undegraded":"2024-02-17T14:30:03.154590+0000","last_fullsized":"2024-02-17T14:30:03.154590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:03.154491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:03.154491+0000","last_clean_scrub_stamp":"2024-02-17T14:30:03.154491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:19:10.507514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:22.159738+0000","last_change":"2024-02-17T14:30:22.159768+0000","last_active":"2024-02-17T14:30:22.159738+0000","last_peered":"2024-02-17T14:30:22.159738+0000","last_clean":"2024-02-17T14:30:22.159738+0000","last_became_active":"2024-02-17T14:28:07.849871+0000","last_became_peered":"2024-02-17T14:28:07.849871+0000","last_unstale":"2024-02-17T14:30:22.159738+0000","last_undegraded":"2024-02-17T14:30:22.159738+0000","last_fullsized":"2024-02-17T14:30:22.159738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:22.159643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:22.159643+0000","last_clean_scrub_stamp":"2024-02-17T14:30:22.159643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:19:58.628043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.105154+0000","last_change":"2024-02-17T14:30:08.105184+0000","last_active":"2024-02-17T14:30:08.105154+0000","last_peered":"2024-02-17T14:30:08.105154+0000","last_clean":"2024-02-17T14:30:08.105154+0000","last_became_active":"2024-02-17T14:28:03.068978+0000","last_became_peered":"2024-02-17T14:28:03.068978+0000","last_unstale":"2024-02-17T14:30:08.105154+0000","last_undegraded":"2024-02-17T14:30:08.105154+0000","last_fullsized":"2024-02-17T14:30:08.105154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-02-17T14:30:08.105064+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-02-17T14:30:08.105064+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.105064+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:47.648353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.516392+0000","last_change":"2024-02-17T14:30:09.516392+0000","last_active":"2024-02-17T14:30:09.516392+0000","last_peered":"2024-02-17T14:30:09.516392+0000","last_clean":"2024-02-17T14:30:09.516392+0000","last_became_active":"2024-02-17T14:28:03.630517+0000","last_became_peered":"2024-02-17T14:28:03.630517+0000","last_unstale":"2024-02-17T14:30:09.516392+0000","last_undegraded":"2024-02-17T14:30:09.516392+0000","last_fullsized":"2024-02-17T14:30:09.516392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.516283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.516283+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.516283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:03:44.447279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.661527+0000","last_change":"2024-02-17T14:30:09.661550+0000","last_active":"2024-02-17T14:30:09.661527+0000","last_peered":"2024-02-17T14:30:09.661527+0000","last_clean":"2024-02-17T14:30:09.661527+0000","last_became_active":"2024-02-17T14:28:07.644458+0000","last_became_peered":"2024-02-17T14:28:07.644458+0000","last_unstale":"2024-02-17T14:30:09.661527+0000","last_undegraded":"2024-02-17T14:30:09.661527+0000","last_fullsized":"2024-02-17T14:30:09.661527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.661429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.661429+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.661429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:18:19.545350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.886286+0000","last_change":"2024-02-17T14:30:06.886314+0000","last_active":"2024-02-17T14:30:06.886286+0000","last_peered":"2024-02-17T14:30:06.886286+0000","last_clean":"2024-02-17T14:30:06.886286+0000","last_became_active":"2024-02-17T14:28:03.070955+0000","last_became_peered":"2024-02-17T14:28:03.070955+0000","last_unstale":"2024-02-17T14:30:06.886286+0000","last_undegraded":"2024-02-17T14:30:06.886286+0000","last_fullsized":"2024-02-17T14:30:06.886286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-02-17T14:30:06.886201+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-02-17T14:30:06.886201+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.886201+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:30.433639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:04.447148+0000","last_change":"2024-02-17T14:30:04.447173+0000","last_active":"2024-02-17T14:30:04.447148+0000","last_peered":"2024-02-17T14:30:04.447148+0000","last_clean":"2024-02-17T14:30:04.447148+0000","last_became_active":"2024-02-17T14:28:03.627865+0000","last_became_peered":"2024-02-17T14:28:03.627865+0000","last_unstale":"2024-02-17T14:30:04.447148+0000","last_undegraded":"2024-02-17T14:30:04.447148+0000","last_fullsized":"2024-02-17T14:30:04.447148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:04.447064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:04.447064+0000","last_clean_scrub_stamp":"2024-02-17T14:30:04.447064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:27.994502+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.644842+0000","last_change":"2024-02-17T14:30:12.644867+0000","last_active":"2024-02-17T14:30:12.644842+0000","last_peered":"2024-02-17T14:30:12.644842+0000","last_clean":"2024-02-17T14:30:12.644842+0000","last_became_active":"2024-02-17T14:28:07.648936+0000","last_became_peered":"2024-02-17T14:28:07.648936+0000","last_unstale":"2024-02-17T14:30:12.644842+0000","last_undegraded":"2024-02-17T14:30:12.644842+0000","last_fullsized":"2024-02-17T14:30:12.644842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.644757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.644757+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.644757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:30:15.541090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.983791+0000","last_change":"2024-02-17T14:30:10.983824+0000","last_active":"2024-02-17T14:30:10.983791+0000","last_peered":"2024-02-17T14:30:10.983791+0000","last_clean":"2024-02-17T14:30:10.983791+0000","last_became_active":"2024-02-17T14:28:03.074490+0000","last_became_peered":"2024-02-17T14:28:03.074490+0000","last_unstale":"2024-02-17T14:30:10.983791+0000","last_undegraded":"2024-02-17T14:30:10.983791+0000","last_fullsized":"2024-02-17T14:30:10.983791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-02-17T14:30:10.983707+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-02-17T14:30:10.983707+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.983707+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:03:45.914704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.367661+0000","last_change":"2024-02-17T14:30:12.367681+0000","last_active":"2024-02-17T14:30:12.367661+0000","last_peered":"2024-02-17T14:30:12.367661+0000","last_clean":"2024-02-17T14:30:12.367661+0000","last_became_active":"2024-02-17T14:28:03.627675+0000","last_became_peered":"2024-02-17T14:28:03.627675+0000","last_unstale":"2024-02-17T14:30:12.367661+0000","last_undegraded":"2024-02-17T14:30:12.367661+0000","last_fullsized":"2024-02-17T14:30:12.367661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.367585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.367585+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.367585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:23.584519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:13.664188+0000","last_change":"2024-02-17T14:30:13.664219+0000","last_active":"2024-02-17T14:30:13.664188+0000","last_peered":"2024-02-17T14:30:13.664188+0000","last_clean":"2024-02-17T14:30:13.664188+0000","last_became_active":"2024-02-17T14:28:07.651946+0000","last_became_peered":"2024-02-17T14:28:07.651946+0000","last_unstale":"2024-02-17T14:30:13.664188+0000","last_undegraded":"2024-02-17T14:30:13.664188+0000","last_fullsized":"2024-02-17T14:30:13.664188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:13.664089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:13.664089+0000","last_clean_scrub_stamp":"2024-02-17T14:30:13.664089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:53.207379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:13.197219+0000","last_change":"2024-02-17T14:30:13.197219+0000","last_active":"2024-02-17T14:30:13.197219+0000","last_peered":"2024-02-17T14:30:13.197219+0000","last_clean":"2024-02-17T14:30:13.197219+0000","last_became_active":"2024-02-17T14:28:03.634759+0000","last_became_peered":"2024-02-17T14:28:03.634759+0000","last_unstale":"2024-02-17T14:30:13.197219+0000","last_undegraded":"2024-02-17T14:30:13.197219+0000","last_fullsized":"2024-02-17T14:30:13.197219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:13.197083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:13.197083+0000","last_clean_scrub_stamp":"2024-02-17T14:30:13.197083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:44.926488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.002447+0000","last_change":"2024-02-17T14:30:12.002447+0000","last_active":"2024-02-17T14:30:12.002447+0000","last_peered":"2024-02-17T14:30:12.002447+0000","last_clean":"2024-02-17T14:30:12.002447+0000","last_became_active":"2024-02-17T14:28:03.075329+0000","last_became_peered":"2024-02-17T14:28:03.075329+0000","last_unstale":"2024-02-17T14:30:12.002447+0000","last_undegraded":"2024-02-17T14:30:12.002447+0000","last_fullsized":"2024-02-17T14:30:12.002447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-02-17T14:30:12.002282+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-02-17T14:30:12.002282+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.002282+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:51.545571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.689780+0000","last_change":"2024-02-17T14:30:10.689780+0000","last_active":"2024-02-17T14:30:10.689780+0000","last_peered":"2024-02-17T14:30:10.689780+0000","last_clean":"2024-02-17T14:30:10.689780+0000","last_became_active":"2024-02-17T14:28:07.645418+0000","last_became_peered":"2024-02-17T14:28:07.645418+0000","last_unstale":"2024-02-17T14:30:10.689780+0000","last_undegraded":"2024-02-17T14:30:10.689780+0000","last_fullsized":"2024-02-17T14:30:10.689780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:10.689642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:10.689642+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.689642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:43:56.411603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.034565+0000","last_change":"2024-02-17T14:30:14.034565+0000","last_active":"2024-02-17T14:30:14.034565+0000","last_peered":"2024-02-17T14:30:14.034565+0000","last_clean":"2024-02-17T14:30:14.034565+0000","last_became_active":"2024-02-17T14:28:03.629097+0000","last_became_peered":"2024-02-17T14:28:03.629097+0000","last_unstale":"2024-02-17T14:30:14.034565+0000","last_undegraded":"2024-02-17T14:30:14.034565+0000","last_fullsized":"2024-02-17T14:30:14.034565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.034455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.034455+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.034455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:29:14.209761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.130942+0000","last_change":"2024-02-17T14:30:09.130942+0000","last_active":"2024-02-17T14:30:09.130942+0000","last_peered":"2024-02-17T14:30:09.130942+0000","last_clean":"2024-02-17T14:30:09.130942+0000","last_became_active":"2024-02-17T14:28:03.073167+0000","last_became_peered":"2024-02-17T14:28:03.073167+0000","last_unstale":"2024-02-17T14:30:09.130942+0000","last_undegraded":"2024-02-17T14:30:09.130942+0000","last_fullsized":"2024-02-17T14:30:09.130942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.130825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.130825+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.130825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:30:12.027158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:16.666732+0000","last_change":"2024-02-17T14:30:16.666732+0000","last_active":"2024-02-17T14:30:16.666732+0000","last_peered":"2024-02-17T14:30:16.666732+0000","last_clean":"2024-02-17T14:30:16.666732+0000","last_became_active":"2024-02-17T14:28:51.773241+0000","last_became_peered":"2024-02-17T14:28:51.773241+0000","last_unstale":"2024-02-17T14:30:16.666732+0000","last_undegraded":"2024-02-17T14:30:16.666732+0000","last_fullsized":"2024-02-17T14:30:16.666732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:16.666619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:16.666619+0000","last_clean_scrub_stamp":"2024-02-17T14:30:16.666619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:16:34.590036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:13.065524+0000","last_change":"2024-02-17T14:30:13.065524+0000","last_active":"2024-02-17T14:30:13.065524+0000","last_peered":"2024-02-17T14:30:13.065524+0000","last_clean":"2024-02-17T14:30:13.065524+0000","last_became_active":"2024-02-17T14:28:03.628274+0000","last_became_peered":"2024-02-17T14:28:03.628274+0000","last_unstale":"2024-02-17T14:30:13.065524+0000","last_undegraded":"2024-02-17T14:30:13.065524+0000","last_fullsized":"2024-02-17T14:30:13.065524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:13.065385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:13.065385+0000","last_clean_scrub_stamp":"2024-02-17T14:30:13.065385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:46.622123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.116962+0000","last_change":"2024-02-17T14:30:07.116962+0000","last_active":"2024-02-17T14:30:07.116962+0000","last_peered":"2024-02-17T14:30:07.116962+0000","last_clean":"2024-02-17T14:30:07.116962+0000","last_became_active":"2024-02-17T14:28:03.072016+0000","last_became_peered":"2024-02-17T14:28:03.072016+0000","last_unstale":"2024-02-17T14:30:07.116962+0000","last_undegraded":"2024-02-17T14:30:07.116962+0000","last_fullsized":"2024-02-17T14:30:07.116962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.116803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.116803+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.116803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:43:52.838764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:18.239092+0000","last_change":"2024-02-17T14:30:18.239092+0000","last_active":"2024-02-17T14:30:18.239092+0000","last_peered":"2024-02-17T14:30:18.239092+0000","last_clean":"2024-02-17T14:30:18.239092+0000","last_became_active":"2024-02-17T14:28:07.850379+0000","last_became_peered":"2024-02-17T14:28:07.850379+0000","last_unstale":"2024-02-17T14:30:18.239092+0000","last_undegraded":"2024-02-17T14:30:18.239092+0000","last_fullsized":"2024-02-17T14:30:18.239092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:18.238969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:18.238969+0000","last_clean_scrub_stamp":"2024-02-17T14:30:18.238969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:46.596349+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:04.627024+0000","last_change":"2024-02-17T14:30:04.627024+0000","last_active":"2024-02-17T14:30:04.627024+0000","last_peered":"2024-02-17T14:30:04.627024+0000","last_clean":"2024-02-17T14:30:04.627024+0000","last_became_active":"2024-02-17T14:28:03.624517+0000","last_became_peered":"2024-02-17T14:28:03.624517+0000","last_unstale":"2024-02-17T14:30:04.627024+0000","last_undegraded":"2024-02-17T14:30:04.627024+0000","last_fullsized":"2024-02-17T14:30:04.627024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:04.626868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:04.626868+0000","last_clean_scrub_stamp":"2024-02-17T14:30:04.626868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:00.733358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.933082+0000","last_change":"2024-02-17T14:30:09.933082+0000","last_active":"2024-02-17T14:30:09.933082+0000","last_peered":"2024-02-17T14:30:09.933082+0000","last_clean":"2024-02-17T14:30:09.933082+0000","last_became_active":"2024-02-17T14:28:03.072490+0000","last_became_peered":"2024-02-17T14:28:03.072490+0000","last_unstale":"2024-02-17T14:30:09.933082+0000","last_undegraded":"2024-02-17T14:30:09.933082+0000","last_fullsized":"2024-02-17T14:30:09.933082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.932982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.932982+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.932982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:14:46.972098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.683669+0000","last_change":"2024-02-17T14:30:17.683669+0000","last_active":"2024-02-17T14:30:17.683669+0000","last_peered":"2024-02-17T14:30:17.683669+0000","last_clean":"2024-02-17T14:30:17.683669+0000","last_became_active":"2024-02-17T14:28:51.773478+0000","last_became_peered":"2024-02-17T14:28:51.773478+0000","last_unstale":"2024-02-17T14:30:17.683669+0000","last_undegraded":"2024-02-17T14:30:17.683669+0000","last_fullsized":"2024-02-17T14:30:17.683669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.683529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.683529+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.683529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:31:03.906640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.586055+0000","last_change":"2024-02-17T14:30:07.586055+0000","last_active":"2024-02-17T14:30:07.586055+0000","last_peered":"2024-02-17T14:30:07.586055+0000","last_clean":"2024-02-17T14:30:07.586055+0000","last_became_active":"2024-02-17T14:28:03.628777+0000","last_became_peered":"2024-02-17T14:28:03.628777+0000","last_unstale":"2024-02-17T14:30:07.586055+0000","last_undegraded":"2024-02-17T14:30:07.586055+0000","last_fullsized":"2024-02-17T14:30:07.586055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.585951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.585951+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.585951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:39.315356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.244971+0000","last_change":"2024-02-17T14:30:05.244971+0000","last_active":"2024-02-17T14:30:05.244971+0000","last_peered":"2024-02-17T14:30:05.244971+0000","last_clean":"2024-02-17T14:30:05.244971+0000","last_became_active":"2024-02-17T14:28:03.070790+0000","last_became_peered":"2024-02-17T14:28:03.070790+0000","last_unstale":"2024-02-17T14:30:05.244971+0000","last_undegraded":"2024-02-17T14:30:05.244971+0000","last_fullsized":"2024-02-17T14:30:05.244971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-02-17T14:30:05.244797+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-02-17T14:30:05.244797+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.244797+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:31:11.951300+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.627706+0000","last_change":"2024-02-17T14:30:15.627739+0000","last_active":"2024-02-17T14:30:15.627706+0000","last_peered":"2024-02-17T14:30:15.627706+0000","last_clean":"2024-02-17T14:30:15.627706+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:30:15.627706+0000","last_undegraded":"2024-02-17T14:30:15.627706+0000","last_fullsized":"2024-02-17T14:30:15.627706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.627610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.627610+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.627610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:47:00.157542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:16.090758+0000","last_change":"2024-02-17T14:30:16.090758+0000","last_active":"2024-02-17T14:30:16.090758+0000","last_peered":"2024-02-17T14:30:16.090758+0000","last_clean":"2024-02-17T14:30:16.090758+0000","last_became_active":"2024-02-17T14:28:03.641577+0000","last_became_peered":"2024-02-17T14:28:03.641577+0000","last_unstale":"2024-02-17T14:30:16.090758+0000","last_undegraded":"2024-02-17T14:30:16.090758+0000","last_fullsized":"2024-02-17T14:30:16.090758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:16.090558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:16.090558+0000","last_clean_scrub_stamp":"2024-02-17T14:30:16.090558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:32:00.304583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.101003+0000","last_change":"2024-02-17T14:30:06.101003+0000","last_active":"2024-02-17T14:30:06.101003+0000","last_peered":"2024-02-17T14:30:06.101003+0000","last_clean":"2024-02-17T14:30:06.101003+0000","last_became_active":"2024-02-17T14:28:03.071850+0000","last_became_peered":"2024-02-17T14:28:03.071850+0000","last_unstale":"2024-02-17T14:30:06.101003+0000","last_undegraded":"2024-02-17T14:30:06.101003+0000","last_fullsized":"2024-02-17T14:30:06.101003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-17T14:30:06.100892+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-17T14:30:06.100892+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.100892+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:18:15.984813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:02.986944+0000","last_change":"2024-02-17T14:28:52.062350+0000","last_active":"2024-02-17T14:30:02.986944+0000","last_peered":"2024-02-17T14:30:02.986944+0000","last_clean":"2024-02-17T14:30:02.986944+0000","last_became_active":"2024-02-17T14:28:52.061827+0000","last_became_peered":"2024-02-17T14:28:52.061827+0000","last_unstale":"2024-02-17T14:30:02.986944+0000","last_undegraded":"2024-02-17T14:30:02.986944+0000","last_fullsized":"2024-02-17T14:30:02.986944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:28:06.624617+0000","last_clean_scrub_stamp":"2024-02-17T14:28:06.624617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:02.116846+0000","last_change":"2024-02-17T14:30:02.116846+0000","last_active":"2024-02-17T14:30:02.116846+0000","last_peered":"2024-02-17T14:30:02.116846+0000","last_clean":"2024-02-17T14:30:02.116846+0000","last_became_active":"2024-02-17T14:28:03.632020+0000","last_became_peered":"2024-02-17T14:28:03.632020+0000","last_unstale":"2024-02-17T14:30:02.116846+0000","last_undegraded":"2024-02-17T14:30:02.116846+0000","last_fullsized":"2024-02-17T14:30:02.116846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:02.116747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:02.116747+0000","last_clean_scrub_stamp":"2024-02-17T14:30:02.116747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:25:54.637354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.927880+0000","last_change":"2024-02-17T14:30:08.927913+0000","last_active":"2024-02-17T14:30:08.927880+0000","last_peered":"2024-02-17T14:30:08.927880+0000","last_clean":"2024-02-17T14:30:08.927880+0000","last_became_active":"2024-02-17T14:28:03.071830+0000","last_became_peered":"2024-02-17T14:28:03.071830+0000","last_unstale":"2024-02-17T14:30:08.927880+0000","last_undegraded":"2024-02-17T14:30:08.927880+0000","last_fullsized":"2024-02-17T14:30:08.927880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:08.927794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:08.927794+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.927794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:40.657199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.480447+0000","last_change":"2024-02-17T14:30:17.480472+0000","last_active":"2024-02-17T14:30:17.480447+0000","last_peered":"2024-02-17T14:30:17.480447+0000","last_clean":"2024-02-17T14:30:17.480447+0000","last_became_active":"2024-02-17T14:28:07.849212+0000","last_became_peered":"2024-02-17T14:28:07.849212+0000","last_unstale":"2024-02-17T14:30:17.480447+0000","last_undegraded":"2024-02-17T14:30:17.480447+0000","last_fullsized":"2024-02-17T14:30:17.480447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.480367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.480367+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.480367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:03:54.021063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.438402+0000","last_change":"2024-02-17T14:30:10.438402+0000","last_active":"2024-02-17T14:30:10.438402+0000","last_peered":"2024-02-17T14:30:10.438402+0000","last_clean":"2024-02-17T14:30:10.438402+0000","last_became_active":"2024-02-17T14:28:03.626174+0000","last_became_peered":"2024-02-17T14:28:03.626174+0000","last_unstale":"2024-02-17T14:30:10.438402+0000","last_undegraded":"2024-02-17T14:30:10.438402+0000","last_fullsized":"2024-02-17T14:30:10.438402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:10.438260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:10.438260+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.438260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:49.981549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:04.088272+0000","last_change":"2024-02-17T14:30:04.088272+0000","last_active":"2024-02-17T14:30:04.088272+0000","last_peered":"2024-02-17T14:30:04.088272+0000","last_clean":"2024-02-17T14:30:04.088272+0000","last_became_active":"2024-02-17T14:28:03.068179+0000","last_became_peered":"2024-02-17T14:28:03.068179+0000","last_unstale":"2024-02-17T14:30:04.088272+0000","last_undegraded":"2024-02-17T14:30:04.088272+0000","last_fullsized":"2024-02-17T14:30:04.088272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:04.088181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:04.088181+0000","last_clean_scrub_stamp":"2024-02-17T14:30:04.088181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:22:36.703286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.227664+0000","last_change":"2024-02-17T14:30:17.227700+0000","last_active":"2024-02-17T14:30:17.227664+0000","last_peered":"2024-02-17T14:30:17.227664+0000","last_clean":"2024-02-17T14:30:17.227664+0000","last_became_active":"2024-02-17T14:28:07.647918+0000","last_became_peered":"2024-02-17T14:28:07.647918+0000","last_unstale":"2024-02-17T14:30:17.227664+0000","last_undegraded":"2024-02-17T14:30:17.227664+0000","last_fullsized":"2024-02-17T14:30:17.227664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.227556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.227556+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.227556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:03:53.768252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.623018+0000","last_change":"2024-02-17T14:30:06.623018+0000","last_active":"2024-02-17T14:30:06.623018+0000","last_peered":"2024-02-17T14:30:06.623018+0000","last_clean":"2024-02-17T14:30:06.623018+0000","last_became_active":"2024-02-17T14:28:03.629077+0000","last_became_peered":"2024-02-17T14:28:03.629077+0000","last_unstale":"2024-02-17T14:30:06.623018+0000","last_undegraded":"2024-02-17T14:30:06.623018+0000","last_fullsized":"2024-02-17T14:30:06.623018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:06.622852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:06.622852+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.622852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:34:33.241401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.435967+0000","last_change":"2024-02-17T14:30:08.436009+0000","last_active":"2024-02-17T14:30:08.435967+0000","last_peered":"2024-02-17T14:30:08.435967+0000","last_clean":"2024-02-17T14:30:08.435967+0000","last_became_active":"2024-02-17T14:28:03.068923+0000","last_became_peered":"2024-02-17T14:28:03.068923+0000","last_unstale":"2024-02-17T14:30:08.435967+0000","last_undegraded":"2024-02-17T14:30:08.435967+0000","last_fullsized":"2024-02-17T14:30:08.435967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:08.435863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:08.435863+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.435863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:14:45.474978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.208957+0000","last_change":"2024-02-17T14:30:14.208999+0000","last_active":"2024-02-17T14:30:14.208957+0000","last_peered":"2024-02-17T14:30:14.208957+0000","last_clean":"2024-02-17T14:30:14.208957+0000","last_became_active":"2024-02-17T14:28:07.645156+0000","last_became_peered":"2024-02-17T14:28:07.645156+0000","last_unstale":"2024-02-17T14:30:14.208957+0000","last_undegraded":"2024-02-17T14:30:14.208957+0000","last_fullsized":"2024-02-17T14:30:14.208957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.208849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.208849+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.208849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:34:50.159272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.146461+0000","last_change":"2024-02-17T14:30:10.146484+0000","last_active":"2024-02-17T14:30:10.146461+0000","last_peered":"2024-02-17T14:30:10.146461+0000","last_clean":"2024-02-17T14:30:10.146461+0000","last_became_active":"2024-02-17T14:28:03.627165+0000","last_became_peered":"2024-02-17T14:28:03.627165+0000","last_unstale":"2024-02-17T14:30:10.146461+0000","last_undegraded":"2024-02-17T14:30:10.146461+0000","last_fullsized":"2024-02-17T14:30:10.146461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:10.146386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:10.146386+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.146386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:49.689675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:02.988112+0000","last_change":"2024-02-17T14:30:02.988112+0000","last_active":"2024-02-17T14:30:02.988112+0000","last_peered":"2024-02-17T14:30:02.988112+0000","last_clean":"2024-02-17T14:30:02.988112+0000","last_became_active":"2024-02-17T14:28:03.066156+0000","last_became_peered":"2024-02-17T14:28:03.066156+0000","last_unstale":"2024-02-17T14:30:02.988112+0000","last_undegraded":"2024-02-17T14:30:02.988112+0000","last_fullsized":"2024-02-17T14:30:02.988112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:02.988016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:02.988016+0000","last_clean_scrub_stamp":"2024-02-17T14:30:02.988016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:32:24.833500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:16.237485+0000","last_change":"2024-02-17T14:30:16.237485+0000","last_active":"2024-02-17T14:30:16.237485+0000","last_peered":"2024-02-17T14:30:16.237485+0000","last_clean":"2024-02-17T14:30:16.237485+0000","last_became_active":"2024-02-17T14:28:07.649403+0000","last_became_peered":"2024-02-17T14:28:07.649403+0000","last_unstale":"2024-02-17T14:30:16.237485+0000","last_undegraded":"2024-02-17T14:30:16.237485+0000","last_fullsized":"2024-02-17T14:30:16.237485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:16.237349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:16.237349+0000","last_clean_scrub_stamp":"2024-02-17T14:30:16.237349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:50:20.483245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.551469+0000","last_change":"2024-02-17T14:30:08.551469+0000","last_active":"2024-02-17T14:30:08.551469+0000","last_peered":"2024-02-17T14:30:08.551469+0000","last_clean":"2024-02-17T14:30:08.551469+0000","last_became_active":"2024-02-17T14:28:03.629247+0000","last_became_peered":"2024-02-17T14:28:03.629247+0000","last_unstale":"2024-02-17T14:30:08.551469+0000","last_undegraded":"2024-02-17T14:30:08.551469+0000","last_fullsized":"2024-02-17T14:30:08.551469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:08.551319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:08.551319+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.551319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:14:45.590434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.920344+0000","last_change":"2024-02-17T14:30:07.920371+0000","last_active":"2024-02-17T14:30:07.920344+0000","last_peered":"2024-02-17T14:30:07.920344+0000","last_clean":"2024-02-17T14:30:07.920344+0000","last_became_active":"2024-02-17T14:28:03.071778+0000","last_became_peered":"2024-02-17T14:28:03.071778+0000","last_unstale":"2024-02-17T14:30:07.920344+0000","last_undegraded":"2024-02-17T14:30:07.920344+0000","last_fullsized":"2024-02-17T14:30:07.920344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.920219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.920219+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.920219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:13:57.823195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:18.465425+0000","last_change":"2024-02-17T14:30:18.465455+0000","last_active":"2024-02-17T14:30:18.465425+0000","last_peered":"2024-02-17T14:30:18.465425+0000","last_clean":"2024-02-17T14:30:18.465425+0000","last_became_active":"2024-02-17T14:28:07.850106+0000","last_became_peered":"2024-02-17T14:28:07.850106+0000","last_unstale":"2024-02-17T14:30:18.465425+0000","last_undegraded":"2024-02-17T14:30:18.465425+0000","last_fullsized":"2024-02-17T14:30:18.465425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:18.465327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:18.465327+0000","last_clean_scrub_stamp":"2024-02-17T14:30:18.465327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:46.822708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.133606+0000","last_change":"2024-02-17T14:30:06.133606+0000","last_active":"2024-02-17T14:30:06.133606+0000","last_peered":"2024-02-17T14:30:06.133606+0000","last_clean":"2024-02-17T14:30:06.133606+0000","last_became_active":"2024-02-17T14:28:03.634570+0000","last_became_peered":"2024-02-17T14:28:03.634570+0000","last_unstale":"2024-02-17T14:30:06.133606+0000","last_undegraded":"2024-02-17T14:30:06.133606+0000","last_fullsized":"2024-02-17T14:30:06.133606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:06.133488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:06.133488+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.133488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:14:43.172604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.441851+0000","last_change":"2024-02-17T14:30:05.441851+0000","last_active":"2024-02-17T14:30:05.441851+0000","last_peered":"2024-02-17T14:30:05.441851+0000","last_clean":"2024-02-17T14:30:05.441851+0000","last_became_active":"2024-02-17T14:28:03.061026+0000","last_became_peered":"2024-02-17T14:28:03.061026+0000","last_unstale":"2024-02-17T14:30:05.441851+0000","last_undegraded":"2024-02-17T14:30:05.441851+0000","last_fullsized":"2024-02-17T14:30:05.441851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:05.441737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:05.441737+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.441737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:13:55.344714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.878469+0000","last_change":"2024-02-17T14:30:05.878504+0000","last_active":"2024-02-17T14:30:05.878469+0000","last_peered":"2024-02-17T14:30:05.878469+0000","last_clean":"2024-02-17T14:30:05.878469+0000","last_became_active":"2024-02-17T14:28:00.252180+0000","last_became_peered":"2024-02-17T14:28:00.252180+0000","last_unstale":"2024-02-17T14:30:05.878469+0000","last_undegraded":"2024-02-17T14:30:05.878469+0000","last_fullsized":"2024-02-17T14:30:05.878469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-02-17T14:30:05.878388+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-02-17T14:30:05.878388+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.878388+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:22:38.493493+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:19.129079+0000","last_change":"2024-02-17T14:30:19.129106+0000","last_active":"2024-02-17T14:30:19.129079+0000","last_peered":"2024-02-17T14:30:19.129079+0000","last_clean":"2024-02-17T14:30:19.129079+0000","last_became_active":"2024-02-17T14:28:07.849264+0000","last_became_peered":"2024-02-17T14:28:07.849264+0000","last_unstale":"2024-02-17T14:30:19.129079+0000","last_undegraded":"2024-02-17T14:30:19.129079+0000","last_fullsized":"2024-02-17T14:30:19.129079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:19.128995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:19.128995+0000","last_clean_scrub_stamp":"2024-02-17T14:30:19.128995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:53:59.166197+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:04.885368+0000","last_change":"2024-02-17T14:30:04.885368+0000","last_active":"2024-02-17T14:30:04.885368+0000","last_peered":"2024-02-17T14:30:04.885368+0000","last_clean":"2024-02-17T14:30:04.885368+0000","last_became_active":"2024-02-17T14:28:03.641815+0000","last_became_peered":"2024-02-17T14:28:03.641815+0000","last_unstale":"2024-02-17T14:30:04.885368+0000","last_undegraded":"2024-02-17T14:30:04.885368+0000","last_fullsized":"2024-02-17T14:30:04.885368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:04.885267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:04.885267+0000","last_clean_scrub_stamp":"2024-02-17T14:30:04.885267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:07:55.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:03.990661+0000","last_change":"2024-02-17T14:30:03.990661+0000","last_active":"2024-02-17T14:30:03.990661+0000","last_peered":"2024-02-17T14:30:03.990661+0000","last_clean":"2024-02-17T14:30:03.990661+0000","last_became_active":"2024-02-17T14:28:03.066169+0000","last_became_peered":"2024-02-17T14:28:03.066169+0000","last_unstale":"2024-02-17T14:30:03.990661+0000","last_undegraded":"2024-02-17T14:30:03.990661+0000","last_fullsized":"2024-02-17T14:30:03.990661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:03.990567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:03.990567+0000","last_clean_scrub_stamp":"2024-02-17T14:30:03.990567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:57:41.179279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:18.149521+0000","last_change":"2024-02-17T14:30:18.149546+0000","last_active":"2024-02-17T14:30:18.149521+0000","last_peered":"2024-02-17T14:30:18.149521+0000","last_clean":"2024-02-17T14:30:18.149521+0000","last_became_active":"2024-02-17T14:28:07.846265+0000","last_became_peered":"2024-02-17T14:28:07.846265+0000","last_unstale":"2024-02-17T14:30:18.149521+0000","last_undegraded":"2024-02-17T14:30:18.149521+0000","last_fullsized":"2024-02-17T14:30:18.149521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:18.149440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:18.149440+0000","last_clean_scrub_stamp":"2024-02-17T14:30:18.149440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:29.366374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.405383+0000","last_change":"2024-02-17T14:30:15.405383+0000","last_active":"2024-02-17T14:30:15.405383+0000","last_peered":"2024-02-17T14:30:15.405383+0000","last_clean":"2024-02-17T14:30:15.405383+0000","last_became_active":"2024-02-17T14:28:03.634290+0000","last_became_peered":"2024-02-17T14:28:03.634290+0000","last_unstale":"2024-02-17T14:30:15.405383+0000","last_undegraded":"2024-02-17T14:30:15.405383+0000","last_fullsized":"2024-02-17T14:30:15.405383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.405267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.405267+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.405267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:48.962005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.112360+0000","last_change":"2024-02-17T14:30:08.112360+0000","last_active":"2024-02-17T14:30:08.112360+0000","last_peered":"2024-02-17T14:30:08.112360+0000","last_clean":"2024-02-17T14:30:08.112360+0000","last_became_active":"2024-02-17T14:28:03.072497+0000","last_became_peered":"2024-02-17T14:28:03.072497+0000","last_unstale":"2024-02-17T14:30:08.112360+0000","last_undegraded":"2024-02-17T14:30:08.112360+0000","last_fullsized":"2024-02-17T14:30:08.112360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-17T14:30:08.112243+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-17T14:30:08.112243+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.112243+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:52.950054+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.470154+0000","last_change":"2024-02-17T14:30:15.470154+0000","last_active":"2024-02-17T14:30:15.470154+0000","last_peered":"2024-02-17T14:30:15.470154+0000","last_clean":"2024-02-17T14:30:15.470154+0000","last_became_active":"2024-02-17T14:28:07.651144+0000","last_became_peered":"2024-02-17T14:28:07.651144+0000","last_unstale":"2024-02-17T14:30:15.470154+0000","last_undegraded":"2024-02-17T14:30:15.470154+0000","last_fullsized":"2024-02-17T14:30:15.470154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.470043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.470043+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.470043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:49.026781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:20.049102+0000","last_change":"2024-02-17T14:30:20.049102+0000","last_active":"2024-02-17T14:30:20.049102+0000","last_peered":"2024-02-17T14:30:20.049102+0000","last_clean":"2024-02-17T14:30:20.049102+0000","last_became_active":"2024-02-17T14:28:03.643033+0000","last_became_peered":"2024-02-17T14:28:03.643033+0000","last_unstale":"2024-02-17T14:30:20.049102+0000","last_undegraded":"2024-02-17T14:30:20.049102+0000","last_fullsized":"2024-02-17T14:30:20.049102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:20.048990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:20.048990+0000","last_clean_scrub_stamp":"2024-02-17T14:30:20.048990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:48.406370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.013037+0000","last_change":"2024-02-17T14:30:05.013037+0000","last_active":"2024-02-17T14:30:05.013037+0000","last_peered":"2024-02-17T14:30:05.013037+0000","last_clean":"2024-02-17T14:30:05.013037+0000","last_became_active":"2024-02-17T14:28:03.066797+0000","last_became_peered":"2024-02-17T14:28:03.066797+0000","last_unstale":"2024-02-17T14:30:05.013037+0000","last_undegraded":"2024-02-17T14:30:05.013037+0000","last_fullsized":"2024-02-17T14:30:05.013037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-02-17T14:30:05.012954+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-02-17T14:30:05.012954+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.012954+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:19:02.904855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:19.411544+0000","last_change":"2024-02-17T14:30:19.411567+0000","last_active":"2024-02-17T14:30:19.411544+0000","last_peered":"2024-02-17T14:30:19.411544+0000","last_clean":"2024-02-17T14:30:19.411544+0000","last_became_active":"2024-02-17T14:28:07.849280+0000","last_became_peered":"2024-02-17T14:28:07.849280+0000","last_unstale":"2024-02-17T14:30:19.411544+0000","last_undegraded":"2024-02-17T14:30:19.411544+0000","last_fullsized":"2024-02-17T14:30:19.411544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:19.411451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:19.411451+0000","last_clean_scrub_stamp":"2024-02-17T14:30:19.411451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:32:03.625475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.040793+0000","last_change":"2024-02-17T14:30:17.040793+0000","last_active":"2024-02-17T14:30:17.040793+0000","last_peered":"2024-02-17T14:30:17.040793+0000","last_clean":"2024-02-17T14:30:17.040793+0000","last_became_active":"2024-02-17T14:28:03.640945+0000","last_became_peered":"2024-02-17T14:28:03.640945+0000","last_unstale":"2024-02-17T14:30:17.040793+0000","last_undegraded":"2024-02-17T14:30:17.040793+0000","last_fullsized":"2024-02-17T14:30:17.040793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.040679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.040679+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.040679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:50.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:03.647330+0000","last_change":"2024-02-17T14:30:03.647330+0000","last_active":"2024-02-17T14:30:03.647330+0000","last_peered":"2024-02-17T14:30:03.647330+0000","last_clean":"2024-02-17T14:30:03.647330+0000","last_became_active":"2024-02-17T14:28:03.066350+0000","last_became_peered":"2024-02-17T14:28:03.066350+0000","last_unstale":"2024-02-17T14:30:03.647330+0000","last_undegraded":"2024-02-17T14:30:03.647330+0000","last_fullsized":"2024-02-17T14:30:03.647330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-17T14:30:03.647222+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-17T14:30:03.647222+0000","last_clean_scrub_stamp":"2024-02-17T14:30:03.647222+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:03:33.343764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.626643+0000","last_change":"2024-02-17T14:30:14.626643+0000","last_active":"2024-02-17T14:30:14.626643+0000","last_peered":"2024-02-17T14:30:14.626643+0000","last_clean":"2024-02-17T14:30:14.626643+0000","last_became_active":"2024-02-17T14:28:07.652088+0000","last_became_peered":"2024-02-17T14:28:07.652088+0000","last_unstale":"2024-02-17T14:30:14.626643+0000","last_undegraded":"2024-02-17T14:30:14.626643+0000","last_fullsized":"2024-02-17T14:30:14.626643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.626532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.626532+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.626532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:13.725750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:19.231465+0000","last_change":"2024-02-17T14:30:19.231488+0000","last_active":"2024-02-17T14:30:19.231465+0000","last_peered":"2024-02-17T14:30:19.231465+0000","last_clean":"2024-02-17T14:30:19.231465+0000","last_became_active":"2024-02-17T14:28:51.770241+0000","last_became_peered":"2024-02-17T14:28:51.770241+0000","last_unstale":"2024-02-17T14:30:19.231465+0000","last_undegraded":"2024-02-17T14:30:19.231465+0000","last_fullsized":"2024-02-17T14:30:19.231465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:19.231347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:19.231347+0000","last_clean_scrub_stamp":"2024-02-17T14:30:19.231347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:32:03.445371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"27'12","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.980158+0000","last_change":"2024-02-17T14:30:05.980158+0000","last_active":"2024-02-17T14:30:05.980158+0000","last_peered":"2024-02-17T14:30:05.980158+0000","last_clean":"2024-02-17T14:30:05.980158+0000","last_became_active":"2024-02-17T14:28:03.069867+0000","last_became_peered":"2024-02-17T14:28:03.069867+0000","last_unstale":"2024-02-17T14:30:05.980158+0000","last_undegraded":"2024-02-17T14:30:05.980158+0000","last_fullsized":"2024-02-17T14:30:05.980158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-02-17T14:30:05.980005+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-02-17T14:30:05.980005+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.980005+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:58:42.626961+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.501984+0000","last_change":"2024-02-17T14:30:14.502024+0000","last_active":"2024-02-17T14:30:14.501984+0000","last_peered":"2024-02-17T14:30:14.501984+0000","last_clean":"2024-02-17T14:30:14.501984+0000","last_became_active":"2024-02-17T14:28:07.644452+0000","last_became_peered":"2024-02-17T14:28:07.644452+0000","last_unstale":"2024-02-17T14:30:14.501984+0000","last_undegraded":"2024-02-17T14:30:14.501984+0000","last_fullsized":"2024-02-17T14:30:14.501984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.501877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.501877+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.501877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:34:50.452300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:11.267666+0000","last_change":"2024-02-17T14:30:11.267694+0000","last_active":"2024-02-17T14:30:11.267666+0000","last_peered":"2024-02-17T14:30:11.267666+0000","last_clean":"2024-02-17T14:30:11.267666+0000","last_became_active":"2024-02-17T14:28:03.630239+0000","last_became_peered":"2024-02-17T14:28:03.630239+0000","last_unstale":"2024-02-17T14:30:11.267666+0000","last_undegraded":"2024-02-17T14:30:11.267666+0000","last_fullsized":"2024-02-17T14:30:11.267666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:11.267546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:11.267546+0000","last_clean_scrub_stamp":"2024-02-17T14:30:11.267546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:01.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.283145+0000","last_change":"2024-02-17T14:30:08.283145+0000","last_active":"2024-02-17T14:30:08.283145+0000","last_peered":"2024-02-17T14:30:08.283145+0000","last_clean":"2024-02-17T14:30:08.283145+0000","last_became_active":"2024-02-17T14:28:03.072801+0000","last_became_peered":"2024-02-17T14:28:03.072801+0000","last_unstale":"2024-02-17T14:30:08.283145+0000","last_undegraded":"2024-02-17T14:30:08.283145+0000","last_fullsized":"2024-02-17T14:30:08.283145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:08.283036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:08.283036+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.283036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:07:58.499005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:20.140732+0000","last_change":"2024-02-17T14:30:20.140754+0000","last_active":"2024-02-17T14:30:20.140732+0000","last_peered":"2024-02-17T14:30:20.140732+0000","last_clean":"2024-02-17T14:30:20.140732+0000","last_became_active":"2024-02-17T14:28:07.848991+0000","last_became_peered":"2024-02-17T14:28:07.848991+0000","last_unstale":"2024-02-17T14:30:20.140732+0000","last_undegraded":"2024-02-17T14:30:20.140732+0000","last_fullsized":"2024-02-17T14:30:20.140732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:20.140643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:20.140643+0000","last_clean_scrub_stamp":"2024-02-17T14:30:20.140643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:02:10.760219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:19.028421+0000","last_change":"2024-02-17T14:30:19.028454+0000","last_active":"2024-02-17T14:30:19.028421+0000","last_peered":"2024-02-17T14:30:19.028421+0000","last_clean":"2024-02-17T14:30:19.028421+0000","last_became_active":"2024-02-17T14:28:03.641501+0000","last_became_peered":"2024-02-17T14:28:03.641501+0000","last_unstale":"2024-02-17T14:30:19.028421+0000","last_undegraded":"2024-02-17T14:30:19.028421+0000","last_fullsized":"2024-02-17T14:30:19.028421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:19.028327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:19.028327+0000","last_clean_scrub_stamp":"2024-02-17T14:30:19.028327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:03:55.569023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.448080+0000","last_change":"2024-02-17T14:30:07.448080+0000","last_active":"2024-02-17T14:30:07.448080+0000","last_peered":"2024-02-17T14:30:07.448080+0000","last_clean":"2024-02-17T14:30:07.448080+0000","last_became_active":"2024-02-17T14:28:03.066538+0000","last_became_peered":"2024-02-17T14:28:03.066538+0000","last_unstale":"2024-02-17T14:30:07.448080+0000","last_undegraded":"2024-02-17T14:30:07.448080+0000","last_fullsized":"2024-02-17T14:30:07.448080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.447964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.447964+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.447964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:39.177369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:19.113861+0000","last_change":"2024-02-17T14:30:19.113891+0000","last_active":"2024-02-17T14:30:19.113861+0000","last_peered":"2024-02-17T14:30:19.113861+0000","last_clean":"2024-02-17T14:30:19.113861+0000","last_became_active":"2024-02-17T14:28:07.846413+0000","last_became_peered":"2024-02-17T14:28:07.846413+0000","last_unstale":"2024-02-17T14:30:19.113861+0000","last_undegraded":"2024-02-17T14:30:19.113861+0000","last_fullsized":"2024-02-17T14:30:19.113861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:19.113756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:19.113756+0000","last_clean_scrub_stamp":"2024-02-17T14:30:19.113756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:27:34.962516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.477246+0000","last_change":"2024-02-17T14:30:12.477307+0000","last_active":"2024-02-17T14:30:12.477246+0000","last_peered":"2024-02-17T14:30:12.477246+0000","last_clean":"2024-02-17T14:30:12.477246+0000","last_became_active":"2024-02-17T14:28:03.637831+0000","last_became_peered":"2024-02-17T14:28:03.637831+0000","last_unstale":"2024-02-17T14:30:12.477246+0000","last_undegraded":"2024-02-17T14:30:12.477246+0000","last_fullsized":"2024-02-17T14:30:12.477246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.477158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.477158+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.477158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:23.694091+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'4","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:03.536049+0000","last_change":"2024-02-17T14:30:03.536049+0000","last_active":"2024-02-17T14:30:03.536049+0000","last_peered":"2024-02-17T14:30:03.536049+0000","last_clean":"2024-02-17T14:30:03.536049+0000","last_became_active":"2024-02-17T14:28:03.064226+0000","last_became_peered":"2024-02-17T14:28:03.064226+0000","last_unstale":"2024-02-17T14:30:03.536049+0000","last_undegraded":"2024-02-17T14:30:03.536049+0000","last_fullsized":"2024-02-17T14:30:03.536049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-17T14:30:03.535896+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-17T14:30:03.535896+0000","last_clean_scrub_stamp":"2024-02-17T14:30:03.535896+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:07:53.751866+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:18.409672+0000","last_change":"2024-02-17T14:30:18.409699+0000","last_active":"2024-02-17T14:30:18.409672+0000","last_peered":"2024-02-17T14:30:18.409672+0000","last_clean":"2024-02-17T14:30:18.409672+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:30:18.409672+0000","last_undegraded":"2024-02-17T14:30:18.409672+0000","last_fullsized":"2024-02-17T14:30:18.409672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:18.409592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:18.409592+0000","last_clean_scrub_stamp":"2024-02-17T14:30:18.409592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:46.766972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.011487+0000","last_change":"2024-02-17T14:30:14.011511+0000","last_active":"2024-02-17T14:30:14.011487+0000","last_peered":"2024-02-17T14:30:14.011487+0000","last_clean":"2024-02-17T14:30:14.011487+0000","last_became_active":"2024-02-17T14:28:03.642077+0000","last_became_peered":"2024-02-17T14:28:03.642077+0000","last_unstale":"2024-02-17T14:30:14.011487+0000","last_undegraded":"2024-02-17T14:30:14.011487+0000","last_fullsized":"2024-02-17T14:30:14.011487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.011403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.011403+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.011403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:25.228337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'17","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.262750+0000","last_change":"2024-02-17T14:30:06.262750+0000","last_active":"2024-02-17T14:30:06.262750+0000","last_peered":"2024-02-17T14:30:06.262750+0000","last_clean":"2024-02-17T14:30:06.262750+0000","last_became_active":"2024-02-17T14:28:03.071303+0000","last_became_peered":"2024-02-17T14:28:03.071303+0000","last_unstale":"2024-02-17T14:30:06.262750+0000","last_undegraded":"2024-02-17T14:30:06.262750+0000","last_fullsized":"2024-02-17T14:30:06.262750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-02-17T14:30:06.262631+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-02-17T14:30:06.262631+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.262631+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:07:12.448560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8125,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.254055+0000","last_change":"2024-02-17T14:30:15.254087+0000","last_active":"2024-02-17T14:30:15.254055+0000","last_peered":"2024-02-17T14:30:15.254055+0000","last_clean":"2024-02-17T14:30:15.254055+0000","last_became_active":"2024-02-17T14:28:07.645313+0000","last_became_peered":"2024-02-17T14:28:07.645313+0000","last_unstale":"2024-02-17T14:30:15.254055+0000","last_undegraded":"2024-02-17T14:30:15.254055+0000","last_fullsized":"2024-02-17T14:30:15.254055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.253947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.253947+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.253947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:48.810685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.633641+0000","last_change":"2024-02-17T14:30:08.633664+0000","last_active":"2024-02-17T14:30:08.633641+0000","last_peered":"2024-02-17T14:30:08.633641+0000","last_clean":"2024-02-17T14:30:08.633641+0000","last_became_active":"2024-02-17T14:28:03.637937+0000","last_became_peered":"2024-02-17T14:28:03.637937+0000","last_unstale":"2024-02-17T14:30:08.633641+0000","last_undegraded":"2024-02-17T14:30:08.633641+0000","last_fullsized":"2024-02-17T14:30:08.633641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:08.633561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:08.633561+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.633561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:19:15.986585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.053175+0000","last_change":"2024-02-17T14:30:05.053201+0000","last_active":"2024-02-17T14:30:05.053175+0000","last_peered":"2024-02-17T14:30:05.053175+0000","last_clean":"2024-02-17T14:30:05.053175+0000","last_became_active":"2024-02-17T14:28:03.069690+0000","last_became_peered":"2024-02-17T14:28:03.069690+0000","last_unstale":"2024-02-17T14:30:05.053175+0000","last_undegraded":"2024-02-17T14:30:05.053175+0000","last_fullsized":"2024-02-17T14:30:05.053175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-02-17T14:30:05.053109+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-02-17T14:30:05.053109+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.053109+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:28.600547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:11.653454+0000","last_change":"2024-02-17T14:30:11.653481+0000","last_active":"2024-02-17T14:30:11.653454+0000","last_peered":"2024-02-17T14:30:11.653454+0000","last_clean":"2024-02-17T14:30:11.653454+0000","last_became_active":"2024-02-17T14:28:07.647420+0000","last_became_peered":"2024-02-17T14:28:07.647420+0000","last_unstale":"2024-02-17T14:30:11.653454+0000","last_undegraded":"2024-02-17T14:30:11.653454+0000","last_fullsized":"2024-02-17T14:30:11.653454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:11.653366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:11.653366+0000","last_clean_scrub_stamp":"2024-02-17T14:30:11.653366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:56.491176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.508211+0000","last_change":"2024-02-17T14:30:10.508251+0000","last_active":"2024-02-17T14:30:10.508211+0000","last_peered":"2024-02-17T14:30:10.508211+0000","last_clean":"2024-02-17T14:30:10.508211+0000","last_became_active":"2024-02-17T14:28:03.630169+0000","last_became_peered":"2024-02-17T14:28:03.630169+0000","last_unstale":"2024-02-17T14:30:10.508211+0000","last_undegraded":"2024-02-17T14:30:10.508211+0000","last_fullsized":"2024-02-17T14:30:10.508211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:10.508132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:10.508132+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.508132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:50.051421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.437459+0000","last_change":"2024-02-17T14:30:09.437512+0000","last_active":"2024-02-17T14:30:09.437459+0000","last_peered":"2024-02-17T14:30:09.437459+0000","last_clean":"2024-02-17T14:30:09.437459+0000","last_became_active":"2024-02-17T14:28:03.069617+0000","last_became_peered":"2024-02-17T14:28:03.069617+0000","last_unstale":"2024-02-17T14:30:09.437459+0000","last_undegraded":"2024-02-17T14:30:09.437459+0000","last_fullsized":"2024-02-17T14:30:09.437459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.437357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.437357+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.437357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:03:44.368354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.119154+0000","last_change":"2024-02-17T14:30:17.119187+0000","last_active":"2024-02-17T14:30:17.119154+0000","last_peered":"2024-02-17T14:30:17.119154+0000","last_clean":"2024-02-17T14:30:17.119154+0000","last_became_active":"2024-02-17T14:28:07.646403+0000","last_became_peered":"2024-02-17T14:28:07.646403+0000","last_unstale":"2024-02-17T14:30:17.119154+0000","last_undegraded":"2024-02-17T14:30:17.119154+0000","last_fullsized":"2024-02-17T14:30:17.119154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.119065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.119065+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.119065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:53:27.091140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:16.389808+0000","last_change":"2024-02-17T14:30:16.389833+0000","last_active":"2024-02-17T14:30:16.389808+0000","last_peered":"2024-02-17T14:30:16.389808+0000","last_clean":"2024-02-17T14:30:16.389808+0000","last_became_active":"2024-02-17T14:28:03.638281+0000","last_became_peered":"2024-02-17T14:28:03.638281+0000","last_unstale":"2024-02-17T14:30:16.389808+0000","last_undegraded":"2024-02-17T14:30:16.389808+0000","last_fullsized":"2024-02-17T14:30:16.389808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:16.389721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:16.389721+0000","last_clean_scrub_stamp":"2024-02-17T14:30:16.389721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:50:20.635618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.237560+0000","last_change":"2024-02-17T14:30:07.237593+0000","last_active":"2024-02-17T14:30:07.237560+0000","last_peered":"2024-02-17T14:30:07.237560+0000","last_clean":"2024-02-17T14:30:07.237560+0000","last_became_active":"2024-02-17T14:28:03.072571+0000","last_became_peered":"2024-02-17T14:28:03.072571+0000","last_unstale":"2024-02-17T14:30:07.237560+0000","last_undegraded":"2024-02-17T14:30:07.237560+0000","last_fullsized":"2024-02-17T14:30:07.237560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.237475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.237475+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.237475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:04.843810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:21.128826+0000","last_change":"2024-02-17T14:30:21.128869+0000","last_active":"2024-02-17T14:30:21.128826+0000","last_peered":"2024-02-17T14:30:21.128826+0000","last_clean":"2024-02-17T14:30:21.128826+0000","last_became_active":"2024-02-17T14:28:07.849096+0000","last_became_peered":"2024-02-17T14:28:07.849096+0000","last_unstale":"2024-02-17T14:30:21.128826+0000","last_undegraded":"2024-02-17T14:30:21.128826+0000","last_fullsized":"2024-02-17T14:30:21.128826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:21.128695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:21.128695+0000","last_clean_scrub_stamp":"2024-02-17T14:30:21.128695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:45:37.081085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:16.481829+0000","last_change":"2024-02-17T14:30:16.481873+0000","last_active":"2024-02-17T14:30:16.481829+0000","last_peered":"2024-02-17T14:30:16.481829+0000","last_clean":"2024-02-17T14:30:16.481829+0000","last_became_active":"2024-02-17T14:28:07.849053+0000","last_became_peered":"2024-02-17T14:28:07.849053+0000","last_unstale":"2024-02-17T14:30:16.481829+0000","last_undegraded":"2024-02-17T14:30:16.481829+0000","last_fullsized":"2024-02-17T14:30:16.481829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:16.481714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:16.481714+0000","last_clean_scrub_stamp":"2024-02-17T14:30:16.481714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:50:20.727610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.202169+0000","last_change":"2024-02-17T14:30:12.202205+0000","last_active":"2024-02-17T14:30:12.202169+0000","last_peered":"2024-02-17T14:30:12.202169+0000","last_clean":"2024-02-17T14:30:12.202169+0000","last_became_active":"2024-02-17T14:28:03.632204+0000","last_became_peered":"2024-02-17T14:28:03.632204+0000","last_unstale":"2024-02-17T14:30:12.202169+0000","last_undegraded":"2024-02-17T14:30:12.202169+0000","last_fullsized":"2024-02-17T14:30:12.202169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.202091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.202091+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.202091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:23.419025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.403929+0000","last_change":"2024-02-17T14:30:06.403982+0000","last_active":"2024-02-17T14:30:06.403929+0000","last_peered":"2024-02-17T14:30:06.403929+0000","last_clean":"2024-02-17T14:30:06.403929+0000","last_became_active":"2024-02-17T14:28:03.062390+0000","last_became_peered":"2024-02-17T14:28:03.062390+0000","last_unstale":"2024-02-17T14:30:06.403929+0000","last_undegraded":"2024-02-17T14:30:06.403929+0000","last_fullsized":"2024-02-17T14:30:06.403929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:06.403827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:06.403827+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.403827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:22:53.200731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.134470+0000","last_change":"2024-02-17T14:30:17.134498+0000","last_active":"2024-02-17T14:30:17.134470+0000","last_peered":"2024-02-17T14:30:17.134470+0000","last_clean":"2024-02-17T14:30:17.134470+0000","last_became_active":"2024-02-17T14:28:07.650627+0000","last_became_peered":"2024-02-17T14:28:07.650627+0000","last_unstale":"2024-02-17T14:30:17.134470+0000","last_undegraded":"2024-02-17T14:30:17.134470+0000","last_fullsized":"2024-02-17T14:30:17.134470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.134388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.134388+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.134388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:16.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.094130+0000","last_change":"2024-02-17T14:30:12.094157+0000","last_active":"2024-02-17T14:30:12.094130+0000","last_peered":"2024-02-17T14:30:12.094130+0000","last_clean":"2024-02-17T14:30:12.094130+0000","last_became_active":"2024-02-17T14:28:03.627708+0000","last_became_peered":"2024-02-17T14:28:03.627708+0000","last_unstale":"2024-02-17T14:30:12.094130+0000","last_undegraded":"2024-02-17T14:30:12.094130+0000","last_fullsized":"2024-02-17T14:30:12.094130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.094041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.094041+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.094041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:58.317152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.102898+0000","last_change":"2024-02-17T14:30:09.102921+0000","last_active":"2024-02-17T14:30:09.102898+0000","last_peered":"2024-02-17T14:30:09.102898+0000","last_clean":"2024-02-17T14:30:09.102898+0000","last_became_active":"2024-02-17T14:28:03.071170+0000","last_became_peered":"2024-02-17T14:28:03.071170+0000","last_unstale":"2024-02-17T14:30:09.102898+0000","last_undegraded":"2024-02-17T14:30:09.102898+0000","last_fullsized":"2024-02-17T14:30:09.102898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.102801+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:08.202018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.260557+0000","last_change":"2024-02-17T14:30:09.260584+0000","last_active":"2024-02-17T14:30:09.260557+0000","last_peered":"2024-02-17T14:30:09.260557+0000","last_clean":"2024-02-17T14:30:09.260557+0000","last_became_active":"2024-02-17T14:28:03.072928+0000","last_became_peered":"2024-02-17T14:28:03.072928+0000","last_unstale":"2024-02-17T14:30:09.260557+0000","last_undegraded":"2024-02-17T14:30:09.260557+0000","last_fullsized":"2024-02-17T14:30:09.260557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-02-17T14:30:09.260469+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-02-17T14:30:09.260469+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.260469+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:07:07.057446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:11.466801+0000","last_change":"2024-02-17T14:30:11.466834+0000","last_active":"2024-02-17T14:30:11.466801+0000","last_peered":"2024-02-17T14:30:11.466801+0000","last_clean":"2024-02-17T14:30:11.466801+0000","last_became_active":"2024-02-17T14:28:03.635362+0000","last_became_peered":"2024-02-17T14:28:03.635362+0000","last_unstale":"2024-02-17T14:30:11.466801+0000","last_undegraded":"2024-02-17T14:30:11.466801+0000","last_fullsized":"2024-02-17T14:30:11.466801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:11.466721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:11.466721+0000","last_clean_scrub_stamp":"2024-02-17T14:30:11.466721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:10.565938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.914621+0000","last_change":"2024-02-17T14:30:08.914663+0000","last_active":"2024-02-17T14:30:08.914621+0000","last_peered":"2024-02-17T14:30:08.914621+0000","last_clean":"2024-02-17T14:30:08.914621+0000","last_became_active":"2024-02-17T14:28:07.644637+0000","last_became_peered":"2024-02-17T14:28:07.644637+0000","last_unstale":"2024-02-17T14:30:08.914621+0000","last_undegraded":"2024-02-17T14:30:08.914621+0000","last_fullsized":"2024-02-17T14:30:08.914621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:08.914504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:08.914504+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.914504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:03:38.611046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.146225+0000","last_change":"2024-02-17T14:30:10.146253+0000","last_active":"2024-02-17T14:30:10.146225+0000","last_peered":"2024-02-17T14:30:10.146225+0000","last_clean":"2024-02-17T14:30:10.146225+0000","last_became_active":"2024-02-17T14:28:03.071112+0000","last_became_peered":"2024-02-17T14:28:03.071112+0000","last_unstale":"2024-02-17T14:30:10.146225+0000","last_undegraded":"2024-02-17T14:30:10.146225+0000","last_fullsized":"2024-02-17T14:30:10.146225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-02-17T14:30:10.146107+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-02-17T14:30:10.146107+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.146107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:21.363041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.583378+0000","last_change":"2024-02-17T14:30:05.583404+0000","last_active":"2024-02-17T14:30:05.583378+0000","last_peered":"2024-02-17T14:30:05.583378+0000","last_clean":"2024-02-17T14:30:05.583378+0000","last_became_active":"2024-02-17T14:28:03.628144+0000","last_became_peered":"2024-02-17T14:28:03.628144+0000","last_unstale":"2024-02-17T14:30:05.583378+0000","last_undegraded":"2024-02-17T14:30:05.583378+0000","last_fullsized":"2024-02-17T14:30:05.583378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:05.583304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:05.583304+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.583304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:25:58.103911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:18.081543+0000","last_change":"2024-02-17T14:30:18.081569+0000","last_active":"2024-02-17T14:30:18.081543+0000","last_peered":"2024-02-17T14:30:18.081543+0000","last_clean":"2024-02-17T14:30:18.081543+0000","last_became_active":"2024-02-17T14:28:07.647491+0000","last_became_peered":"2024-02-17T14:28:07.647491+0000","last_unstale":"2024-02-17T14:30:18.081543+0000","last_undegraded":"2024-02-17T14:30:18.081543+0000","last_fullsized":"2024-02-17T14:30:18.081543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:18.081452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:18.081452+0000","last_clean_scrub_stamp":"2024-02-17T14:30:18.081452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:27:22.063770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.240921+0000","last_change":"2024-02-17T14:30:12.240921+0000","last_active":"2024-02-17T14:30:12.240921+0000","last_peered":"2024-02-17T14:30:12.240921+0000","last_clean":"2024-02-17T14:30:12.240921+0000","last_became_active":"2024-02-17T14:28:03.630662+0000","last_became_peered":"2024-02-17T14:28:03.630662+0000","last_unstale":"2024-02-17T14:30:12.240921+0000","last_undegraded":"2024-02-17T14:30:12.240921+0000","last_fullsized":"2024-02-17T14:30:12.240921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.240798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.240798+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.240798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:22:59.037703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.969343+0000","last_change":"2024-02-17T14:30:06.969343+0000","last_active":"2024-02-17T14:30:06.969343+0000","last_peered":"2024-02-17T14:30:06.969343+0000","last_clean":"2024-02-17T14:30:06.969343+0000","last_became_active":"2024-02-17T14:28:03.628781+0000","last_became_peered":"2024-02-17T14:28:03.628781+0000","last_unstale":"2024-02-17T14:30:06.969343+0000","last_undegraded":"2024-02-17T14:30:06.969343+0000","last_fullsized":"2024-02-17T14:30:06.969343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:06.969206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:06.969206+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.969206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:37:44.610292+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:20.405186+0000","last_change":"2024-02-17T14:30:20.405207+0000","last_active":"2024-02-17T14:30:20.405186+0000","last_peered":"2024-02-17T14:30:20.405186+0000","last_clean":"2024-02-17T14:30:20.405186+0000","last_became_active":"2024-02-17T14:28:51.772895+0000","last_became_peered":"2024-02-17T14:28:51.772895+0000","last_unstale":"2024-02-17T14:30:20.405186+0000","last_undegraded":"2024-02-17T14:30:20.405186+0000","last_fullsized":"2024-02-17T14:30:20.405186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:20.405105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:20.405105+0000","last_clean_scrub_stamp":"2024-02-17T14:30:20.405105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:24:51.416034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.550801+0000","last_change":"2024-02-17T14:30:05.550801+0000","last_active":"2024-02-17T14:30:05.550801+0000","last_peered":"2024-02-17T14:30:05.550801+0000","last_clean":"2024-02-17T14:30:05.550801+0000","last_became_active":"2024-02-17T14:28:03.626738+0000","last_became_peered":"2024-02-17T14:28:03.626738+0000","last_unstale":"2024-02-17T14:30:05.550801+0000","last_undegraded":"2024-02-17T14:30:05.550801+0000","last_fullsized":"2024-02-17T14:30:05.550801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:05.550710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:05.550710+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.550710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:29.098148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.108236+0000","last_change":"2024-02-17T14:30:07.108236+0000","last_active":"2024-02-17T14:30:07.108236+0000","last_peered":"2024-02-17T14:30:07.108236+0000","last_clean":"2024-02-17T14:30:07.108236+0000","last_became_active":"2024-02-17T14:28:03.630705+0000","last_became_peered":"2024-02-17T14:28:03.630705+0000","last_unstale":"2024-02-17T14:30:07.108236+0000","last_undegraded":"2024-02-17T14:30:07.108236+0000","last_fullsized":"2024-02-17T14:30:07.108236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.108124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.108124+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.108124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:03:42.039121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:11.183877+0000","last_change":"2024-02-17T14:30:11.183877+0000","last_active":"2024-02-17T14:30:11.183877+0000","last_peered":"2024-02-17T14:30:11.183877+0000","last_clean":"2024-02-17T14:30:11.183877+0000","last_became_active":"2024-02-17T14:28:03.631476+0000","last_became_peered":"2024-02-17T14:28:03.631476+0000","last_unstale":"2024-02-17T14:30:11.183877+0000","last_undegraded":"2024-02-17T14:30:11.183877+0000","last_fullsized":"2024-02-17T14:30:11.183877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:11.183762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:11.183762+0000","last_clean_scrub_stamp":"2024-02-17T14:30:11.183762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:10.282980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:16.099832+0000","last_change":"2024-02-17T14:30:16.099832+0000","last_active":"2024-02-17T14:30:16.099832+0000","last_peered":"2024-02-17T14:30:16.099832+0000","last_clean":"2024-02-17T14:30:16.099832+0000","last_became_active":"2024-02-17T14:28:03.638442+0000","last_became_peered":"2024-02-17T14:28:03.638442+0000","last_unstale":"2024-02-17T14:30:16.099832+0000","last_undegraded":"2024-02-17T14:30:16.099832+0000","last_fullsized":"2024-02-17T14:30:16.099832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:16.099731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:16.099731+0000","last_clean_scrub_stamp":"2024-02-17T14:30:16.099731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:55.643020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.073131+0000","last_change":"2024-02-17T14:30:15.073131+0000","last_active":"2024-02-17T14:30:15.073131+0000","last_peered":"2024-02-17T14:30:15.073131+0000","last_clean":"2024-02-17T14:30:15.073131+0000","last_became_active":"2024-02-17T14:28:03.630676+0000","last_became_peered":"2024-02-17T14:28:03.630676+0000","last_unstale":"2024-02-17T14:30:15.073131+0000","last_undegraded":"2024-02-17T14:30:15.073131+0000","last_fullsized":"2024-02-17T14:30:15.073131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.073017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.073017+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.073017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:42:51.933998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:11.402321+0000","last_change":"2024-02-17T14:30:11.402321+0000","last_active":"2024-02-17T14:30:11.402321+0000","last_peered":"2024-02-17T14:30:11.402321+0000","last_clean":"2024-02-17T14:30:11.402321+0000","last_became_active":"2024-02-17T14:28:03.626848+0000","last_became_peered":"2024-02-17T14:28:03.626848+0000","last_unstale":"2024-02-17T14:30:11.402321+0000","last_undegraded":"2024-02-17T14:30:11.402321+0000","last_fullsized":"2024-02-17T14:30:11.402321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:11.402194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:11.402194+0000","last_clean_scrub_stamp":"2024-02-17T14:30:11.402194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:10.501412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:11.144170+0000","last_change":"2024-02-17T14:30:11.144170+0000","last_active":"2024-02-17T14:30:11.144170+0000","last_peered":"2024-02-17T14:30:11.144170+0000","last_clean":"2024-02-17T14:30:11.144170+0000","last_became_active":"2024-02-17T14:28:03.626450+0000","last_became_peered":"2024-02-17T14:28:03.626450+0000","last_unstale":"2024-02-17T14:30:11.144170+0000","last_undegraded":"2024-02-17T14:30:11.144170+0000","last_fullsized":"2024-02-17T14:30:11.144170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:11.144029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:11.144029+0000","last_clean_scrub_stamp":"2024-02-17T14:30:11.144029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:53:51.181231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.370133+0000","last_change":"2024-02-17T14:30:17.370133+0000","last_active":"2024-02-17T14:30:17.370133+0000","last_peered":"2024-02-17T14:30:17.370133+0000","last_clean":"2024-02-17T14:30:17.370133+0000","last_became_active":"2024-02-17T14:28:03.639330+0000","last_became_peered":"2024-02-17T14:28:03.639330+0000","last_unstale":"2024-02-17T14:30:17.370133+0000","last_undegraded":"2024-02-17T14:30:17.370133+0000","last_fullsized":"2024-02-17T14:30:17.370133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.370029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.370029+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.370029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:03:53.910725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:13.507031+0000","last_change":"2024-02-17T14:30:13.507031+0000","last_active":"2024-02-17T14:30:13.507031+0000","last_peered":"2024-02-17T14:30:13.507031+0000","last_clean":"2024-02-17T14:30:13.507031+0000","last_became_active":"2024-02-17T14:28:03.641485+0000","last_became_peered":"2024-02-17T14:28:03.641485+0000","last_unstale":"2024-02-17T14:30:13.507031+0000","last_undegraded":"2024-02-17T14:30:13.507031+0000","last_fullsized":"2024-02-17T14:30:13.507031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:13.506925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:13.506925+0000","last_clean_scrub_stamp":"2024-02-17T14:30:13.506925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:53:53.544127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.248464+0000","last_change":"2024-02-17T14:30:10.248464+0000","last_active":"2024-02-17T14:30:10.248464+0000","last_peered":"2024-02-17T14:30:10.248464+0000","last_clean":"2024-02-17T14:30:10.248464+0000","last_became_active":"2024-02-17T14:28:03.629841+0000","last_became_peered":"2024-02-17T14:28:03.629841+0000","last_unstale":"2024-02-17T14:30:10.248464+0000","last_undegraded":"2024-02-17T14:30:10.248464+0000","last_fullsized":"2024-02-17T14:30:10.248464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:10.248354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:10.248354+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.248354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:33.795792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.987118+0000","last_change":"2024-02-17T14:30:14.987118+0000","last_active":"2024-02-17T14:30:14.987118+0000","last_peered":"2024-02-17T14:30:14.987118+0000","last_clean":"2024-02-17T14:30:14.987118+0000","last_became_active":"2024-02-17T14:28:03.642150+0000","last_became_peered":"2024-02-17T14:28:03.642150+0000","last_unstale":"2024-02-17T14:30:14.987118+0000","last_undegraded":"2024-02-17T14:30:14.987118+0000","last_fullsized":"2024-02-17T14:30:14.987118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.987000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.987000+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.987000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:53:55.024202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.934762+0000","last_change":"2024-02-17T14:30:07.934805+0000","last_active":"2024-02-17T14:30:07.934762+0000","last_peered":"2024-02-17T14:30:07.934762+0000","last_clean":"2024-02-17T14:30:07.934762+0000","last_became_active":"2024-02-17T14:28:03.631844+0000","last_became_peered":"2024-02-17T14:28:03.631844+0000","last_unstale":"2024-02-17T14:30:07.934762+0000","last_undegraded":"2024-02-17T14:30:07.934762+0000","last_fullsized":"2024-02-17T14:30:07.934762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.934653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.934653+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.934653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:40:58.635577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.894915+0000","last_change":"2024-02-17T14:30:10.894943+0000","last_active":"2024-02-17T14:30:10.894915+0000","last_peered":"2024-02-17T14:30:10.894915+0000","last_clean":"2024-02-17T14:30:10.894915+0000","last_became_active":"2024-02-17T14:28:52.061682+0000","last_became_peered":"2024-02-17T14:28:52.061682+0000","last_unstale":"2024-02-17T14:30:10.894915+0000","last_undegraded":"2024-02-17T14:30:10.894915+0000","last_fullsized":"2024-02-17T14:30:10.894915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:10.894805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:10.894805+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.894805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:26:03.415413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.406307+0000","last_change":"2024-02-17T14:30:14.406332+0000","last_active":"2024-02-17T14:30:14.406307+0000","last_peered":"2024-02-17T14:30:14.406307+0000","last_clean":"2024-02-17T14:30:14.406307+0000","last_became_active":"2024-02-17T14:28:03.628343+0000","last_became_peered":"2024-02-17T14:28:03.628343+0000","last_unstale":"2024-02-17T14:30:14.406307+0000","last_undegraded":"2024-02-17T14:30:14.406307+0000","last_fullsized":"2024-02-17T14:30:14.406307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.406230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.406230+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.406230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:34:50.356652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:13.210629+0000","last_change":"2024-02-17T14:30:13.210671+0000","last_active":"2024-02-17T14:30:13.210629+0000","last_peered":"2024-02-17T14:30:13.210629+0000","last_clean":"2024-02-17T14:30:13.210629+0000","last_became_active":"2024-02-17T14:28:03.635340+0000","last_became_peered":"2024-02-17T14:28:03.635340+0000","last_unstale":"2024-02-17T14:30:13.210629+0000","last_undegraded":"2024-02-17T14:30:13.210629+0000","last_fullsized":"2024-02-17T14:30:13.210629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:13.210534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:13.210534+0000","last_clean_scrub_stamp":"2024-02-17T14:30:13.210534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:53:53.247736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:02.574885+0000","last_change":"2024-02-17T14:30:02.574905+0000","last_active":"2024-02-17T14:30:02.574885+0000","last_peered":"2024-02-17T14:30:02.574885+0000","last_clean":"2024-02-17T14:30:02.574885+0000","last_became_active":"2024-02-17T14:28:03.632273+0000","last_became_peered":"2024-02-17T14:28:03.632273+0000","last_unstale":"2024-02-17T14:30:02.574885+0000","last_undegraded":"2024-02-17T14:30:02.574885+0000","last_fullsized":"2024-02-17T14:30:02.574885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:02.574820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:02.574820+0000","last_clean_scrub_stamp":"2024-02-17T14:30:02.574820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:00.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.169630+0000","last_change":"2024-02-17T14:30:05.169649+0000","last_active":"2024-02-17T14:30:05.169630+0000","last_peered":"2024-02-17T14:30:05.169630+0000","last_clean":"2024-02-17T14:30:05.169630+0000","last_became_active":"2024-02-17T14:28:03.631431+0000","last_became_peered":"2024-02-17T14:28:03.631431+0000","last_unstale":"2024-02-17T14:30:05.169630+0000","last_undegraded":"2024-02-17T14:30:05.169630+0000","last_fullsized":"2024-02-17T14:30:05.169630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:05.169569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:05.169569+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.169569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:36.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.583981+0000","last_change":"2024-02-17T14:30:07.584023+0000","last_active":"2024-02-17T14:30:07.583981+0000","last_peered":"2024-02-17T14:30:07.583981+0000","last_clean":"2024-02-17T14:30:07.583981+0000","last_became_active":"2024-02-17T14:28:03.631379+0000","last_became_peered":"2024-02-17T14:28:03.631379+0000","last_unstale":"2024-02-17T14:30:07.583981+0000","last_undegraded":"2024-02-17T14:30:07.583981+0000","last_fullsized":"2024-02-17T14:30:07.583981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.583864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.583864+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.583864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:30:35.765958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.189107+0000","last_change":"2024-02-17T14:30:14.189128+0000","last_active":"2024-02-17T14:30:14.189107+0000","last_peered":"2024-02-17T14:30:14.189107+0000","last_clean":"2024-02-17T14:30:14.189107+0000","last_became_active":"2024-02-17T14:28:03.635254+0000","last_became_peered":"2024-02-17T14:28:03.635254+0000","last_unstale":"2024-02-17T14:30:14.189107+0000","last_undegraded":"2024-02-17T14:30:14.189107+0000","last_fullsized":"2024-02-17T14:30:14.189107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.189007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.189007+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.189007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:14:51.228122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.148708+0000","last_change":"2024-02-17T14:30:15.148748+0000","last_active":"2024-02-17T14:30:15.148708+0000","last_peered":"2024-02-17T14:30:15.148708+0000","last_clean":"2024-02-17T14:30:15.148708+0000","last_became_active":"2024-02-17T14:28:03.635312+0000","last_became_peered":"2024-02-17T14:28:03.635312+0000","last_unstale":"2024-02-17T14:30:15.148708+0000","last_undegraded":"2024-02-17T14:30:15.148708+0000","last_fullsized":"2024-02-17T14:30:15.148708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.148595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.148595+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.148595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:03:50.079591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:21.041644+0000","last_change":"2024-02-17T14:30:21.041670+0000","last_active":"2024-02-17T14:30:21.041644+0000","last_peered":"2024-02-17T14:30:21.041644+0000","last_clean":"2024-02-17T14:30:21.041644+0000","last_became_active":"2024-02-17T14:28:03.646337+0000","last_became_peered":"2024-02-17T14:28:03.646337+0000","last_unstale":"2024-02-17T14:30:21.041644+0000","last_undegraded":"2024-02-17T14:30:21.041644+0000","last_fullsized":"2024-02-17T14:30:21.041644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:21.041543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:21.041543+0000","last_clean_scrub_stamp":"2024-02-17T14:30:21.041543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:32:05.255567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:04.133577+0000","last_change":"2024-02-17T14:30:04.133597+0000","last_active":"2024-02-17T14:30:04.133577+0000","last_peered":"2024-02-17T14:30:04.133577+0000","last_clean":"2024-02-17T14:30:04.133577+0000","last_became_active":"2024-02-17T14:28:03.634751+0000","last_became_peered":"2024-02-17T14:28:03.634751+0000","last_unstale":"2024-02-17T14:30:04.133577+0000","last_undegraded":"2024-02-17T14:30:04.133577+0000","last_fullsized":"2024-02-17T14:30:04.133577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:04.133504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:04.133504+0000","last_clean_scrub_stamp":"2024-02-17T14:30:04.133504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:18:14.017425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.996913+0000","last_change":"2024-02-17T14:30:17.996941+0000","last_active":"2024-02-17T14:30:17.996913+0000","last_peered":"2024-02-17T14:30:17.996913+0000","last_clean":"2024-02-17T14:30:17.996913+0000","last_became_active":"2024-02-17T14:28:03.641260+0000","last_became_peered":"2024-02-17T14:28:03.641260+0000","last_unstale":"2024-02-17T14:30:17.996913+0000","last_undegraded":"2024-02-17T14:30:17.996913+0000","last_fullsized":"2024-02-17T14:30:17.996913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.996820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.996820+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.996820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:50:22.242716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:13.411485+0000","last_change":"2024-02-17T14:30:13.411522+0000","last_active":"2024-02-17T14:30:13.411485+0000","last_peered":"2024-02-17T14:30:13.411485+0000","last_clean":"2024-02-17T14:30:13.411485+0000","last_became_active":"2024-02-17T14:28:03.627918+0000","last_became_peered":"2024-02-17T14:28:03.627918+0000","last_unstale":"2024-02-17T14:30:13.411485+0000","last_undegraded":"2024-02-17T14:30:13.411485+0000","last_fullsized":"2024-02-17T14:30:13.411485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:13.411374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:13.411374+0000","last_clean_scrub_stamp":"2024-02-17T14:30:13.411374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:53:53.448576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.999284+0000","last_change":"2024-02-17T14:30:12.999310+0000","last_active":"2024-02-17T14:30:12.999284+0000","last_peered":"2024-02-17T14:30:12.999284+0000","last_clean":"2024-02-17T14:30:12.999284+0000","last_became_active":"2024-02-17T14:28:03.640873+0000","last_became_peered":"2024-02-17T14:28:03.640873+0000","last_unstale":"2024-02-17T14:30:12.999284+0000","last_undegraded":"2024-02-17T14:30:12.999284+0000","last_fullsized":"2024-02-17T14:30:12.999284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.999202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.999202+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.999202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:12.098420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.883684+0000","last_change":"2024-02-17T14:30:09.883707+0000","last_active":"2024-02-17T14:30:09.883684+0000","last_peered":"2024-02-17T14:30:09.883684+0000","last_clean":"2024-02-17T14:30:09.883684+0000","last_became_active":"2024-02-17T14:28:51.767928+0000","last_became_peered":"2024-02-17T14:28:51.767928+0000","last_unstale":"2024-02-17T14:30:09.883684+0000","last_undegraded":"2024-02-17T14:30:09.883684+0000","last_fullsized":"2024-02-17T14:30:09.883684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.883594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.883594+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.883594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:05.990084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.555862+0000","last_change":"2024-02-17T14:30:06.555862+0000","last_active":"2024-02-17T14:30:06.555862+0000","last_peered":"2024-02-17T14:30:06.555862+0000","last_clean":"2024-02-17T14:30:06.555862+0000","last_became_active":"2024-02-17T14:28:03.627978+0000","last_became_peered":"2024-02-17T14:28:03.627978+0000","last_unstale":"2024-02-17T14:30:06.555862+0000","last_undegraded":"2024-02-17T14:30:06.555862+0000","last_fullsized":"2024-02-17T14:30:06.555862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:06.555656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:06.555656+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.555656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:13:56.458632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:03.078338+0000","last_change":"2024-02-17T14:30:03.078338+0000","last_active":"2024-02-17T14:30:03.078338+0000","last_peered":"2024-02-17T14:30:03.078338+0000","last_clean":"2024-02-17T14:30:03.078338+0000","last_became_active":"2024-02-17T14:28:03.631493+0000","last_became_peered":"2024-02-17T14:28:03.631493+0000","last_unstale":"2024-02-17T14:30:03.078338+0000","last_undegraded":"2024-02-17T14:30:03.078338+0000","last_fullsized":"2024-02-17T14:30:03.078338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:03.078243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:03.078243+0000","last_clean_scrub_stamp":"2024-02-17T14:30:03.078243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:34:29.696791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.996206+0000","last_change":"2024-02-17T14:30:15.996242+0000","last_active":"2024-02-17T14:30:15.996206+0000","last_peered":"2024-02-17T14:30:15.996206+0000","last_clean":"2024-02-17T14:30:15.996206+0000","last_became_active":"2024-02-17T14:28:03.641154+0000","last_became_peered":"2024-02-17T14:28:03.641154+0000","last_unstale":"2024-02-17T14:30:15.996206+0000","last_undegraded":"2024-02-17T14:30:15.996206+0000","last_fullsized":"2024-02-17T14:30:15.996206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.996111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.996111+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.996111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:34:51.946534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8923,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":17846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":709990,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53600000000000003,"15min":0.53900000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.436}]},{"osd":1,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.59999999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.65600000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.53700000000000003}]},{"osd":2,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.67400000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.68500000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57699999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.55100000000000005,"15min":0.55900000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67000000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36699999999999999}]},{"osd":5,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.745,"5min":0.751,"15min":0.751},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58599999999999997}]},{"osd":6,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.55300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.755,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.443,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57399999999999995}]},{"osd":1,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73599999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.51200000000000001}]},{"osd":2,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.74099999999999999,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.498},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.67000000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.68799999999999994,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78100000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.32900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63800000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.309},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67300000000000004,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40799999999999997}]},{"osd":5,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69299999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73699999999999999,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.36899999999999999}]},{"osd":7,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71999999999999997,"5min":0.754,"15min":0.754},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68500000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40899999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.376,"5min":0.222,"15min":0.222},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.43099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.44500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.746,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.55200000000000005}]},{"osd":2,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53700000000000003,"15min":0.53100000000000003},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.499,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.436},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.625,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.41999999999999998}]},{"osd":6,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48799999999999999,"15min":0.48999999999999999},"min":{"1min":0.35099999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.52000000000000002,"15min":0.52300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68200000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.74199999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":119166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.61299999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.63800000000000001}]},{"osd":1,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.432,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.66100000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65800000000000003,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.56200000000000006}]},{"osd":2,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66400000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.66000000000000003}]},{"osd":3,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.65500000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70099999999999996,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.622}]},{"osd":5,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70399999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48799999999999999,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68799999999999994,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.501}]},{"osd":6,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.33700000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.64800000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76500000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70199999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.66800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39100000000000001,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50800000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.27500000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.433,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.39100000000000001}]},{"osd":1,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.254,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56999999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42799999999999999}]},{"osd":2,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.39700000000000002,"15min":0.39100000000000001},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60099999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.372},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.44,"15min":0.442},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59499999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.46899999999999997}]},{"osd":4,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77500000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76900000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.73299999999999998}]},{"osd":6,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.44900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.44800000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.72999999999999998,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.58999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":119040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.36299999999999999,"15min":0.36799999999999999},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51600000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.443},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.53200000000000003,"5min":1.401,"15min":1.401},"last":0.48099999999999998}]},{"osd":1,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.59999999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41099999999999998,"15min":0.41499999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64200000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57399999999999995,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.53700000000000003}]},{"osd":4,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84299999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.75}]},{"osd":5,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.46700000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.79500000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.86499999999999999}]},{"osd":6,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77400000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84599999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.47699999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81200000000000006,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.91900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":119200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.33800000000000002},"min":{"1min":0.247,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.48699999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.36399999999999999,"15min":0.36499999999999999},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.46600000000000003,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.38500000000000001}]},{"osd":2,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.251,"5min":0.217,"15min":0.217},"max":{"1min":0.44500000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.53300000000000003,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.41399999999999998}]},{"osd":3,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44500000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55200000000000005,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.30599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.50800000000000001,"5min":1.056,"15min":1.056},"last":0.437}]},{"osd":4,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.41699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70099999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.434,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76400000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.84399999999999997}]},{"osd":5,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.441,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77800000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77700000000000002}]},{"osd":6,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68899999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.73699999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61199999999999999}]},{"osd":7,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59699999999999998,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.72399999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.79400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":710046,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34799999999999998,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.34300000000000003,"15min":0.33900000000000002},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.39100000000000001}]},{"osd":2,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.35899999999999999,"15min":0.35299999999999998},"min":{"1min":0.28100000000000003,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35899999999999999,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.25900000000000001}]},{"osd":3,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.379},"min":{"1min":0.25900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39300000000000002},"min":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.30499999999999999}]},{"osd":4,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78900000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70999999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.45900000000000002}]},{"osd":5,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.623,"15min":0.628},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79700000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.48799999999999999}]},{"osd":6,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.73499999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70799999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.44600000000000001}]},{"osd":7,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.47399999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.76600000000000001,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63,"15min":0.628},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.752,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":8125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":8125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T14:30:25.400 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-17T14:28:06.624617+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=28, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=14, tm_min=30, tm_sec=0, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T14:30:25.402 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-17T14:30:36.753 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:30:36.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:30:45.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T14:30:45.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.513+0000 7fecfcf0c640 1 Processor -- start 2024-02-17T14:30:45.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.513+0000 7fecfcf0c640 1 -- start start 2024-02-17T14:30:45.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.514+0000 7fecfcf0c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecf809b3f0 0x7fecf80b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.514+0000 7fecfcf0c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fecf8146f20 0x7fecf8147380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.514+0000 7fecfcf0c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fecf814a490 0x7fecf814a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.514+0000 7fecfcf0c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf806b530 con 0x7fecf814a490 2024-02-17T14:30:45.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.514+0000 7fecfcf0c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf80b85e0 con 0x7fecf8146f20 2024-02-17T14:30:45.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.514+0000 7fecfcf0c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf81478c0 con 0x7fecf809b3f0 2024-02-17T14:30:45.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.514+0000 7fecf6d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fecf814a490 0x7fecf814a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.514+0000 7fecf6d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fecf814a490 0x7fecf814a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58960/0 (socket says 172.21.15.134:58960) 2024-02-17T14:30:45.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.514+0000 7fecf6d9d640 1 -- 172.21.15.134:0/84466661 learned_addr learned my addr 172.21.15.134:0/84466661 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:45.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.514+0000 7fecf659c640 1 --2- 172.21.15.134:0/84466661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecf809b3f0 0x7fecf80b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.514+0000 7feceffff640 1 --2- 172.21.15.134:0/84466661 >> v2:172.21.15.142:3300/0 conn(0x7fecf8146f20 0x7fecf8147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.514+0000 7fecf6d9d640 1 -- 172.21.15.134:0/84466661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecf809b3f0 msgr2=0x7fecf80b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:45.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.514+0000 7fecf6d9d640 1 --2- 172.21.15.134:0/84466661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecf809b3f0 0x7fecf80b6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.515+0000 7fecf6d9d640 1 -- 172.21.15.134:0/84466661 >> v2:172.21.15.142:3300/0 conn(0x7fecf8146f20 msgr2=0x7fecf8147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:45.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.515+0000 7fecf6d9d640 1 --2- 172.21.15.134:0/84466661 >> v2:172.21.15.142:3300/0 conn(0x7fecf8146f20 0x7fecf8147380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.515+0000 7fecf6d9d640 1 -- 172.21.15.134:0/84466661 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf809b7d0 con 0x7fecf814a490 2024-02-17T14:30:45.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.515+0000 7fecf6d9d640 1 --2- 172.21.15.134:0/84466661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf814a490 0x7fecf814a8f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fecf80bc590 tx=0x7fecf002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0331a7a1555ddc9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:45.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.515+0000 7fecf5d9b640 1 -- 172.21.15.134:0/84466661 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf002ca70 con 0x7fecf814a490 2024-02-17T14:30:45.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.515+0000 7fecf5d9b640 1 -- 172.21.15.134:0/84466661 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf002cbd0 con 0x7fecf814a490 2024-02-17T14:30:45.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.515+0000 7fecf5d9b640 1 -- 172.21.15.134:0/84466661 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00343f0 con 0x7fecf814a490 2024-02-17T14:30:45.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.516+0000 7fecfcf0c640 1 -- 172.21.15.134:0/84466661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf814a490 msgr2=0x7fecf814a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:45.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.516+0000 7fecfcf0c640 1 --2- 172.21.15.134:0/84466661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf814a490 0x7fecf814a8f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fecf80bc590 tx=0x7fecf002bed0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.516+0000 7fecfcf0c640 1 -- 172.21.15.134:0/84466661 shutdown_connections 2024-02-17T14:30:45.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.516+0000 7fecfcf0c640 1 --2- 172.21.15.134:0/84466661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf814a490 0x7fecf814a8f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.516+0000 7fecfcf0c640 1 --2- 172.21.15.134:0/84466661 >> v2:172.21.15.142:3300/0 conn(0x7fecf8146f20 0x7fecf8147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.516+0000 7fecfcf0c640 1 --2- 172.21.15.134:0/84466661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecf809b3f0 0x7fecf80b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.516+0000 7fecfcf0c640 1 -- 172.21.15.134:0/84466661 >> 172.21.15.134:0/84466661 conn(0x7fecf80bc630 msgr2=0x7fecf80bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:45.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.516+0000 7fecfcf0c640 1 -- 172.21.15.134:0/84466661 shutdown_connections 2024-02-17T14:30:45.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.516+0000 7fecfcf0c640 1 -- 172.21.15.134:0/84466661 wait complete. 2024-02-17T14:30:45.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.517+0000 7fecfcf0c640 1 Processor -- start 2024-02-17T14:30:45.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.517+0000 7fecfcf0c640 1 -- start start 2024-02-17T14:30:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecfcf0c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecf809b3f0 0x7fecf809d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecfcf0c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecf8146f20 0x7fecf80b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecfcf0c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf814a490 0x7fecf80b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecfcf0c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf81447b0 con 0x7fecf814a490 2024-02-17T14:30:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecfcf0c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80b14b0 con 0x7fecf809b3f0 2024-02-17T14:30:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecfcf0c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf809de50 con 0x7fecf8146f20 2024-02-17T14:30:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecf6d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf814a490 0x7fecf80b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecf6d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf814a490 0x7fecf80b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58972/0 (socket says 172.21.15.134:58972) 2024-02-17T14:30:45.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecf6d9d640 1 -- 172.21.15.134:0/666592652 learned_addr learned my addr 172.21.15.134:0/666592652 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:45.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7feceffff640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecf8146f20 0x7fecf80b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecf659c640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecf809b3f0 0x7fecf809d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecf6d9d640 1 -- 172.21.15.134:0/666592652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecf8146f20 msgr2=0x7fecf80b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:45.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecf6d9d640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecf8146f20 0x7fecf80b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecf6d9d640 1 -- 172.21.15.134:0/666592652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecf809b3f0 msgr2=0x7fecf809d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:45.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecf6d9d640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecf809b3f0 0x7fecf809d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.518+0000 7fecf6d9d640 1 -- 172.21.15.134:0/666592652 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf0009b30 con 0x7fecf814a490 2024-02-17T14:30:45.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.519+0000 7fecf6d9d640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf814a490 0x7fecf80b2780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fecf0036040 tx=0x7fecf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:45.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.519+0000 7feceeffd640 1 -- 172.21.15.134:0/666592652 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0009510 con 0x7fecf814a490 2024-02-17T14:30:45.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.519+0000 7feceeffd640 1 -- 172.21.15.134:0/666592652 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf003e450 con 0x7fecf814a490 2024-02-17T14:30:45.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.519+0000 7fecfcf0c640 1 -- 172.21.15.134:0/666592652 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf80af930 con 0x7fecf814a490 2024-02-17T14:30:45.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.519+0000 7feceeffd640 1 -- 172.21.15.134:0/666592652 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf003e800 con 0x7fecf814a490 2024-02-17T14:30:45.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.519+0000 7fecfcf0c640 1 -- 172.21.15.134:0/666592652 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf80b3a30 con 0x7fecf814a490 2024-02-17T14:30:45.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.520+0000 7fecfcf0c640 1 -- 172.21.15.134:0/666592652 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf8146b60 con 0x7fecf814a490 2024-02-17T14:30:45.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.520+0000 7feceeffd640 1 -- 172.21.15.134:0/666592652 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fecf003e960 con 0x7fecf814a490 2024-02-17T14:30:45.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.521+0000 7feceeffd640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fecd806b810 0x7fecd806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.521+0000 7feceeffd640 1 -- 172.21.15.134:0/666592652 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fecf00ad0a0 con 0x7fecf814a490 2024-02-17T14:30:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.521+0000 7fecf659c640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fecd806b810 0x7fecd806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.521+0000 7fecf659c640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fecd806b810 0x7fecd806dcd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fece8009aa0 tx=0x7fece8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:45.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.525+0000 7feceeffd640 1 -- 172.21.15.134:0/666592652 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fecf0077800 con 0x7fecf814a490 2024-02-17T14:30:45.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.694+0000 7fecfcf0c640 1 -- 172.21.15.134:0/666592652 --> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fecf80bd480 con 0x7fecd806b810 2024-02-17T14:30:45.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.703+0000 7feceeffd640 1 -- 172.21.15.134:0/666592652 <== mgr.4110 v2:172.21.15.134:6832/653762796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371051 (secure 0 0 0) 0x7fece8011a00 con 0x7fecd806b810 2024-02-17T14:30:45.707 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:30:45.709 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-02-17T14:30:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.706+0000 7fecfcf0c640 1 -- 172.21.15.134:0/666592652 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fecd806b810 msgr2=0x7fecd806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.706+0000 7fecfcf0c640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fecd806b810 0x7fecd806dcd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fece8009aa0 tx=0x7fece8009190 comp rx=0 tx=0).stop 2024-02-17T14:30:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.706+0000 7fecfcf0c640 1 -- 172.21.15.134:0/666592652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf814a490 msgr2=0x7fecf80b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.706+0000 7fecfcf0c640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf814a490 0x7fecf80b2780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fecf0036040 tx=0x7fecf0004a40 comp rx=0 tx=0).stop 2024-02-17T14:30:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.706+0000 7fecfcf0c640 1 -- 172.21.15.134:0/666592652 shutdown_connections 2024-02-17T14:30:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.706+0000 7fecfcf0c640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fecd806b810 0x7fecd806dcd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.706+0000 7fecfcf0c640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf814a490 0x7fecf80b2780 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.706+0000 7fecfcf0c640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecf8146f20 0x7fecf80b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.706+0000 7fecfcf0c640 1 --2- 172.21.15.134:0/666592652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecf809b3f0 0x7fecf809d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.706+0000 7fecfcf0c640 1 -- 172.21.15.134:0/666592652 >> 172.21.15.134:0/666592652 conn(0x7fecf80bc630 msgr2=0x7fecf80b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.706+0000 7fecfcf0c640 1 -- 172.21.15.134:0/666592652 shutdown_connections 2024-02-17T14:30:45.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.706+0000 7fecfcf0c640 1 -- 172.21.15.134:0/666592652 wait complete. 2024-02-17T14:30:45.717 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-02-17T14:30:44.606223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599291,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":219,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218600,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756120,"statfs":{"total":773094113280,"available":772870266880,"internally_reserved":0,"allocated":2531328,"data_stored":2150902,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003515"},"pg_stats":[{"pgid":"2.1f","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:04.510878+0000","last_change":"2024-02-17T14:30:04.510878+0000","last_active":"2024-02-17T14:30:04.510878+0000","last_peered":"2024-02-17T14:30:04.510878+0000","last_clean":"2024-02-17T14:30:04.510878+0000","last_became_active":"2024-02-17T14:28:03.068714+0000","last_became_peered":"2024-02-17T14:28:03.068714+0000","last_unstale":"2024-02-17T14:30:04.510878+0000","last_undegraded":"2024-02-17T14:30:04.510878+0000","last_fullsized":"2024-02-17T14:30:04.510878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-02-17T14:30:04.510740+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-02-17T14:30:04.510740+0000","last_clean_scrub_stamp":"2024-02-17T14:30:04.510740+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:22:37.125845+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:03.154590+0000","last_change":"2024-02-17T14:30:03.154590+0000","last_active":"2024-02-17T14:30:03.154590+0000","last_peered":"2024-02-17T14:30:03.154590+0000","last_clean":"2024-02-17T14:30:03.154590+0000","last_became_active":"2024-02-17T14:28:03.631462+0000","last_became_peered":"2024-02-17T14:28:03.631462+0000","last_unstale":"2024-02-17T14:30:03.154590+0000","last_undegraded":"2024-02-17T14:30:03.154590+0000","last_fullsized":"2024-02-17T14:30:03.154590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:03.154491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:03.154491+0000","last_clean_scrub_stamp":"2024-02-17T14:30:03.154491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:19:10.507514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:22.159768+0000","last_change":"2024-02-17T14:30:22.159768+0000","last_active":"2024-02-17T14:30:22.159768+0000","last_peered":"2024-02-17T14:30:22.159768+0000","last_clean":"2024-02-17T14:30:22.159768+0000","last_became_active":"2024-02-17T14:28:07.849871+0000","last_became_peered":"2024-02-17T14:28:07.849871+0000","last_unstale":"2024-02-17T14:30:22.159768+0000","last_undegraded":"2024-02-17T14:30:22.159768+0000","last_fullsized":"2024-02-17T14:30:22.159768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:22.159643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:22.159643+0000","last_clean_scrub_stamp":"2024-02-17T14:30:22.159643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:19:58.628043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.105154+0000","last_change":"2024-02-17T14:30:08.105184+0000","last_active":"2024-02-17T14:30:08.105154+0000","last_peered":"2024-02-17T14:30:08.105154+0000","last_clean":"2024-02-17T14:30:08.105154+0000","last_became_active":"2024-02-17T14:28:03.068978+0000","last_became_peered":"2024-02-17T14:28:03.068978+0000","last_unstale":"2024-02-17T14:30:08.105154+0000","last_undegraded":"2024-02-17T14:30:08.105154+0000","last_fullsized":"2024-02-17T14:30:08.105154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-02-17T14:30:08.105064+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-02-17T14:30:08.105064+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.105064+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:47.648353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.516392+0000","last_change":"2024-02-17T14:30:09.516392+0000","last_active":"2024-02-17T14:30:09.516392+0000","last_peered":"2024-02-17T14:30:09.516392+0000","last_clean":"2024-02-17T14:30:09.516392+0000","last_became_active":"2024-02-17T14:28:03.630517+0000","last_became_peered":"2024-02-17T14:28:03.630517+0000","last_unstale":"2024-02-17T14:30:09.516392+0000","last_undegraded":"2024-02-17T14:30:09.516392+0000","last_fullsized":"2024-02-17T14:30:09.516392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.516283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.516283+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.516283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:03:44.447279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.661550+0000","last_change":"2024-02-17T14:30:09.661550+0000","last_active":"2024-02-17T14:30:09.661550+0000","last_peered":"2024-02-17T14:30:09.661550+0000","last_clean":"2024-02-17T14:30:09.661550+0000","last_became_active":"2024-02-17T14:28:07.644458+0000","last_became_peered":"2024-02-17T14:28:07.644458+0000","last_unstale":"2024-02-17T14:30:09.661550+0000","last_undegraded":"2024-02-17T14:30:09.661550+0000","last_fullsized":"2024-02-17T14:30:09.661550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.661429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.661429+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.661429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:18:19.545350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.886314+0000","last_change":"2024-02-17T14:30:06.886314+0000","last_active":"2024-02-17T14:30:06.886314+0000","last_peered":"2024-02-17T14:30:06.886314+0000","last_clean":"2024-02-17T14:30:06.886314+0000","last_became_active":"2024-02-17T14:28:03.070955+0000","last_became_peered":"2024-02-17T14:28:03.070955+0000","last_unstale":"2024-02-17T14:30:06.886314+0000","last_undegraded":"2024-02-17T14:30:06.886314+0000","last_fullsized":"2024-02-17T14:30:06.886314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-02-17T14:30:06.886201+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-02-17T14:30:06.886201+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.886201+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:30.433639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:04.447173+0000","last_change":"2024-02-17T14:30:04.447173+0000","last_active":"2024-02-17T14:30:04.447173+0000","last_peered":"2024-02-17T14:30:04.447173+0000","last_clean":"2024-02-17T14:30:04.447173+0000","last_became_active":"2024-02-17T14:28:03.627865+0000","last_became_peered":"2024-02-17T14:28:03.627865+0000","last_unstale":"2024-02-17T14:30:04.447173+0000","last_undegraded":"2024-02-17T14:30:04.447173+0000","last_fullsized":"2024-02-17T14:30:04.447173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:04.447064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:04.447064+0000","last_clean_scrub_stamp":"2024-02-17T14:30:04.447064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:27.994502+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.644867+0000","last_change":"2024-02-17T14:30:12.644867+0000","last_active":"2024-02-17T14:30:12.644867+0000","last_peered":"2024-02-17T14:30:12.644867+0000","last_clean":"2024-02-17T14:30:12.644867+0000","last_became_active":"2024-02-17T14:28:07.648936+0000","last_became_peered":"2024-02-17T14:28:07.648936+0000","last_unstale":"2024-02-17T14:30:12.644867+0000","last_undegraded":"2024-02-17T14:30:12.644867+0000","last_fullsized":"2024-02-17T14:30:12.644867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.644757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.644757+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.644757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:30:15.541090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.983824+0000","last_change":"2024-02-17T14:30:10.983824+0000","last_active":"2024-02-17T14:30:10.983824+0000","last_peered":"2024-02-17T14:30:10.983824+0000","last_clean":"2024-02-17T14:30:10.983824+0000","last_became_active":"2024-02-17T14:28:03.074490+0000","last_became_peered":"2024-02-17T14:28:03.074490+0000","last_unstale":"2024-02-17T14:30:10.983824+0000","last_undegraded":"2024-02-17T14:30:10.983824+0000","last_fullsized":"2024-02-17T14:30:10.983824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-02-17T14:30:10.983707+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-02-17T14:30:10.983707+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.983707+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:03:45.914704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.367681+0000","last_change":"2024-02-17T14:30:12.367681+0000","last_active":"2024-02-17T14:30:12.367681+0000","last_peered":"2024-02-17T14:30:12.367681+0000","last_clean":"2024-02-17T14:30:12.367681+0000","last_became_active":"2024-02-17T14:28:03.627675+0000","last_became_peered":"2024-02-17T14:28:03.627675+0000","last_unstale":"2024-02-17T14:30:12.367681+0000","last_undegraded":"2024-02-17T14:30:12.367681+0000","last_fullsized":"2024-02-17T14:30:12.367681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.367585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.367585+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.367585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:23.584519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:13.664219+0000","last_change":"2024-02-17T14:30:13.664219+0000","last_active":"2024-02-17T14:30:13.664219+0000","last_peered":"2024-02-17T14:30:13.664219+0000","last_clean":"2024-02-17T14:30:13.664219+0000","last_became_active":"2024-02-17T14:28:07.651946+0000","last_became_peered":"2024-02-17T14:28:07.651946+0000","last_unstale":"2024-02-17T14:30:13.664219+0000","last_undegraded":"2024-02-17T14:30:13.664219+0000","last_fullsized":"2024-02-17T14:30:13.664219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:13.664089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:13.664089+0000","last_clean_scrub_stamp":"2024-02-17T14:30:13.664089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:53.207379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:13.197219+0000","last_change":"2024-02-17T14:30:13.197219+0000","last_active":"2024-02-17T14:30:13.197219+0000","last_peered":"2024-02-17T14:30:13.197219+0000","last_clean":"2024-02-17T14:30:13.197219+0000","last_became_active":"2024-02-17T14:28:03.634759+0000","last_became_peered":"2024-02-17T14:28:03.634759+0000","last_unstale":"2024-02-17T14:30:13.197219+0000","last_undegraded":"2024-02-17T14:30:13.197219+0000","last_fullsized":"2024-02-17T14:30:13.197219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:13.197083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:13.197083+0000","last_clean_scrub_stamp":"2024-02-17T14:30:13.197083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:44.926488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.002447+0000","last_change":"2024-02-17T14:30:12.002447+0000","last_active":"2024-02-17T14:30:12.002447+0000","last_peered":"2024-02-17T14:30:12.002447+0000","last_clean":"2024-02-17T14:30:12.002447+0000","last_became_active":"2024-02-17T14:28:03.075329+0000","last_became_peered":"2024-02-17T14:28:03.075329+0000","last_unstale":"2024-02-17T14:30:12.002447+0000","last_undegraded":"2024-02-17T14:30:12.002447+0000","last_fullsized":"2024-02-17T14:30:12.002447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-02-17T14:30:12.002282+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-02-17T14:30:12.002282+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.002282+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:51.545571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.689780+0000","last_change":"2024-02-17T14:30:10.689780+0000","last_active":"2024-02-17T14:30:10.689780+0000","last_peered":"2024-02-17T14:30:10.689780+0000","last_clean":"2024-02-17T14:30:10.689780+0000","last_became_active":"2024-02-17T14:28:07.645418+0000","last_became_peered":"2024-02-17T14:28:07.645418+0000","last_unstale":"2024-02-17T14:30:10.689780+0000","last_undegraded":"2024-02-17T14:30:10.689780+0000","last_fullsized":"2024-02-17T14:30:10.689780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:10.689642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:10.689642+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.689642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:43:56.411603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.034565+0000","last_change":"2024-02-17T14:30:14.034565+0000","last_active":"2024-02-17T14:30:14.034565+0000","last_peered":"2024-02-17T14:30:14.034565+0000","last_clean":"2024-02-17T14:30:14.034565+0000","last_became_active":"2024-02-17T14:28:03.629097+0000","last_became_peered":"2024-02-17T14:28:03.629097+0000","last_unstale":"2024-02-17T14:30:14.034565+0000","last_undegraded":"2024-02-17T14:30:14.034565+0000","last_fullsized":"2024-02-17T14:30:14.034565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.034455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.034455+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.034455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:29:14.209761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.130942+0000","last_change":"2024-02-17T14:30:09.130942+0000","last_active":"2024-02-17T14:30:09.130942+0000","last_peered":"2024-02-17T14:30:09.130942+0000","last_clean":"2024-02-17T14:30:09.130942+0000","last_became_active":"2024-02-17T14:28:03.073167+0000","last_became_peered":"2024-02-17T14:28:03.073167+0000","last_unstale":"2024-02-17T14:30:09.130942+0000","last_undegraded":"2024-02-17T14:30:09.130942+0000","last_fullsized":"2024-02-17T14:30:09.130942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.130825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.130825+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.130825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:30:12.027158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:16.666732+0000","last_change":"2024-02-17T14:30:16.666732+0000","last_active":"2024-02-17T14:30:16.666732+0000","last_peered":"2024-02-17T14:30:16.666732+0000","last_clean":"2024-02-17T14:30:16.666732+0000","last_became_active":"2024-02-17T14:28:51.773241+0000","last_became_peered":"2024-02-17T14:28:51.773241+0000","last_unstale":"2024-02-17T14:30:16.666732+0000","last_undegraded":"2024-02-17T14:30:16.666732+0000","last_fullsized":"2024-02-17T14:30:16.666732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:16.666619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:16.666619+0000","last_clean_scrub_stamp":"2024-02-17T14:30:16.666619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:16:34.590036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:13.065524+0000","last_change":"2024-02-17T14:30:13.065524+0000","last_active":"2024-02-17T14:30:13.065524+0000","last_peered":"2024-02-17T14:30:13.065524+0000","last_clean":"2024-02-17T14:30:13.065524+0000","last_became_active":"2024-02-17T14:28:03.628274+0000","last_became_peered":"2024-02-17T14:28:03.628274+0000","last_unstale":"2024-02-17T14:30:13.065524+0000","last_undegraded":"2024-02-17T14:30:13.065524+0000","last_fullsized":"2024-02-17T14:30:13.065524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:13.065385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:13.065385+0000","last_clean_scrub_stamp":"2024-02-17T14:30:13.065385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:46.622123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.116962+0000","last_change":"2024-02-17T14:30:07.116962+0000","last_active":"2024-02-17T14:30:07.116962+0000","last_peered":"2024-02-17T14:30:07.116962+0000","last_clean":"2024-02-17T14:30:07.116962+0000","last_became_active":"2024-02-17T14:28:03.072016+0000","last_became_peered":"2024-02-17T14:28:03.072016+0000","last_unstale":"2024-02-17T14:30:07.116962+0000","last_undegraded":"2024-02-17T14:30:07.116962+0000","last_fullsized":"2024-02-17T14:30:07.116962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.116803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.116803+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.116803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:43:52.838764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:18.239092+0000","last_change":"2024-02-17T14:30:18.239092+0000","last_active":"2024-02-17T14:30:18.239092+0000","last_peered":"2024-02-17T14:30:18.239092+0000","last_clean":"2024-02-17T14:30:18.239092+0000","last_became_active":"2024-02-17T14:28:07.850379+0000","last_became_peered":"2024-02-17T14:28:07.850379+0000","last_unstale":"2024-02-17T14:30:18.239092+0000","last_undegraded":"2024-02-17T14:30:18.239092+0000","last_fullsized":"2024-02-17T14:30:18.239092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:18.238969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:18.238969+0000","last_clean_scrub_stamp":"2024-02-17T14:30:18.238969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:46.596349+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:04.627024+0000","last_change":"2024-02-17T14:30:04.627024+0000","last_active":"2024-02-17T14:30:04.627024+0000","last_peered":"2024-02-17T14:30:04.627024+0000","last_clean":"2024-02-17T14:30:04.627024+0000","last_became_active":"2024-02-17T14:28:03.624517+0000","last_became_peered":"2024-02-17T14:28:03.624517+0000","last_unstale":"2024-02-17T14:30:04.627024+0000","last_undegraded":"2024-02-17T14:30:04.627024+0000","last_fullsized":"2024-02-17T14:30:04.627024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:04.626868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:04.626868+0000","last_clean_scrub_stamp":"2024-02-17T14:30:04.626868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:00.733358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.933082+0000","last_change":"2024-02-17T14:30:09.933082+0000","last_active":"2024-02-17T14:30:09.933082+0000","last_peered":"2024-02-17T14:30:09.933082+0000","last_clean":"2024-02-17T14:30:09.933082+0000","last_became_active":"2024-02-17T14:28:03.072490+0000","last_became_peered":"2024-02-17T14:28:03.072490+0000","last_unstale":"2024-02-17T14:30:09.933082+0000","last_undegraded":"2024-02-17T14:30:09.933082+0000","last_fullsized":"2024-02-17T14:30:09.933082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.932982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.932982+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.932982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:14:46.972098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.683669+0000","last_change":"2024-02-17T14:30:17.683669+0000","last_active":"2024-02-17T14:30:17.683669+0000","last_peered":"2024-02-17T14:30:17.683669+0000","last_clean":"2024-02-17T14:30:17.683669+0000","last_became_active":"2024-02-17T14:28:51.773478+0000","last_became_peered":"2024-02-17T14:28:51.773478+0000","last_unstale":"2024-02-17T14:30:17.683669+0000","last_undegraded":"2024-02-17T14:30:17.683669+0000","last_fullsized":"2024-02-17T14:30:17.683669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.683529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.683529+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.683529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:31:03.906640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.586055+0000","last_change":"2024-02-17T14:30:07.586055+0000","last_active":"2024-02-17T14:30:07.586055+0000","last_peered":"2024-02-17T14:30:07.586055+0000","last_clean":"2024-02-17T14:30:07.586055+0000","last_became_active":"2024-02-17T14:28:03.628777+0000","last_became_peered":"2024-02-17T14:28:03.628777+0000","last_unstale":"2024-02-17T14:30:07.586055+0000","last_undegraded":"2024-02-17T14:30:07.586055+0000","last_fullsized":"2024-02-17T14:30:07.586055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.585951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.585951+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.585951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:39.315356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.244971+0000","last_change":"2024-02-17T14:30:05.244971+0000","last_active":"2024-02-17T14:30:05.244971+0000","last_peered":"2024-02-17T14:30:05.244971+0000","last_clean":"2024-02-17T14:30:05.244971+0000","last_became_active":"2024-02-17T14:28:03.070790+0000","last_became_peered":"2024-02-17T14:28:03.070790+0000","last_unstale":"2024-02-17T14:30:05.244971+0000","last_undegraded":"2024-02-17T14:30:05.244971+0000","last_fullsized":"2024-02-17T14:30:05.244971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-02-17T14:30:05.244797+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-02-17T14:30:05.244797+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.244797+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:31:11.951300+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.627706+0000","last_change":"2024-02-17T14:30:15.627739+0000","last_active":"2024-02-17T14:30:15.627706+0000","last_peered":"2024-02-17T14:30:15.627706+0000","last_clean":"2024-02-17T14:30:15.627706+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:30:15.627706+0000","last_undegraded":"2024-02-17T14:30:15.627706+0000","last_fullsized":"2024-02-17T14:30:15.627706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.627610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.627610+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.627610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:47:00.157542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:16.090758+0000","last_change":"2024-02-17T14:30:16.090758+0000","last_active":"2024-02-17T14:30:16.090758+0000","last_peered":"2024-02-17T14:30:16.090758+0000","last_clean":"2024-02-17T14:30:16.090758+0000","last_became_active":"2024-02-17T14:28:03.641577+0000","last_became_peered":"2024-02-17T14:28:03.641577+0000","last_unstale":"2024-02-17T14:30:16.090758+0000","last_undegraded":"2024-02-17T14:30:16.090758+0000","last_fullsized":"2024-02-17T14:30:16.090758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:16.090558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:16.090558+0000","last_clean_scrub_stamp":"2024-02-17T14:30:16.090558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:32:00.304583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.101003+0000","last_change":"2024-02-17T14:30:06.101003+0000","last_active":"2024-02-17T14:30:06.101003+0000","last_peered":"2024-02-17T14:30:06.101003+0000","last_clean":"2024-02-17T14:30:06.101003+0000","last_became_active":"2024-02-17T14:28:03.071850+0000","last_became_peered":"2024-02-17T14:28:03.071850+0000","last_unstale":"2024-02-17T14:30:06.101003+0000","last_undegraded":"2024-02-17T14:30:06.101003+0000","last_fullsized":"2024-02-17T14:30:06.101003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-17T14:30:06.100892+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-17T14:30:06.100892+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.100892+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:18:15.984813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:23.116186+0000","last_change":"2024-02-17T14:30:23.116224+0000","last_active":"2024-02-17T14:30:23.116186+0000","last_peered":"2024-02-17T14:30:23.116186+0000","last_clean":"2024-02-17T14:30:23.116186+0000","last_became_active":"2024-02-17T14:28:52.061827+0000","last_became_peered":"2024-02-17T14:28:52.061827+0000","last_unstale":"2024-02-17T14:30:23.116186+0000","last_undegraded":"2024-02-17T14:30:23.116186+0000","last_fullsized":"2024-02-17T14:30:23.116186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:23.116093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:23.116093+0000","last_clean_scrub_stamp":"2024-02-17T14:30:23.116093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:46:31.745095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:02.116846+0000","last_change":"2024-02-17T14:30:02.116846+0000","last_active":"2024-02-17T14:30:02.116846+0000","last_peered":"2024-02-17T14:30:02.116846+0000","last_clean":"2024-02-17T14:30:02.116846+0000","last_became_active":"2024-02-17T14:28:03.632020+0000","last_became_peered":"2024-02-17T14:28:03.632020+0000","last_unstale":"2024-02-17T14:30:02.116846+0000","last_undegraded":"2024-02-17T14:30:02.116846+0000","last_fullsized":"2024-02-17T14:30:02.116846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:02.116747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:02.116747+0000","last_clean_scrub_stamp":"2024-02-17T14:30:02.116747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:25:54.637354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.927880+0000","last_change":"2024-02-17T14:30:08.927913+0000","last_active":"2024-02-17T14:30:08.927880+0000","last_peered":"2024-02-17T14:30:08.927880+0000","last_clean":"2024-02-17T14:30:08.927880+0000","last_became_active":"2024-02-17T14:28:03.071830+0000","last_became_peered":"2024-02-17T14:28:03.071830+0000","last_unstale":"2024-02-17T14:30:08.927880+0000","last_undegraded":"2024-02-17T14:30:08.927880+0000","last_fullsized":"2024-02-17T14:30:08.927880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:08.927794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:08.927794+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.927794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:40.657199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.480447+0000","last_change":"2024-02-17T14:30:17.480472+0000","last_active":"2024-02-17T14:30:17.480447+0000","last_peered":"2024-02-17T14:30:17.480447+0000","last_clean":"2024-02-17T14:30:17.480447+0000","last_became_active":"2024-02-17T14:28:07.849212+0000","last_became_peered":"2024-02-17T14:28:07.849212+0000","last_unstale":"2024-02-17T14:30:17.480447+0000","last_undegraded":"2024-02-17T14:30:17.480447+0000","last_fullsized":"2024-02-17T14:30:17.480447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.480367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.480367+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.480367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:03:54.021063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.438402+0000","last_change":"2024-02-17T14:30:10.438402+0000","last_active":"2024-02-17T14:30:10.438402+0000","last_peered":"2024-02-17T14:30:10.438402+0000","last_clean":"2024-02-17T14:30:10.438402+0000","last_became_active":"2024-02-17T14:28:03.626174+0000","last_became_peered":"2024-02-17T14:28:03.626174+0000","last_unstale":"2024-02-17T14:30:10.438402+0000","last_undegraded":"2024-02-17T14:30:10.438402+0000","last_fullsized":"2024-02-17T14:30:10.438402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:10.438260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:10.438260+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.438260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:49.981549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:04.088272+0000","last_change":"2024-02-17T14:30:04.088272+0000","last_active":"2024-02-17T14:30:04.088272+0000","last_peered":"2024-02-17T14:30:04.088272+0000","last_clean":"2024-02-17T14:30:04.088272+0000","last_became_active":"2024-02-17T14:28:03.068179+0000","last_became_peered":"2024-02-17T14:28:03.068179+0000","last_unstale":"2024-02-17T14:30:04.088272+0000","last_undegraded":"2024-02-17T14:30:04.088272+0000","last_fullsized":"2024-02-17T14:30:04.088272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:04.088181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:04.088181+0000","last_clean_scrub_stamp":"2024-02-17T14:30:04.088181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:22:36.703286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.227664+0000","last_change":"2024-02-17T14:30:17.227700+0000","last_active":"2024-02-17T14:30:17.227664+0000","last_peered":"2024-02-17T14:30:17.227664+0000","last_clean":"2024-02-17T14:30:17.227664+0000","last_became_active":"2024-02-17T14:28:07.647918+0000","last_became_peered":"2024-02-17T14:28:07.647918+0000","last_unstale":"2024-02-17T14:30:17.227664+0000","last_undegraded":"2024-02-17T14:30:17.227664+0000","last_fullsized":"2024-02-17T14:30:17.227664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.227556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.227556+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.227556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:03:53.768252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.623018+0000","last_change":"2024-02-17T14:30:06.623018+0000","last_active":"2024-02-17T14:30:06.623018+0000","last_peered":"2024-02-17T14:30:06.623018+0000","last_clean":"2024-02-17T14:30:06.623018+0000","last_became_active":"2024-02-17T14:28:03.629077+0000","last_became_peered":"2024-02-17T14:28:03.629077+0000","last_unstale":"2024-02-17T14:30:06.623018+0000","last_undegraded":"2024-02-17T14:30:06.623018+0000","last_fullsized":"2024-02-17T14:30:06.623018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:06.622852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:06.622852+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.622852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:34:33.241401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.435967+0000","last_change":"2024-02-17T14:30:08.436009+0000","last_active":"2024-02-17T14:30:08.435967+0000","last_peered":"2024-02-17T14:30:08.435967+0000","last_clean":"2024-02-17T14:30:08.435967+0000","last_became_active":"2024-02-17T14:28:03.068923+0000","last_became_peered":"2024-02-17T14:28:03.068923+0000","last_unstale":"2024-02-17T14:30:08.435967+0000","last_undegraded":"2024-02-17T14:30:08.435967+0000","last_fullsized":"2024-02-17T14:30:08.435967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:08.435863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:08.435863+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.435863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:14:45.474978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.208957+0000","last_change":"2024-02-17T14:30:14.208999+0000","last_active":"2024-02-17T14:30:14.208957+0000","last_peered":"2024-02-17T14:30:14.208957+0000","last_clean":"2024-02-17T14:30:14.208957+0000","last_became_active":"2024-02-17T14:28:07.645156+0000","last_became_peered":"2024-02-17T14:28:07.645156+0000","last_unstale":"2024-02-17T14:30:14.208957+0000","last_undegraded":"2024-02-17T14:30:14.208957+0000","last_fullsized":"2024-02-17T14:30:14.208957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.208849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.208849+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.208849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:34:50.159272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.146461+0000","last_change":"2024-02-17T14:30:10.146484+0000","last_active":"2024-02-17T14:30:10.146461+0000","last_peered":"2024-02-17T14:30:10.146461+0000","last_clean":"2024-02-17T14:30:10.146461+0000","last_became_active":"2024-02-17T14:28:03.627165+0000","last_became_peered":"2024-02-17T14:28:03.627165+0000","last_unstale":"2024-02-17T14:30:10.146461+0000","last_undegraded":"2024-02-17T14:30:10.146461+0000","last_fullsized":"2024-02-17T14:30:10.146461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:10.146386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:10.146386+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.146386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:49.689675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:02.988112+0000","last_change":"2024-02-17T14:30:02.988112+0000","last_active":"2024-02-17T14:30:02.988112+0000","last_peered":"2024-02-17T14:30:02.988112+0000","last_clean":"2024-02-17T14:30:02.988112+0000","last_became_active":"2024-02-17T14:28:03.066156+0000","last_became_peered":"2024-02-17T14:28:03.066156+0000","last_unstale":"2024-02-17T14:30:02.988112+0000","last_undegraded":"2024-02-17T14:30:02.988112+0000","last_fullsized":"2024-02-17T14:30:02.988112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:02.988016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:02.988016+0000","last_clean_scrub_stamp":"2024-02-17T14:30:02.988016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:32:24.833500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:16.237485+0000","last_change":"2024-02-17T14:30:16.237485+0000","last_active":"2024-02-17T14:30:16.237485+0000","last_peered":"2024-02-17T14:30:16.237485+0000","last_clean":"2024-02-17T14:30:16.237485+0000","last_became_active":"2024-02-17T14:28:07.649403+0000","last_became_peered":"2024-02-17T14:28:07.649403+0000","last_unstale":"2024-02-17T14:30:16.237485+0000","last_undegraded":"2024-02-17T14:30:16.237485+0000","last_fullsized":"2024-02-17T14:30:16.237485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:16.237349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:16.237349+0000","last_clean_scrub_stamp":"2024-02-17T14:30:16.237349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:50:20.483245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.551469+0000","last_change":"2024-02-17T14:30:08.551469+0000","last_active":"2024-02-17T14:30:08.551469+0000","last_peered":"2024-02-17T14:30:08.551469+0000","last_clean":"2024-02-17T14:30:08.551469+0000","last_became_active":"2024-02-17T14:28:03.629247+0000","last_became_peered":"2024-02-17T14:28:03.629247+0000","last_unstale":"2024-02-17T14:30:08.551469+0000","last_undegraded":"2024-02-17T14:30:08.551469+0000","last_fullsized":"2024-02-17T14:30:08.551469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:08.551319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:08.551319+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.551319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:14:45.590434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.920344+0000","last_change":"2024-02-17T14:30:07.920371+0000","last_active":"2024-02-17T14:30:07.920344+0000","last_peered":"2024-02-17T14:30:07.920344+0000","last_clean":"2024-02-17T14:30:07.920344+0000","last_became_active":"2024-02-17T14:28:03.071778+0000","last_became_peered":"2024-02-17T14:28:03.071778+0000","last_unstale":"2024-02-17T14:30:07.920344+0000","last_undegraded":"2024-02-17T14:30:07.920344+0000","last_fullsized":"2024-02-17T14:30:07.920344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.920219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.920219+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.920219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:13:57.823195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:18.465425+0000","last_change":"2024-02-17T14:30:18.465455+0000","last_active":"2024-02-17T14:30:18.465425+0000","last_peered":"2024-02-17T14:30:18.465425+0000","last_clean":"2024-02-17T14:30:18.465425+0000","last_became_active":"2024-02-17T14:28:07.850106+0000","last_became_peered":"2024-02-17T14:28:07.850106+0000","last_unstale":"2024-02-17T14:30:18.465425+0000","last_undegraded":"2024-02-17T14:30:18.465425+0000","last_fullsized":"2024-02-17T14:30:18.465425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:18.465327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:18.465327+0000","last_clean_scrub_stamp":"2024-02-17T14:30:18.465327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:46.822708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.133606+0000","last_change":"2024-02-17T14:30:06.133606+0000","last_active":"2024-02-17T14:30:06.133606+0000","last_peered":"2024-02-17T14:30:06.133606+0000","last_clean":"2024-02-17T14:30:06.133606+0000","last_became_active":"2024-02-17T14:28:03.634570+0000","last_became_peered":"2024-02-17T14:28:03.634570+0000","last_unstale":"2024-02-17T14:30:06.133606+0000","last_undegraded":"2024-02-17T14:30:06.133606+0000","last_fullsized":"2024-02-17T14:30:06.133606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:06.133488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:06.133488+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.133488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:14:43.172604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.441851+0000","last_change":"2024-02-17T14:30:05.441851+0000","last_active":"2024-02-17T14:30:05.441851+0000","last_peered":"2024-02-17T14:30:05.441851+0000","last_clean":"2024-02-17T14:30:05.441851+0000","last_became_active":"2024-02-17T14:28:03.061026+0000","last_became_peered":"2024-02-17T14:28:03.061026+0000","last_unstale":"2024-02-17T14:30:05.441851+0000","last_undegraded":"2024-02-17T14:30:05.441851+0000","last_fullsized":"2024-02-17T14:30:05.441851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:05.441737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:05.441737+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.441737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:13:55.344714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.878469+0000","last_change":"2024-02-17T14:30:05.878504+0000","last_active":"2024-02-17T14:30:05.878469+0000","last_peered":"2024-02-17T14:30:05.878469+0000","last_clean":"2024-02-17T14:30:05.878469+0000","last_became_active":"2024-02-17T14:28:00.252180+0000","last_became_peered":"2024-02-17T14:28:00.252180+0000","last_unstale":"2024-02-17T14:30:05.878469+0000","last_undegraded":"2024-02-17T14:30:05.878469+0000","last_fullsized":"2024-02-17T14:30:05.878469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-02-17T14:30:05.878388+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-02-17T14:30:05.878388+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.878388+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:22:38.493493+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:19.129079+0000","last_change":"2024-02-17T14:30:19.129106+0000","last_active":"2024-02-17T14:30:19.129079+0000","last_peered":"2024-02-17T14:30:19.129079+0000","last_clean":"2024-02-17T14:30:19.129079+0000","last_became_active":"2024-02-17T14:28:07.849264+0000","last_became_peered":"2024-02-17T14:28:07.849264+0000","last_unstale":"2024-02-17T14:30:19.129079+0000","last_undegraded":"2024-02-17T14:30:19.129079+0000","last_fullsized":"2024-02-17T14:30:19.129079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:19.128995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:19.128995+0000","last_clean_scrub_stamp":"2024-02-17T14:30:19.128995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:53:59.166197+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:04.885368+0000","last_change":"2024-02-17T14:30:04.885368+0000","last_active":"2024-02-17T14:30:04.885368+0000","last_peered":"2024-02-17T14:30:04.885368+0000","last_clean":"2024-02-17T14:30:04.885368+0000","last_became_active":"2024-02-17T14:28:03.641815+0000","last_became_peered":"2024-02-17T14:28:03.641815+0000","last_unstale":"2024-02-17T14:30:04.885368+0000","last_undegraded":"2024-02-17T14:30:04.885368+0000","last_fullsized":"2024-02-17T14:30:04.885368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:04.885267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:04.885267+0000","last_clean_scrub_stamp":"2024-02-17T14:30:04.885267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:07:55.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:03.990661+0000","last_change":"2024-02-17T14:30:03.990661+0000","last_active":"2024-02-17T14:30:03.990661+0000","last_peered":"2024-02-17T14:30:03.990661+0000","last_clean":"2024-02-17T14:30:03.990661+0000","last_became_active":"2024-02-17T14:28:03.066169+0000","last_became_peered":"2024-02-17T14:28:03.066169+0000","last_unstale":"2024-02-17T14:30:03.990661+0000","last_undegraded":"2024-02-17T14:30:03.990661+0000","last_fullsized":"2024-02-17T14:30:03.990661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:03.990567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:03.990567+0000","last_clean_scrub_stamp":"2024-02-17T14:30:03.990567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:57:41.179279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:18.149521+0000","last_change":"2024-02-17T14:30:18.149546+0000","last_active":"2024-02-17T14:30:18.149521+0000","last_peered":"2024-02-17T14:30:18.149521+0000","last_clean":"2024-02-17T14:30:18.149521+0000","last_became_active":"2024-02-17T14:28:07.846265+0000","last_became_peered":"2024-02-17T14:28:07.846265+0000","last_unstale":"2024-02-17T14:30:18.149521+0000","last_undegraded":"2024-02-17T14:30:18.149521+0000","last_fullsized":"2024-02-17T14:30:18.149521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:18.149440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:18.149440+0000","last_clean_scrub_stamp":"2024-02-17T14:30:18.149440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:29.366374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.405383+0000","last_change":"2024-02-17T14:30:15.405383+0000","last_active":"2024-02-17T14:30:15.405383+0000","last_peered":"2024-02-17T14:30:15.405383+0000","last_clean":"2024-02-17T14:30:15.405383+0000","last_became_active":"2024-02-17T14:28:03.634290+0000","last_became_peered":"2024-02-17T14:28:03.634290+0000","last_unstale":"2024-02-17T14:30:15.405383+0000","last_undegraded":"2024-02-17T14:30:15.405383+0000","last_fullsized":"2024-02-17T14:30:15.405383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.405267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.405267+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.405267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:48.962005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.112360+0000","last_change":"2024-02-17T14:30:08.112360+0000","last_active":"2024-02-17T14:30:08.112360+0000","last_peered":"2024-02-17T14:30:08.112360+0000","last_clean":"2024-02-17T14:30:08.112360+0000","last_became_active":"2024-02-17T14:28:03.072497+0000","last_became_peered":"2024-02-17T14:28:03.072497+0000","last_unstale":"2024-02-17T14:30:08.112360+0000","last_undegraded":"2024-02-17T14:30:08.112360+0000","last_fullsized":"2024-02-17T14:30:08.112360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-17T14:30:08.112243+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-17T14:30:08.112243+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.112243+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:52.950054+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.470154+0000","last_change":"2024-02-17T14:30:15.470154+0000","last_active":"2024-02-17T14:30:15.470154+0000","last_peered":"2024-02-17T14:30:15.470154+0000","last_clean":"2024-02-17T14:30:15.470154+0000","last_became_active":"2024-02-17T14:28:07.651144+0000","last_became_peered":"2024-02-17T14:28:07.651144+0000","last_unstale":"2024-02-17T14:30:15.470154+0000","last_undegraded":"2024-02-17T14:30:15.470154+0000","last_fullsized":"2024-02-17T14:30:15.470154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.470043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.470043+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.470043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:49.026781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:20.049102+0000","last_change":"2024-02-17T14:30:20.049102+0000","last_active":"2024-02-17T14:30:20.049102+0000","last_peered":"2024-02-17T14:30:20.049102+0000","last_clean":"2024-02-17T14:30:20.049102+0000","last_became_active":"2024-02-17T14:28:03.643033+0000","last_became_peered":"2024-02-17T14:28:03.643033+0000","last_unstale":"2024-02-17T14:30:20.049102+0000","last_undegraded":"2024-02-17T14:30:20.049102+0000","last_fullsized":"2024-02-17T14:30:20.049102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:20.048990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:20.048990+0000","last_clean_scrub_stamp":"2024-02-17T14:30:20.048990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:48.406370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.013037+0000","last_change":"2024-02-17T14:30:05.013037+0000","last_active":"2024-02-17T14:30:05.013037+0000","last_peered":"2024-02-17T14:30:05.013037+0000","last_clean":"2024-02-17T14:30:05.013037+0000","last_became_active":"2024-02-17T14:28:03.066797+0000","last_became_peered":"2024-02-17T14:28:03.066797+0000","last_unstale":"2024-02-17T14:30:05.013037+0000","last_undegraded":"2024-02-17T14:30:05.013037+0000","last_fullsized":"2024-02-17T14:30:05.013037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-02-17T14:30:05.012954+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-02-17T14:30:05.012954+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.012954+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:19:02.904855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:19.411544+0000","last_change":"2024-02-17T14:30:19.411567+0000","last_active":"2024-02-17T14:30:19.411544+0000","last_peered":"2024-02-17T14:30:19.411544+0000","last_clean":"2024-02-17T14:30:19.411544+0000","last_became_active":"2024-02-17T14:28:07.849280+0000","last_became_peered":"2024-02-17T14:28:07.849280+0000","last_unstale":"2024-02-17T14:30:19.411544+0000","last_undegraded":"2024-02-17T14:30:19.411544+0000","last_fullsized":"2024-02-17T14:30:19.411544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:19.411451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:19.411451+0000","last_clean_scrub_stamp":"2024-02-17T14:30:19.411451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:32:03.625475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.040793+0000","last_change":"2024-02-17T14:30:17.040793+0000","last_active":"2024-02-17T14:30:17.040793+0000","last_peered":"2024-02-17T14:30:17.040793+0000","last_clean":"2024-02-17T14:30:17.040793+0000","last_became_active":"2024-02-17T14:28:03.640945+0000","last_became_peered":"2024-02-17T14:28:03.640945+0000","last_unstale":"2024-02-17T14:30:17.040793+0000","last_undegraded":"2024-02-17T14:30:17.040793+0000","last_fullsized":"2024-02-17T14:30:17.040793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.040679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.040679+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.040679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:50.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:03.647330+0000","last_change":"2024-02-17T14:30:03.647330+0000","last_active":"2024-02-17T14:30:03.647330+0000","last_peered":"2024-02-17T14:30:03.647330+0000","last_clean":"2024-02-17T14:30:03.647330+0000","last_became_active":"2024-02-17T14:28:03.066350+0000","last_became_peered":"2024-02-17T14:28:03.066350+0000","last_unstale":"2024-02-17T14:30:03.647330+0000","last_undegraded":"2024-02-17T14:30:03.647330+0000","last_fullsized":"2024-02-17T14:30:03.647330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-02-17T14:30:03.647222+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-02-17T14:30:03.647222+0000","last_clean_scrub_stamp":"2024-02-17T14:30:03.647222+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:03:33.343764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.626643+0000","last_change":"2024-02-17T14:30:14.626643+0000","last_active":"2024-02-17T14:30:14.626643+0000","last_peered":"2024-02-17T14:30:14.626643+0000","last_clean":"2024-02-17T14:30:14.626643+0000","last_became_active":"2024-02-17T14:28:07.652088+0000","last_became_peered":"2024-02-17T14:28:07.652088+0000","last_unstale":"2024-02-17T14:30:14.626643+0000","last_undegraded":"2024-02-17T14:30:14.626643+0000","last_fullsized":"2024-02-17T14:30:14.626643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.626532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.626532+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.626532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:13.725750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:19.231465+0000","last_change":"2024-02-17T14:30:19.231488+0000","last_active":"2024-02-17T14:30:19.231465+0000","last_peered":"2024-02-17T14:30:19.231465+0000","last_clean":"2024-02-17T14:30:19.231465+0000","last_became_active":"2024-02-17T14:28:51.770241+0000","last_became_peered":"2024-02-17T14:28:51.770241+0000","last_unstale":"2024-02-17T14:30:19.231465+0000","last_undegraded":"2024-02-17T14:30:19.231465+0000","last_fullsized":"2024-02-17T14:30:19.231465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:19.231347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:19.231347+0000","last_clean_scrub_stamp":"2024-02-17T14:30:19.231347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:32:03.445371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"27'12","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.980158+0000","last_change":"2024-02-17T14:30:05.980158+0000","last_active":"2024-02-17T14:30:05.980158+0000","last_peered":"2024-02-17T14:30:05.980158+0000","last_clean":"2024-02-17T14:30:05.980158+0000","last_became_active":"2024-02-17T14:28:03.069867+0000","last_became_peered":"2024-02-17T14:28:03.069867+0000","last_unstale":"2024-02-17T14:30:05.980158+0000","last_undegraded":"2024-02-17T14:30:05.980158+0000","last_fullsized":"2024-02-17T14:30:05.980158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-02-17T14:30:05.980005+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-02-17T14:30:05.980005+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.980005+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:58:42.626961+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.502024+0000","last_change":"2024-02-17T14:30:14.502024+0000","last_active":"2024-02-17T14:30:14.502024+0000","last_peered":"2024-02-17T14:30:14.502024+0000","last_clean":"2024-02-17T14:30:14.502024+0000","last_became_active":"2024-02-17T14:28:07.644452+0000","last_became_peered":"2024-02-17T14:28:07.644452+0000","last_unstale":"2024-02-17T14:30:14.502024+0000","last_undegraded":"2024-02-17T14:30:14.502024+0000","last_fullsized":"2024-02-17T14:30:14.502024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.501877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.501877+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.501877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:34:50.452300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:11.267694+0000","last_change":"2024-02-17T14:30:11.267694+0000","last_active":"2024-02-17T14:30:11.267694+0000","last_peered":"2024-02-17T14:30:11.267694+0000","last_clean":"2024-02-17T14:30:11.267694+0000","last_became_active":"2024-02-17T14:28:03.630239+0000","last_became_peered":"2024-02-17T14:28:03.630239+0000","last_unstale":"2024-02-17T14:30:11.267694+0000","last_undegraded":"2024-02-17T14:30:11.267694+0000","last_fullsized":"2024-02-17T14:30:11.267694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:11.267546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:11.267546+0000","last_clean_scrub_stamp":"2024-02-17T14:30:11.267546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:14:01.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.283145+0000","last_change":"2024-02-17T14:30:08.283145+0000","last_active":"2024-02-17T14:30:08.283145+0000","last_peered":"2024-02-17T14:30:08.283145+0000","last_clean":"2024-02-17T14:30:08.283145+0000","last_became_active":"2024-02-17T14:28:03.072801+0000","last_became_peered":"2024-02-17T14:28:03.072801+0000","last_unstale":"2024-02-17T14:30:08.283145+0000","last_undegraded":"2024-02-17T14:30:08.283145+0000","last_fullsized":"2024-02-17T14:30:08.283145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:08.283036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:08.283036+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.283036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:07:58.499005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:20.140754+0000","last_change":"2024-02-17T14:30:20.140754+0000","last_active":"2024-02-17T14:30:20.140754+0000","last_peered":"2024-02-17T14:30:20.140754+0000","last_clean":"2024-02-17T14:30:20.140754+0000","last_became_active":"2024-02-17T14:28:07.848991+0000","last_became_peered":"2024-02-17T14:28:07.848991+0000","last_unstale":"2024-02-17T14:30:20.140754+0000","last_undegraded":"2024-02-17T14:30:20.140754+0000","last_fullsized":"2024-02-17T14:30:20.140754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:20.140643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:20.140643+0000","last_clean_scrub_stamp":"2024-02-17T14:30:20.140643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:02:10.760219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:19.028454+0000","last_change":"2024-02-17T14:30:19.028454+0000","last_active":"2024-02-17T14:30:19.028454+0000","last_peered":"2024-02-17T14:30:19.028454+0000","last_clean":"2024-02-17T14:30:19.028454+0000","last_became_active":"2024-02-17T14:28:03.641501+0000","last_became_peered":"2024-02-17T14:28:03.641501+0000","last_unstale":"2024-02-17T14:30:19.028454+0000","last_undegraded":"2024-02-17T14:30:19.028454+0000","last_fullsized":"2024-02-17T14:30:19.028454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:19.028327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:19.028327+0000","last_clean_scrub_stamp":"2024-02-17T14:30:19.028327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:03:55.569023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.448080+0000","last_change":"2024-02-17T14:30:07.448080+0000","last_active":"2024-02-17T14:30:07.448080+0000","last_peered":"2024-02-17T14:30:07.448080+0000","last_clean":"2024-02-17T14:30:07.448080+0000","last_became_active":"2024-02-17T14:28:03.066538+0000","last_became_peered":"2024-02-17T14:28:03.066538+0000","last_unstale":"2024-02-17T14:30:07.448080+0000","last_undegraded":"2024-02-17T14:30:07.448080+0000","last_fullsized":"2024-02-17T14:30:07.448080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.447964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.447964+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.447964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:39.177369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:19.113891+0000","last_change":"2024-02-17T14:30:19.113891+0000","last_active":"2024-02-17T14:30:19.113891+0000","last_peered":"2024-02-17T14:30:19.113891+0000","last_clean":"2024-02-17T14:30:19.113891+0000","last_became_active":"2024-02-17T14:28:07.846413+0000","last_became_peered":"2024-02-17T14:28:07.846413+0000","last_unstale":"2024-02-17T14:30:19.113891+0000","last_undegraded":"2024-02-17T14:30:19.113891+0000","last_fullsized":"2024-02-17T14:30:19.113891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:19.113756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:19.113756+0000","last_clean_scrub_stamp":"2024-02-17T14:30:19.113756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:27:34.962516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.477307+0000","last_change":"2024-02-17T14:30:12.477307+0000","last_active":"2024-02-17T14:30:12.477307+0000","last_peered":"2024-02-17T14:30:12.477307+0000","last_clean":"2024-02-17T14:30:12.477307+0000","last_became_active":"2024-02-17T14:28:03.637831+0000","last_became_peered":"2024-02-17T14:28:03.637831+0000","last_unstale":"2024-02-17T14:30:12.477307+0000","last_undegraded":"2024-02-17T14:30:12.477307+0000","last_fullsized":"2024-02-17T14:30:12.477307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.477158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.477158+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.477158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:23.694091+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'4","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:03.536049+0000","last_change":"2024-02-17T14:30:03.536049+0000","last_active":"2024-02-17T14:30:03.536049+0000","last_peered":"2024-02-17T14:30:03.536049+0000","last_clean":"2024-02-17T14:30:03.536049+0000","last_became_active":"2024-02-17T14:28:03.064226+0000","last_became_peered":"2024-02-17T14:28:03.064226+0000","last_unstale":"2024-02-17T14:30:03.536049+0000","last_undegraded":"2024-02-17T14:30:03.536049+0000","last_fullsized":"2024-02-17T14:30:03.536049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-02-17T14:30:03.535896+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-02-17T14:30:03.535896+0000","last_clean_scrub_stamp":"2024-02-17T14:30:03.535896+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:07:53.751866+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:18.409699+0000","last_change":"2024-02-17T14:30:18.409699+0000","last_active":"2024-02-17T14:30:18.409699+0000","last_peered":"2024-02-17T14:30:18.409699+0000","last_clean":"2024-02-17T14:30:18.409699+0000","last_became_active":"2024-02-17T14:28:07.849345+0000","last_became_peered":"2024-02-17T14:28:07.849345+0000","last_unstale":"2024-02-17T14:30:18.409699+0000","last_undegraded":"2024-02-17T14:30:18.409699+0000","last_fullsized":"2024-02-17T14:30:18.409699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:18.409592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:18.409592+0000","last_clean_scrub_stamp":"2024-02-17T14:30:18.409592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:46.766972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.011511+0000","last_change":"2024-02-17T14:30:14.011511+0000","last_active":"2024-02-17T14:30:14.011511+0000","last_peered":"2024-02-17T14:30:14.011511+0000","last_clean":"2024-02-17T14:30:14.011511+0000","last_became_active":"2024-02-17T14:28:03.642077+0000","last_became_peered":"2024-02-17T14:28:03.642077+0000","last_unstale":"2024-02-17T14:30:14.011511+0000","last_undegraded":"2024-02-17T14:30:14.011511+0000","last_fullsized":"2024-02-17T14:30:14.011511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.011403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.011403+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.011403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:25.228337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'17","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.262750+0000","last_change":"2024-02-17T14:30:06.262750+0000","last_active":"2024-02-17T14:30:06.262750+0000","last_peered":"2024-02-17T14:30:06.262750+0000","last_clean":"2024-02-17T14:30:06.262750+0000","last_became_active":"2024-02-17T14:28:03.071303+0000","last_became_peered":"2024-02-17T14:28:03.071303+0000","last_unstale":"2024-02-17T14:30:06.262750+0000","last_undegraded":"2024-02-17T14:30:06.262750+0000","last_fullsized":"2024-02-17T14:30:06.262750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-02-17T14:30:06.262631+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-02-17T14:30:06.262631+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.262631+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:07:12.448560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8125,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.254087+0000","last_change":"2024-02-17T14:30:15.254087+0000","last_active":"2024-02-17T14:30:15.254087+0000","last_peered":"2024-02-17T14:30:15.254087+0000","last_clean":"2024-02-17T14:30:15.254087+0000","last_became_active":"2024-02-17T14:28:07.645313+0000","last_became_peered":"2024-02-17T14:28:07.645313+0000","last_unstale":"2024-02-17T14:30:15.254087+0000","last_undegraded":"2024-02-17T14:30:15.254087+0000","last_fullsized":"2024-02-17T14:30:15.254087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.253947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.253947+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.253947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:48.810685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.633664+0000","last_change":"2024-02-17T14:30:08.633664+0000","last_active":"2024-02-17T14:30:08.633664+0000","last_peered":"2024-02-17T14:30:08.633664+0000","last_clean":"2024-02-17T14:30:08.633664+0000","last_became_active":"2024-02-17T14:28:03.637937+0000","last_became_peered":"2024-02-17T14:28:03.637937+0000","last_unstale":"2024-02-17T14:30:08.633664+0000","last_undegraded":"2024-02-17T14:30:08.633664+0000","last_fullsized":"2024-02-17T14:30:08.633664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:08.633561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:08.633561+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.633561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:19:15.986585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.053201+0000","last_change":"2024-02-17T14:30:05.053201+0000","last_active":"2024-02-17T14:30:05.053201+0000","last_peered":"2024-02-17T14:30:05.053201+0000","last_clean":"2024-02-17T14:30:05.053201+0000","last_became_active":"2024-02-17T14:28:03.069690+0000","last_became_peered":"2024-02-17T14:28:03.069690+0000","last_unstale":"2024-02-17T14:30:05.053201+0000","last_undegraded":"2024-02-17T14:30:05.053201+0000","last_fullsized":"2024-02-17T14:30:05.053201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-02-17T14:30:05.053109+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-02-17T14:30:05.053109+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.053109+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:28.600547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:11.653481+0000","last_change":"2024-02-17T14:30:11.653481+0000","last_active":"2024-02-17T14:30:11.653481+0000","last_peered":"2024-02-17T14:30:11.653481+0000","last_clean":"2024-02-17T14:30:11.653481+0000","last_became_active":"2024-02-17T14:28:07.647420+0000","last_became_peered":"2024-02-17T14:28:07.647420+0000","last_unstale":"2024-02-17T14:30:11.653481+0000","last_undegraded":"2024-02-17T14:30:11.653481+0000","last_fullsized":"2024-02-17T14:30:11.653481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:11.653366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:11.653366+0000","last_clean_scrub_stamp":"2024-02-17T14:30:11.653366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:32:56.491176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.508251+0000","last_change":"2024-02-17T14:30:10.508251+0000","last_active":"2024-02-17T14:30:10.508251+0000","last_peered":"2024-02-17T14:30:10.508251+0000","last_clean":"2024-02-17T14:30:10.508251+0000","last_became_active":"2024-02-17T14:28:03.630169+0000","last_became_peered":"2024-02-17T14:28:03.630169+0000","last_unstale":"2024-02-17T14:30:10.508251+0000","last_undegraded":"2024-02-17T14:30:10.508251+0000","last_fullsized":"2024-02-17T14:30:10.508251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:10.508132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:10.508132+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.508132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:50.051421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.437512+0000","last_change":"2024-02-17T14:30:09.437512+0000","last_active":"2024-02-17T14:30:09.437512+0000","last_peered":"2024-02-17T14:30:09.437512+0000","last_clean":"2024-02-17T14:30:09.437512+0000","last_became_active":"2024-02-17T14:28:03.069617+0000","last_became_peered":"2024-02-17T14:28:03.069617+0000","last_unstale":"2024-02-17T14:30:09.437512+0000","last_undegraded":"2024-02-17T14:30:09.437512+0000","last_fullsized":"2024-02-17T14:30:09.437512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.437357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.437357+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.437357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:03:44.368354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.119187+0000","last_change":"2024-02-17T14:30:17.119187+0000","last_active":"2024-02-17T14:30:17.119187+0000","last_peered":"2024-02-17T14:30:17.119187+0000","last_clean":"2024-02-17T14:30:17.119187+0000","last_became_active":"2024-02-17T14:28:07.646403+0000","last_became_peered":"2024-02-17T14:28:07.646403+0000","last_unstale":"2024-02-17T14:30:17.119187+0000","last_undegraded":"2024-02-17T14:30:17.119187+0000","last_fullsized":"2024-02-17T14:30:17.119187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.119065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.119065+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.119065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:53:27.091140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:16.389833+0000","last_change":"2024-02-17T14:30:16.389833+0000","last_active":"2024-02-17T14:30:16.389833+0000","last_peered":"2024-02-17T14:30:16.389833+0000","last_clean":"2024-02-17T14:30:16.389833+0000","last_became_active":"2024-02-17T14:28:03.638281+0000","last_became_peered":"2024-02-17T14:28:03.638281+0000","last_unstale":"2024-02-17T14:30:16.389833+0000","last_undegraded":"2024-02-17T14:30:16.389833+0000","last_fullsized":"2024-02-17T14:30:16.389833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:16.389721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:16.389721+0000","last_clean_scrub_stamp":"2024-02-17T14:30:16.389721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:50:20.635618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.237593+0000","last_change":"2024-02-17T14:30:07.237593+0000","last_active":"2024-02-17T14:30:07.237593+0000","last_peered":"2024-02-17T14:30:07.237593+0000","last_clean":"2024-02-17T14:30:07.237593+0000","last_became_active":"2024-02-17T14:28:03.072571+0000","last_became_peered":"2024-02-17T14:28:03.072571+0000","last_unstale":"2024-02-17T14:30:07.237593+0000","last_undegraded":"2024-02-17T14:30:07.237593+0000","last_fullsized":"2024-02-17T14:30:07.237593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.237475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.237475+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.237475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:04.843810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:21.128869+0000","last_change":"2024-02-17T14:30:21.128869+0000","last_active":"2024-02-17T14:30:21.128869+0000","last_peered":"2024-02-17T14:30:21.128869+0000","last_clean":"2024-02-17T14:30:21.128869+0000","last_became_active":"2024-02-17T14:28:07.849096+0000","last_became_peered":"2024-02-17T14:28:07.849096+0000","last_unstale":"2024-02-17T14:30:21.128869+0000","last_undegraded":"2024-02-17T14:30:21.128869+0000","last_fullsized":"2024-02-17T14:30:21.128869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:21.128695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:21.128695+0000","last_clean_scrub_stamp":"2024-02-17T14:30:21.128695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:45:37.081085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:16.481829+0000","last_change":"2024-02-17T14:30:16.481873+0000","last_active":"2024-02-17T14:30:16.481829+0000","last_peered":"2024-02-17T14:30:16.481829+0000","last_clean":"2024-02-17T14:30:16.481829+0000","last_became_active":"2024-02-17T14:28:07.849053+0000","last_became_peered":"2024-02-17T14:28:07.849053+0000","last_unstale":"2024-02-17T14:30:16.481829+0000","last_undegraded":"2024-02-17T14:30:16.481829+0000","last_fullsized":"2024-02-17T14:30:16.481829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:16.481714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:16.481714+0000","last_clean_scrub_stamp":"2024-02-17T14:30:16.481714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:50:20.727610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.202205+0000","last_change":"2024-02-17T14:30:12.202205+0000","last_active":"2024-02-17T14:30:12.202205+0000","last_peered":"2024-02-17T14:30:12.202205+0000","last_clean":"2024-02-17T14:30:12.202205+0000","last_became_active":"2024-02-17T14:28:03.632204+0000","last_became_peered":"2024-02-17T14:28:03.632204+0000","last_unstale":"2024-02-17T14:30:12.202205+0000","last_undegraded":"2024-02-17T14:30:12.202205+0000","last_fullsized":"2024-02-17T14:30:12.202205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.202091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.202091+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.202091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:23.419025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.403982+0000","last_change":"2024-02-17T14:30:06.403982+0000","last_active":"2024-02-17T14:30:06.403982+0000","last_peered":"2024-02-17T14:30:06.403982+0000","last_clean":"2024-02-17T14:30:06.403982+0000","last_became_active":"2024-02-17T14:28:03.062390+0000","last_became_peered":"2024-02-17T14:28:03.062390+0000","last_unstale":"2024-02-17T14:30:06.403982+0000","last_undegraded":"2024-02-17T14:30:06.403982+0000","last_fullsized":"2024-02-17T14:30:06.403982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:06.403827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:06.403827+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.403827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:22:53.200731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.134470+0000","last_change":"2024-02-17T14:30:17.134498+0000","last_active":"2024-02-17T14:30:17.134470+0000","last_peered":"2024-02-17T14:30:17.134470+0000","last_clean":"2024-02-17T14:30:17.134470+0000","last_became_active":"2024-02-17T14:28:07.650627+0000","last_became_peered":"2024-02-17T14:28:07.650627+0000","last_unstale":"2024-02-17T14:30:17.134470+0000","last_undegraded":"2024-02-17T14:30:17.134470+0000","last_fullsized":"2024-02-17T14:30:17.134470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.134388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.134388+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.134388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:16.233606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.094157+0000","last_change":"2024-02-17T14:30:12.094157+0000","last_active":"2024-02-17T14:30:12.094157+0000","last_peered":"2024-02-17T14:30:12.094157+0000","last_clean":"2024-02-17T14:30:12.094157+0000","last_became_active":"2024-02-17T14:28:03.627708+0000","last_became_peered":"2024-02-17T14:28:03.627708+0000","last_unstale":"2024-02-17T14:30:12.094157+0000","last_undegraded":"2024-02-17T14:30:12.094157+0000","last_fullsized":"2024-02-17T14:30:12.094157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.094041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.094041+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.094041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:58.317152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.102921+0000","last_change":"2024-02-17T14:30:09.102921+0000","last_active":"2024-02-17T14:30:09.102921+0000","last_peered":"2024-02-17T14:30:09.102921+0000","last_clean":"2024-02-17T14:30:09.102921+0000","last_became_active":"2024-02-17T14:28:03.071170+0000","last_became_peered":"2024-02-17T14:28:03.071170+0000","last_unstale":"2024-02-17T14:30:09.102921+0000","last_undegraded":"2024-02-17T14:30:09.102921+0000","last_fullsized":"2024-02-17T14:30:09.102921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.102801+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:08.202018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.260584+0000","last_change":"2024-02-17T14:30:09.260584+0000","last_active":"2024-02-17T14:30:09.260584+0000","last_peered":"2024-02-17T14:30:09.260584+0000","last_clean":"2024-02-17T14:30:09.260584+0000","last_became_active":"2024-02-17T14:28:03.072928+0000","last_became_peered":"2024-02-17T14:28:03.072928+0000","last_unstale":"2024-02-17T14:30:09.260584+0000","last_undegraded":"2024-02-17T14:30:09.260584+0000","last_fullsized":"2024-02-17T14:30:09.260584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-02-17T14:30:09.260469+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-02-17T14:30:09.260469+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.260469+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:07:07.057446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:11.466834+0000","last_change":"2024-02-17T14:30:11.466834+0000","last_active":"2024-02-17T14:30:11.466834+0000","last_peered":"2024-02-17T14:30:11.466834+0000","last_clean":"2024-02-17T14:30:11.466834+0000","last_became_active":"2024-02-17T14:28:03.635362+0000","last_became_peered":"2024-02-17T14:28:03.635362+0000","last_unstale":"2024-02-17T14:30:11.466834+0000","last_undegraded":"2024-02-17T14:30:11.466834+0000","last_fullsized":"2024-02-17T14:30:11.466834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:11.466721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:11.466721+0000","last_clean_scrub_stamp":"2024-02-17T14:30:11.466721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:10.565938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:08.914663+0000","last_change":"2024-02-17T14:30:08.914663+0000","last_active":"2024-02-17T14:30:08.914663+0000","last_peered":"2024-02-17T14:30:08.914663+0000","last_clean":"2024-02-17T14:30:08.914663+0000","last_became_active":"2024-02-17T14:28:07.644637+0000","last_became_peered":"2024-02-17T14:28:07.644637+0000","last_unstale":"2024-02-17T14:30:08.914663+0000","last_undegraded":"2024-02-17T14:30:08.914663+0000","last_fullsized":"2024-02-17T14:30:08.914663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:08.914504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:08.914504+0000","last_clean_scrub_stamp":"2024-02-17T14:30:08.914504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:03:38.611046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.146253+0000","last_change":"2024-02-17T14:30:10.146253+0000","last_active":"2024-02-17T14:30:10.146253+0000","last_peered":"2024-02-17T14:30:10.146253+0000","last_clean":"2024-02-17T14:30:10.146253+0000","last_became_active":"2024-02-17T14:28:03.071112+0000","last_became_peered":"2024-02-17T14:28:03.071112+0000","last_unstale":"2024-02-17T14:30:10.146253+0000","last_undegraded":"2024-02-17T14:30:10.146253+0000","last_fullsized":"2024-02-17T14:30:10.146253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-02-17T14:30:10.146107+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-02-17T14:30:10.146107+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.146107+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:15:21.363041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.583404+0000","last_change":"2024-02-17T14:30:05.583404+0000","last_active":"2024-02-17T14:30:05.583404+0000","last_peered":"2024-02-17T14:30:05.583404+0000","last_clean":"2024-02-17T14:30:05.583404+0000","last_became_active":"2024-02-17T14:28:03.628144+0000","last_became_peered":"2024-02-17T14:28:03.628144+0000","last_unstale":"2024-02-17T14:30:05.583404+0000","last_undegraded":"2024-02-17T14:30:05.583404+0000","last_fullsized":"2024-02-17T14:30:05.583404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:05.583304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:05.583304+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.583304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:25:58.103911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:18.081569+0000","last_change":"2024-02-17T14:30:18.081569+0000","last_active":"2024-02-17T14:30:18.081569+0000","last_peered":"2024-02-17T14:30:18.081569+0000","last_clean":"2024-02-17T14:30:18.081569+0000","last_became_active":"2024-02-17T14:28:07.647491+0000","last_became_peered":"2024-02-17T14:28:07.647491+0000","last_unstale":"2024-02-17T14:30:18.081569+0000","last_undegraded":"2024-02-17T14:30:18.081569+0000","last_fullsized":"2024-02-17T14:30:18.081569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:18.081452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:18.081452+0000","last_clean_scrub_stamp":"2024-02-17T14:30:18.081452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:27:22.063770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.240921+0000","last_change":"2024-02-17T14:30:12.240921+0000","last_active":"2024-02-17T14:30:12.240921+0000","last_peered":"2024-02-17T14:30:12.240921+0000","last_clean":"2024-02-17T14:30:12.240921+0000","last_became_active":"2024-02-17T14:28:03.630662+0000","last_became_peered":"2024-02-17T14:28:03.630662+0000","last_unstale":"2024-02-17T14:30:12.240921+0000","last_undegraded":"2024-02-17T14:30:12.240921+0000","last_fullsized":"2024-02-17T14:30:12.240921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.240798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.240798+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.240798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:22:59.037703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.969343+0000","last_change":"2024-02-17T14:30:06.969343+0000","last_active":"2024-02-17T14:30:06.969343+0000","last_peered":"2024-02-17T14:30:06.969343+0000","last_clean":"2024-02-17T14:30:06.969343+0000","last_became_active":"2024-02-17T14:28:03.628781+0000","last_became_peered":"2024-02-17T14:28:03.628781+0000","last_unstale":"2024-02-17T14:30:06.969343+0000","last_undegraded":"2024-02-17T14:30:06.969343+0000","last_fullsized":"2024-02-17T14:30:06.969343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:06.969206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:06.969206+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.969206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:37:44.610292+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:20.405186+0000","last_change":"2024-02-17T14:30:20.405207+0000","last_active":"2024-02-17T14:30:20.405186+0000","last_peered":"2024-02-17T14:30:20.405186+0000","last_clean":"2024-02-17T14:30:20.405186+0000","last_became_active":"2024-02-17T14:28:51.772895+0000","last_became_peered":"2024-02-17T14:28:51.772895+0000","last_unstale":"2024-02-17T14:30:20.405186+0000","last_undegraded":"2024-02-17T14:30:20.405186+0000","last_fullsized":"2024-02-17T14:30:20.405186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:20.405105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:20.405105+0000","last_clean_scrub_stamp":"2024-02-17T14:30:20.405105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:24:51.416034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.550801+0000","last_change":"2024-02-17T14:30:05.550801+0000","last_active":"2024-02-17T14:30:05.550801+0000","last_peered":"2024-02-17T14:30:05.550801+0000","last_clean":"2024-02-17T14:30:05.550801+0000","last_became_active":"2024-02-17T14:28:03.626738+0000","last_became_peered":"2024-02-17T14:28:03.626738+0000","last_unstale":"2024-02-17T14:30:05.550801+0000","last_undegraded":"2024-02-17T14:30:05.550801+0000","last_fullsized":"2024-02-17T14:30:05.550801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:05.550710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:05.550710+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.550710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:29.098148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.108236+0000","last_change":"2024-02-17T14:30:07.108236+0000","last_active":"2024-02-17T14:30:07.108236+0000","last_peered":"2024-02-17T14:30:07.108236+0000","last_clean":"2024-02-17T14:30:07.108236+0000","last_became_active":"2024-02-17T14:28:03.630705+0000","last_became_peered":"2024-02-17T14:28:03.630705+0000","last_unstale":"2024-02-17T14:30:07.108236+0000","last_undegraded":"2024-02-17T14:30:07.108236+0000","last_fullsized":"2024-02-17T14:30:07.108236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.108124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.108124+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.108124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:03:42.039121+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:11.183877+0000","last_change":"2024-02-17T14:30:11.183877+0000","last_active":"2024-02-17T14:30:11.183877+0000","last_peered":"2024-02-17T14:30:11.183877+0000","last_clean":"2024-02-17T14:30:11.183877+0000","last_became_active":"2024-02-17T14:28:03.631476+0000","last_became_peered":"2024-02-17T14:28:03.631476+0000","last_unstale":"2024-02-17T14:30:11.183877+0000","last_undegraded":"2024-02-17T14:30:11.183877+0000","last_fullsized":"2024-02-17T14:30:11.183877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:11.183762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:11.183762+0000","last_clean_scrub_stamp":"2024-02-17T14:30:11.183762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:10.282980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:16.099832+0000","last_change":"2024-02-17T14:30:16.099832+0000","last_active":"2024-02-17T14:30:16.099832+0000","last_peered":"2024-02-17T14:30:16.099832+0000","last_clean":"2024-02-17T14:30:16.099832+0000","last_became_active":"2024-02-17T14:28:03.638442+0000","last_became_peered":"2024-02-17T14:28:03.638442+0000","last_unstale":"2024-02-17T14:30:16.099832+0000","last_undegraded":"2024-02-17T14:30:16.099832+0000","last_fullsized":"2024-02-17T14:30:16.099832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:16.099731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:16.099731+0000","last_clean_scrub_stamp":"2024-02-17T14:30:16.099731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:58:55.643020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.073131+0000","last_change":"2024-02-17T14:30:15.073131+0000","last_active":"2024-02-17T14:30:15.073131+0000","last_peered":"2024-02-17T14:30:15.073131+0000","last_clean":"2024-02-17T14:30:15.073131+0000","last_became_active":"2024-02-17T14:28:03.630676+0000","last_became_peered":"2024-02-17T14:28:03.630676+0000","last_unstale":"2024-02-17T14:30:15.073131+0000","last_undegraded":"2024-02-17T14:30:15.073131+0000","last_fullsized":"2024-02-17T14:30:15.073131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.073017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.073017+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.073017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:42:51.933998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:11.402321+0000","last_change":"2024-02-17T14:30:11.402321+0000","last_active":"2024-02-17T14:30:11.402321+0000","last_peered":"2024-02-17T14:30:11.402321+0000","last_clean":"2024-02-17T14:30:11.402321+0000","last_became_active":"2024-02-17T14:28:03.626848+0000","last_became_peered":"2024-02-17T14:28:03.626848+0000","last_unstale":"2024-02-17T14:30:11.402321+0000","last_undegraded":"2024-02-17T14:30:11.402321+0000","last_fullsized":"2024-02-17T14:30:11.402321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:11.402194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:11.402194+0000","last_clean_scrub_stamp":"2024-02-17T14:30:11.402194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:10.501412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:11.144170+0000","last_change":"2024-02-17T14:30:11.144170+0000","last_active":"2024-02-17T14:30:11.144170+0000","last_peered":"2024-02-17T14:30:11.144170+0000","last_clean":"2024-02-17T14:30:11.144170+0000","last_became_active":"2024-02-17T14:28:03.626450+0000","last_became_peered":"2024-02-17T14:28:03.626450+0000","last_unstale":"2024-02-17T14:30:11.144170+0000","last_undegraded":"2024-02-17T14:30:11.144170+0000","last_fullsized":"2024-02-17T14:30:11.144170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:11.144029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:11.144029+0000","last_clean_scrub_stamp":"2024-02-17T14:30:11.144029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:53:51.181231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.370133+0000","last_change":"2024-02-17T14:30:17.370133+0000","last_active":"2024-02-17T14:30:17.370133+0000","last_peered":"2024-02-17T14:30:17.370133+0000","last_clean":"2024-02-17T14:30:17.370133+0000","last_became_active":"2024-02-17T14:28:03.639330+0000","last_became_peered":"2024-02-17T14:28:03.639330+0000","last_unstale":"2024-02-17T14:30:17.370133+0000","last_undegraded":"2024-02-17T14:30:17.370133+0000","last_fullsized":"2024-02-17T14:30:17.370133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.370029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.370029+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.370029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:03:53.910725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:13.507031+0000","last_change":"2024-02-17T14:30:13.507031+0000","last_active":"2024-02-17T14:30:13.507031+0000","last_peered":"2024-02-17T14:30:13.507031+0000","last_clean":"2024-02-17T14:30:13.507031+0000","last_became_active":"2024-02-17T14:28:03.641485+0000","last_became_peered":"2024-02-17T14:28:03.641485+0000","last_unstale":"2024-02-17T14:30:13.507031+0000","last_undegraded":"2024-02-17T14:30:13.507031+0000","last_fullsized":"2024-02-17T14:30:13.507031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:13.506925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:13.506925+0000","last_clean_scrub_stamp":"2024-02-17T14:30:13.506925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:53:53.544127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.248464+0000","last_change":"2024-02-17T14:30:10.248464+0000","last_active":"2024-02-17T14:30:10.248464+0000","last_peered":"2024-02-17T14:30:10.248464+0000","last_clean":"2024-02-17T14:30:10.248464+0000","last_became_active":"2024-02-17T14:28:03.629841+0000","last_became_peered":"2024-02-17T14:28:03.629841+0000","last_unstale":"2024-02-17T14:30:10.248464+0000","last_undegraded":"2024-02-17T14:30:10.248464+0000","last_fullsized":"2024-02-17T14:30:10.248464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:10.248354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:10.248354+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.248354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:33.795792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.987118+0000","last_change":"2024-02-17T14:30:14.987118+0000","last_active":"2024-02-17T14:30:14.987118+0000","last_peered":"2024-02-17T14:30:14.987118+0000","last_clean":"2024-02-17T14:30:14.987118+0000","last_became_active":"2024-02-17T14:28:03.642150+0000","last_became_peered":"2024-02-17T14:28:03.642150+0000","last_unstale":"2024-02-17T14:30:14.987118+0000","last_undegraded":"2024-02-17T14:30:14.987118+0000","last_fullsized":"2024-02-17T14:30:14.987118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.987000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.987000+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.987000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:53:55.024202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.934805+0000","last_change":"2024-02-17T14:30:07.934805+0000","last_active":"2024-02-17T14:30:07.934805+0000","last_peered":"2024-02-17T14:30:07.934805+0000","last_clean":"2024-02-17T14:30:07.934805+0000","last_became_active":"2024-02-17T14:28:03.631844+0000","last_became_peered":"2024-02-17T14:28:03.631844+0000","last_unstale":"2024-02-17T14:30:07.934805+0000","last_undegraded":"2024-02-17T14:30:07.934805+0000","last_fullsized":"2024-02-17T14:30:07.934805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.934653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.934653+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.934653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:40:58.635577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:10.894915+0000","last_change":"2024-02-17T14:30:10.894943+0000","last_active":"2024-02-17T14:30:10.894915+0000","last_peered":"2024-02-17T14:30:10.894915+0000","last_clean":"2024-02-17T14:30:10.894915+0000","last_became_active":"2024-02-17T14:28:52.061682+0000","last_became_peered":"2024-02-17T14:28:52.061682+0000","last_unstale":"2024-02-17T14:30:10.894915+0000","last_undegraded":"2024-02-17T14:30:10.894915+0000","last_fullsized":"2024-02-17T14:30:10.894915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:10.894805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:10.894805+0000","last_clean_scrub_stamp":"2024-02-17T14:30:10.894805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:26:03.415413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.406332+0000","last_change":"2024-02-17T14:30:14.406332+0000","last_active":"2024-02-17T14:30:14.406332+0000","last_peered":"2024-02-17T14:30:14.406332+0000","last_clean":"2024-02-17T14:30:14.406332+0000","last_became_active":"2024-02-17T14:28:03.628343+0000","last_became_peered":"2024-02-17T14:28:03.628343+0000","last_unstale":"2024-02-17T14:30:14.406332+0000","last_undegraded":"2024-02-17T14:30:14.406332+0000","last_fullsized":"2024-02-17T14:30:14.406332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.406230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.406230+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.406230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:34:50.356652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:13.210671+0000","last_change":"2024-02-17T14:30:13.210671+0000","last_active":"2024-02-17T14:30:13.210671+0000","last_peered":"2024-02-17T14:30:13.210671+0000","last_clean":"2024-02-17T14:30:13.210671+0000","last_became_active":"2024-02-17T14:28:03.635340+0000","last_became_peered":"2024-02-17T14:28:03.635340+0000","last_unstale":"2024-02-17T14:30:13.210671+0000","last_undegraded":"2024-02-17T14:30:13.210671+0000","last_fullsized":"2024-02-17T14:30:13.210671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:13.210534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:13.210534+0000","last_clean_scrub_stamp":"2024-02-17T14:30:13.210534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:53:53.247736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:02.574905+0000","last_change":"2024-02-17T14:30:02.574905+0000","last_active":"2024-02-17T14:30:02.574905+0000","last_peered":"2024-02-17T14:30:02.574905+0000","last_clean":"2024-02-17T14:30:02.574905+0000","last_became_active":"2024-02-17T14:28:03.632273+0000","last_became_peered":"2024-02-17T14:28:03.632273+0000","last_unstale":"2024-02-17T14:30:02.574905+0000","last_undegraded":"2024-02-17T14:30:02.574905+0000","last_fullsized":"2024-02-17T14:30:02.574905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:02.574820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:02.574820+0000","last_clean_scrub_stamp":"2024-02-17T14:30:02.574820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:00.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:05.169649+0000","last_change":"2024-02-17T14:30:05.169649+0000","last_active":"2024-02-17T14:30:05.169649+0000","last_peered":"2024-02-17T14:30:05.169649+0000","last_clean":"2024-02-17T14:30:05.169649+0000","last_became_active":"2024-02-17T14:28:03.631431+0000","last_became_peered":"2024-02-17T14:28:03.631431+0000","last_unstale":"2024-02-17T14:30:05.169649+0000","last_undegraded":"2024-02-17T14:30:05.169649+0000","last_fullsized":"2024-02-17T14:30:05.169649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:05.169569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:05.169569+0000","last_clean_scrub_stamp":"2024-02-17T14:30:05.169569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:20:36.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:07.584023+0000","last_change":"2024-02-17T14:30:07.584023+0000","last_active":"2024-02-17T14:30:07.584023+0000","last_peered":"2024-02-17T14:30:07.584023+0000","last_clean":"2024-02-17T14:30:07.584023+0000","last_became_active":"2024-02-17T14:28:03.631379+0000","last_became_peered":"2024-02-17T14:28:03.631379+0000","last_unstale":"2024-02-17T14:30:07.584023+0000","last_undegraded":"2024-02-17T14:30:07.584023+0000","last_fullsized":"2024-02-17T14:30:07.584023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:07.583864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:07.583864+0000","last_clean_scrub_stamp":"2024-02-17T14:30:07.583864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:30:35.765958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:14.189128+0000","last_change":"2024-02-17T14:30:14.189128+0000","last_active":"2024-02-17T14:30:14.189128+0000","last_peered":"2024-02-17T14:30:14.189128+0000","last_clean":"2024-02-17T14:30:14.189128+0000","last_became_active":"2024-02-17T14:28:03.635254+0000","last_became_peered":"2024-02-17T14:28:03.635254+0000","last_unstale":"2024-02-17T14:30:14.189128+0000","last_undegraded":"2024-02-17T14:30:14.189128+0000","last_fullsized":"2024-02-17T14:30:14.189128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:14.189007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:14.189007+0000","last_clean_scrub_stamp":"2024-02-17T14:30:14.189007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:14:51.228122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.148748+0000","last_change":"2024-02-17T14:30:15.148748+0000","last_active":"2024-02-17T14:30:15.148748+0000","last_peered":"2024-02-17T14:30:15.148748+0000","last_clean":"2024-02-17T14:30:15.148748+0000","last_became_active":"2024-02-17T14:28:03.635312+0000","last_became_peered":"2024-02-17T14:28:03.635312+0000","last_unstale":"2024-02-17T14:30:15.148748+0000","last_undegraded":"2024-02-17T14:30:15.148748+0000","last_fullsized":"2024-02-17T14:30:15.148748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.148595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.148595+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.148595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:03:50.079591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:21.041670+0000","last_change":"2024-02-17T14:30:21.041670+0000","last_active":"2024-02-17T14:30:21.041670+0000","last_peered":"2024-02-17T14:30:21.041670+0000","last_clean":"2024-02-17T14:30:21.041670+0000","last_became_active":"2024-02-17T14:28:03.646337+0000","last_became_peered":"2024-02-17T14:28:03.646337+0000","last_unstale":"2024-02-17T14:30:21.041670+0000","last_undegraded":"2024-02-17T14:30:21.041670+0000","last_fullsized":"2024-02-17T14:30:21.041670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:21.041543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:21.041543+0000","last_clean_scrub_stamp":"2024-02-17T14:30:21.041543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:32:05.255567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:04.133597+0000","last_change":"2024-02-17T14:30:04.133597+0000","last_active":"2024-02-17T14:30:04.133597+0000","last_peered":"2024-02-17T14:30:04.133597+0000","last_clean":"2024-02-17T14:30:04.133597+0000","last_became_active":"2024-02-17T14:28:03.634751+0000","last_became_peered":"2024-02-17T14:28:03.634751+0000","last_unstale":"2024-02-17T14:30:04.133597+0000","last_undegraded":"2024-02-17T14:30:04.133597+0000","last_fullsized":"2024-02-17T14:30:04.133597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:04.133504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:04.133504+0000","last_clean_scrub_stamp":"2024-02-17T14:30:04.133504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:18:14.017425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:17.996941+0000","last_change":"2024-02-17T14:30:17.996941+0000","last_active":"2024-02-17T14:30:17.996941+0000","last_peered":"2024-02-17T14:30:17.996941+0000","last_clean":"2024-02-17T14:30:17.996941+0000","last_became_active":"2024-02-17T14:28:03.641260+0000","last_became_peered":"2024-02-17T14:28:03.641260+0000","last_unstale":"2024-02-17T14:30:17.996941+0000","last_undegraded":"2024-02-17T14:30:17.996941+0000","last_fullsized":"2024-02-17T14:30:17.996941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:17.996820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:17.996820+0000","last_clean_scrub_stamp":"2024-02-17T14:30:17.996820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:50:22.242716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:13.411522+0000","last_change":"2024-02-17T14:30:13.411522+0000","last_active":"2024-02-17T14:30:13.411522+0000","last_peered":"2024-02-17T14:30:13.411522+0000","last_clean":"2024-02-17T14:30:13.411522+0000","last_became_active":"2024-02-17T14:28:03.627918+0000","last_became_peered":"2024-02-17T14:28:03.627918+0000","last_unstale":"2024-02-17T14:30:13.411522+0000","last_undegraded":"2024-02-17T14:30:13.411522+0000","last_fullsized":"2024-02-17T14:30:13.411522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:13.411374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:13.411374+0000","last_clean_scrub_stamp":"2024-02-17T14:30:13.411374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:53:53.448576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:12.999310+0000","last_change":"2024-02-17T14:30:12.999310+0000","last_active":"2024-02-17T14:30:12.999310+0000","last_peered":"2024-02-17T14:30:12.999310+0000","last_clean":"2024-02-17T14:30:12.999310+0000","last_became_active":"2024-02-17T14:28:03.640873+0000","last_became_peered":"2024-02-17T14:28:03.640873+0000","last_unstale":"2024-02-17T14:30:12.999310+0000","last_undegraded":"2024-02-17T14:30:12.999310+0000","last_fullsized":"2024-02-17T14:30:12.999310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:12.999202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:12.999202+0000","last_clean_scrub_stamp":"2024-02-17T14:30:12.999202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T01:17:12.098420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:09.883684+0000","last_change":"2024-02-17T14:30:09.883707+0000","last_active":"2024-02-17T14:30:09.883684+0000","last_peered":"2024-02-17T14:30:09.883684+0000","last_clean":"2024-02-17T14:30:09.883684+0000","last_became_active":"2024-02-17T14:28:51.767928+0000","last_became_peered":"2024-02-17T14:28:51.767928+0000","last_unstale":"2024-02-17T14:30:09.883684+0000","last_undegraded":"2024-02-17T14:30:09.883684+0000","last_fullsized":"2024-02-17T14:30:09.883684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:09.883594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:09.883594+0000","last_clean_scrub_stamp":"2024-02-17T14:30:09.883594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:26:05.990084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:06.555862+0000","last_change":"2024-02-17T14:30:06.555862+0000","last_active":"2024-02-17T14:30:06.555862+0000","last_peered":"2024-02-17T14:30:06.555862+0000","last_clean":"2024-02-17T14:30:06.555862+0000","last_became_active":"2024-02-17T14:28:03.627978+0000","last_became_peered":"2024-02-17T14:28:03.627978+0000","last_unstale":"2024-02-17T14:30:06.555862+0000","last_undegraded":"2024-02-17T14:30:06.555862+0000","last_fullsized":"2024-02-17T14:30:06.555862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:06.555656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:06.555656+0000","last_clean_scrub_stamp":"2024-02-17T14:30:06.555656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:13:56.458632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:03.078338+0000","last_change":"2024-02-17T14:30:03.078338+0000","last_active":"2024-02-17T14:30:03.078338+0000","last_peered":"2024-02-17T14:30:03.078338+0000","last_clean":"2024-02-17T14:30:03.078338+0000","last_became_active":"2024-02-17T14:28:03.631493+0000","last_became_peered":"2024-02-17T14:28:03.631493+0000","last_unstale":"2024-02-17T14:30:03.078338+0000","last_undegraded":"2024-02-17T14:30:03.078338+0000","last_fullsized":"2024-02-17T14:30:03.078338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:03.078243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:03.078243+0000","last_clean_scrub_stamp":"2024-02-17T14:30:03.078243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:34:29.696791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-02-17T14:30:15.996206+0000","last_change":"2024-02-17T14:30:15.996242+0000","last_active":"2024-02-17T14:30:15.996206+0000","last_peered":"2024-02-17T14:30:15.996206+0000","last_clean":"2024-02-17T14:30:15.996206+0000","last_became_active":"2024-02-17T14:28:03.641154+0000","last_became_peered":"2024-02-17T14:28:03.641154+0000","last_unstale":"2024-02-17T14:30:15.996206+0000","last_undegraded":"2024-02-17T14:30:15.996206+0000","last_fullsized":"2024-02-17T14:30:15.996206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T14:30:15.996111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T14:30:15.996111+0000","last_clean_scrub_stamp":"2024-02-17T14:30:15.996111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:34:51.946534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8923,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":17846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":709990,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53600000000000003,"15min":0.53900000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.59999999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.65600000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.56899999999999995}]},{"osd":2,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.62}]},{"osd":3,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.67400000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.68500000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65200000000000002}]},{"osd":4,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.57699999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.496},{"interface":"front","average":{"1min":0.499,"5min":0.55100000000000005,"15min":0.55900000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67000000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36799999999999999}]},{"osd":5,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.745,"5min":0.751,"15min":0.751},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.441}]},{"osd":6,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.58399999999999996,"15min":0.59399999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.755,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.443,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46000000000000002}]},{"osd":1,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.441},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73599999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53400000000000003}]},{"osd":2,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.74099999999999999,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.495},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.67000000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.71199999999999997}]},{"osd":3,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.68799999999999994,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78100000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57099999999999995}]},{"osd":4,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.32900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63800000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67300000000000004,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58499999999999996}]},{"osd":5,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69299999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.629},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73699999999999999,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.74199999999999999}]},{"osd":7,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71999999999999997,"5min":0.754,"15min":0.754},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68500000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40899999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.376,"5min":0.222,"15min":0.222},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.43099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.44500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.746,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.627}]},{"osd":2,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53700000000000003,"15min":0.53100000000000003},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.499,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.625,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.39500000000000002}]},{"osd":6,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48799999999999999,"15min":0.48999999999999999},"min":{"1min":0.35099999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.37},{"interface":"front","average":{"1min":0.504,"5min":0.52000000000000002,"15min":0.52300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.33000000000000002}]},{"osd":7,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68200000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.74199999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.47099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":119166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.61299999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.623}]},{"osd":1,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.432,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.66100000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65800000000000003,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.59999999999999998}]},{"osd":2,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66400000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.65500000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70099999999999996,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58299999999999996}]},{"osd":5,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47899999999999998,"15min":0.48299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70399999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48799999999999999,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68799999999999994,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.44800000000000001}]},{"osd":6,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.33700000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.64800000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.432},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Feb 17 14:30:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76500000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.503},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70199999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.46500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":127165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39100000000000001,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50800000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.432},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.27500000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.433,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.28599999999999998}]},{"osd":1,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.254,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56999999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58399999999999996}]},{"osd":2,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.39700000000000002,"15min":0.39100000000000001},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60099999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.373},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.44,"15min":0.442},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59499999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77500000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76900000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60499999999999998}]},{"osd":5,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48099999999999998}]},{"osd":6,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.44900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46600000000000003}]},{"osd":7,"last update":"Sat Feb 17 14:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.44800000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.72999999999999998,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":119040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.36299999999999999,"15min":0.36799999999999999},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51600000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.53200000000000003,"5min":1.401,"15min":1.401},"last":0.38400000000000001}]},{"osd":1,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.59999999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41099999999999998,"15min":0.41499999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.441}]},{"osd":3,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64200000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57399999999999995,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.48999999999999999}]},{"osd":4,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84299999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.46700000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.79500000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56899999999999995}]},{"osd":6,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77400000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84599999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68700000000000006}]},{"osd":7,"last update":"Sat Feb 17 14:30:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.47699999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81200000000000006,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.70599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":119200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.33800000000000002},"min":{"1min":0.247,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.48699999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.375},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.36399999999999999,"15min":0.36499999999999999},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.46600000000000003,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.35799999999999998}]},{"osd":2,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.39000000000000001,"15min":0.39300000000000002},"min":{"1min":0.251,"5min":0.217,"15min":0.217},"max":{"1min":0.44500000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.53300000000000003,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.432}]},{"osd":3,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44500000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55200000000000005,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.30599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.50800000000000001,"5min":1.056,"15min":1.056},"last":0.40699999999999997}]},{"osd":4,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.41699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70099999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.434,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76400000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57199999999999995}]},{"osd":5,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.441,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77800000000000002,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64200000000000002}]},{"osd":6,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68899999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.73699999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.626}]},{"osd":7,"last update":"Sat Feb 17 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59699999999999998,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.72399999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":710046,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34799999999999998,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.246},{"interface":"front","average":{"1min":0.371,"5min":0.34300000000000003,"15min":0.33900000000000002},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.35899999999999999,"15min":0.35299999999999998},"min":{"1min":0.28100000000000003,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.432},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35899999999999999,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.29099999999999998}]},{"osd":3,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.379},"min":{"1min":0.25900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39300000000000002},"min":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.32500000000000001}]},{"osd":4,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78900000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70999999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.65900000000000003}]},{"osd":5,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.623,"15min":0.628},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79700000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.70499999999999996}]},{"osd":6,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.73499999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70799999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.63200000000000001}]},{"osd":7,"last update":"Sat Feb 17 14:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.47399999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.76600000000000001,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63,"15min":0.628},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.752,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":8125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":8125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T14:30:45.726 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-17T14:30:45.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.858+0000 7f997eb65640 1 Processor -- start 2024-02-17T14:30:45.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.858+0000 7f997eb65640 1 -- start start 2024-02-17T14:30:45.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f997eb65640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99780b5610 0x7f997806e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f997eb65640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997806e270 con 0x7f997806d610 2024-02-17T14:30:45.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f997eb65640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997806f350 con 0x7f997809bd10 2024-02-17T14:30:45.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f997eb65640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99780b6190 con 0x7f99780b5610 2024-02-17T14:30:45.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f997d102640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f997806d610 0x7f99781517e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36558/0 (socket says 172.21.15.134:36558) 2024-02-17T14:30:45.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f997d102640 1 -- 172.21.15.134:0/2515001716 learned_addr learned my addr 172.21.15.134:0/2515001716 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:45.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f997c901640 1 --2- 172.21.15.134:0/2515001716 >> v2:172.21.15.142:3300/0 conn(0x7f99780b5610 0x7f997806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911713060 0 0) 0x7f997806e270 con 0x7f997806d610 2024-02-17T14:30:45.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9964003520 con 0x7f997806d610 2024-02-17T14:30:45.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3263287408 0 0) 0x7f9964003520 con 0x7f997806d610 2024-02-17T14:30:45.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 >> v2:172.21.15.142:3300/0 conn(0x7f99780b5610 msgr2=0x7f997806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:45.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 --2- 172.21.15.134:0/2515001716 >> v2:172.21.15.142:3300/0 conn(0x7f99780b5610 0x7f997806e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 >> v1:172.21.15.142:6789/0 conn(0x7f997809bd10 legacy=0x7f997806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:45.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997806f630 con 0x7f997806d610 2024-02-17T14:30:45.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f9960001670 con 0x7f997806d610 2024-02-17T14:30:45.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 >> v1:172.21.15.134:6789/0 conn(0x7f997806d610 legacy=0x7f99781517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:45.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 --2- 172.21.15.134:0/2515001716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9964003970 0x7f9964003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 --2- 172.21.15.134:0/2515001716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99640047c0 0x7f9964004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 --2- 172.21.15.134:0/2515001716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99640052a0 0x7f996400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99780b6190 con 0x7f99640047c0 2024-02-17T14:30:45.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996400c170 con 0x7f9964003970 2024-02-17T14:30:45.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.859+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996400c330 con 0x7f99640052a0 2024-02-17T14:30:45.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.860+0000 7f9977fff640 1 --2- 172.21.15.134:0/2515001716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99640047c0 0x7f9964004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.860+0000 7f997c901640 1 --2- 172.21.15.134:0/2515001716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9964003970 0x7f9964003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.860+0000 7f997d102640 1 --2- 172.21.15.134:0/2515001716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99640052a0 0x7f996400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.860+0000 7f9977fff640 1 -- 172.21.15.134:0/2515001716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99640052a0 msgr2=0x7f996400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:45.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.860+0000 7f9977fff640 1 --2- 172.21.15.134:0/2515001716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99640052a0 0x7f996400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.860+0000 7f9977fff640 1 -- 172.21.15.134:0/2515001716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9964003970 msgr2=0x7f9964003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:45.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.860+0000 7f9977fff640 1 --2- 172.21.15.134:0/2515001716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9964003970 0x7f9964003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.860+0000 7f9977fff640 1 -- 172.21.15.134:0/2515001716 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9964003520 con 0x7f99640047c0 2024-02-17T14:30:45.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.860+0000 7f997d102640 1 -- 172.21.15.134:0/2515001716 reap_dead start 2024-02-17T14:30:45.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.860+0000 7f9977fff640 1 --2- 172.21.15.134:0/2515001716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99640047c0 0x7f9964004c40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f997809c110 tx=0x7f99640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3881f086d5fe72 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:45.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.861+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99680052d0 con 0x7f99640047c0 2024-02-17T14:30:45.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.861+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996802e050 con 0x7f99640047c0 2024-02-17T14:30:45.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.861+0000 7f99777fe640 1 -- 172.21.15.134:0/2515001716 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9968003830 con 0x7f99640047c0 2024-02-17T14:30:45.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.861+0000 7f997eb65640 1 -- 172.21.15.134:0/2515001716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99640047c0 msgr2=0x7f9964004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.861+0000 7f997eb65640 1 --2- 172.21.15.134:0/2515001716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99640047c0 0x7f9964004c40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f997809c110 tx=0x7f99640057f0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.861+0000 7f997eb65640 1 -- 172.21.15.134:0/2515001716 shutdown_connections 2024-02-17T14:30:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.861+0000 7f997eb65640 1 --2- 172.21.15.134:0/2515001716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99640047c0 0x7f9964004c40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.861+0000 7f997eb65640 1 -- 172.21.15.134:0/2515001716 >> 172.21.15.134:0/2515001716 conn(0x7f99780ba430 msgr2=0x7f99780ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.861+0000 7f997eb65640 1 -- 172.21.15.134:0/2515001716 shutdown_connections 2024-02-17T14:30:45.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.861+0000 7f997eb65640 1 -- 172.21.15.134:0/2515001716 wait complete. 2024-02-17T14:30:45.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.862+0000 7f997eb65640 1 Processor -- start 2024-02-17T14:30:45.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.862+0000 7f997eb65640 1 -- start start 2024-02-17T14:30:45.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997eb65640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99640047c0 0x7f99780afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997eb65640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99781dc2c0 0x7f997809ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997eb65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99780b3a10 0x7f99780b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997eb65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997809fad0 con 0x7f99780b3a10 2024-02-17T14:30:45.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997eb65640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99780a04a0 con 0x7f99640047c0 2024-02-17T14:30:45.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997eb65640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99780b0fc0 con 0x7f99781dc2c0 2024-02-17T14:30:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997d102640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99780b3a10 0x7f99780b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997d102640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99780b3a10 0x7f99780b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59002/0 (socket says 172.21.15.134:59002) 2024-02-17T14:30:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997d102640 1 -- 172.21.15.134:0/3495207692 learned_addr learned my addr 172.21.15.134:0/3495207692 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997c901640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99640047c0 0x7f99780afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f9977fff640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99781dc2c0 0x7f997809ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997d102640 1 -- 172.21.15.134:0/3495207692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99781dc2c0 msgr2=0x7f997809ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997d102640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99781dc2c0 0x7f997809ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997d102640 1 -- 172.21.15.134:0/3495207692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99640047c0 msgr2=0x7f99780afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:45.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997d102640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99640047c0 0x7f99780afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:45.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997d102640 1 -- 172.21.15.134:0/3495207692 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99780b12a0 con 0x7f99780b3a10 2024-02-17T14:30:45.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997c901640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99640047c0 0x7f99780afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:30:45.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.863+0000 7f997d102640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99780b3a10 0x7f99780b3e90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9978074730 tx=0x7f996000e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:45.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.864+0000 7f99757fa640 1 -- 172.21.15.134:0/3495207692 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960010510 con 0x7f99780b3a10 2024-02-17T14:30:45.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.864+0000 7f99757fa640 1 -- 172.21.15.134:0/3495207692 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9960010690 con 0x7f99780b3a10 2024-02-17T14:30:45.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.864+0000 7f99757fa640 1 -- 172.21.15.134:0/3495207692 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960010a40 con 0x7f99780b3a10 2024-02-17T14:30:45.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.864+0000 7f997eb65640 1 -- 172.21.15.134:0/3495207692 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997809eba0 con 0x7f99780b3a10 2024-02-17T14:30:45.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.864+0000 7f997eb65640 1 -- 172.21.15.134:0/3495207692 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997809f760 con 0x7f99780b3a10 2024-02-17T14:30:45.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.865+0000 7f997eb65640 1 -- 172.21.15.134:0/3495207692 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9978074440 con 0x7f99780b3a10 2024-02-17T14:30:45.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.865+0000 7f99757fa640 1 -- 172.21.15.134:0/3495207692 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f9960010ba0 con 0x7f99780b3a10 2024-02-17T14:30:45.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.865+0000 7f99757fa640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f995806b840 0x7f995806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:45.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.866+0000 7f99757fa640 1 -- 172.21.15.134:0/3495207692 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9960089c90 con 0x7f99780b3a10 2024-02-17T14:30:45.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.866+0000 7f997c901640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f995806b840 0x7f995806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:45.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.866+0000 7f997c901640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f995806b840 0x7f995806dd00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9978144910 tx=0x7f997000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:45.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:45.870+0000 7f99757fa640 1 -- 172.21.15.134:0/3495207692 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9960054340 con 0x7f99780b3a10 2024-02-17T14:30:46.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.040+0000 7f997eb65640 1 -- 172.21.15.134:0/3495207692 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f9978067b70 con 0x7f99780b3a10 2024-02-17T14:30:46.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.042+0000 7f99757fa640 1 -- 172.21.15.134:0/3495207692 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9960019070 con 0x7f99780b3a10 2024-02-17T14:30:46.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.043+0000 7f99757fa640 1 -- 172.21.15.134:0/3495207692 <== mon.0 v2:172.21.15.134:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9960054340 con 0x7f99780b3a10 2024-02-17T14:30:46.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.045+0000 7f997eb65640 1 -- 172.21.15.134:0/3495207692 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f995806b840 msgr2=0x7f995806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.045+0000 7f997eb65640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f995806b840 0x7f995806dd00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9978144910 tx=0x7f997000b040 comp rx=0 tx=0).stop 2024-02-17T14:30:46.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.045+0000 7f997eb65640 1 -- 172.21.15.134:0/3495207692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99780b3a10 msgr2=0x7f99780b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.045+0000 7f997eb65640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99780b3a10 0x7f99780b3e90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9978074730 tx=0x7f996000e960 comp rx=0 tx=0).stop 2024-02-17T14:30:46.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.045+0000 7f997eb65640 1 -- 172.21.15.134:0/3495207692 shutdown_connections 2024-02-17T14:30:46.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.045+0000 7f997eb65640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f995806b840 0x7f995806dd00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.045+0000 7f997eb65640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99780b3a10 0x7f99780b3e90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.045+0000 7f997eb65640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99781dc2c0 0x7f997809ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.045+0000 7f997eb65640 1 --2- 172.21.15.134:0/3495207692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99640047c0 0x7f99780afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.045+0000 7f997eb65640 1 -- 172.21.15.134:0/3495207692 >> 172.21.15.134:0/3495207692 conn(0x7f99780ba430 msgr2=0x7f99780b7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:46.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.046+0000 7f997eb65640 1 -- 172.21.15.134:0/3495207692 shutdown_connections 2024-02-17T14:30:46.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.046+0000 7f997eb65640 1 -- 172.21.15.134:0/3495207692 wait complete. 2024-02-17T14:30:46.056 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-17T14:30:46.057 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T14:30:46.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.157+0000 7fcc4539f640 1 Processor -- start 2024-02-17T14:30:46.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.157+0000 7fcc4539f640 1 -- start start 2024-02-17T14:30:46.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.158+0000 7fcc4539f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcc4014a600 0x7fcc4014a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.158+0000 7fcc4539f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4014b2b0 con 0x7fcc4009e4a0 2024-02-17T14:30:46.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.158+0000 7fcc4539f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4009c350 con 0x7fcc401474c0 2024-02-17T14:30:46.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.158+0000 7fcc4539f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4014afd0 con 0x7fcc4014a600 2024-02-17T14:30:46.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.158+0000 7fcc44b9e640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fcc4009e4a0 0x7fcc401516c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36566/0 (socket says 172.21.15.134:36566) 2024-02-17T14:30:46.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.158+0000 7fcc44b9e640 1 -- 172.21.15.134:0/588469244 learned_addr learned my addr 172.21.15.134:0/588469244 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:46.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.158+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091073402 0 0) 0x7fcc4014b2b0 con 0x7fcc4009e4a0 2024-02-17T14:30:46.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.158+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc28003520 con 0x7fcc4009e4a0 2024-02-17T14:30:46.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.158+0000 7fcc3ffff640 1 --2- 172.21.15.134:0/588469244 >> v2:172.21.15.142:3300/0 conn(0x7fcc4014a600 0x7fcc4014a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1356436218 0 0) 0x7fcc28003520 con 0x7fcc4009e4a0 2024-02-17T14:30:46.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 >> v2:172.21.15.142:3300/0 conn(0x7fcc4014a600 msgr2=0x7fcc4014a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:46.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3effd640 1 --2- 172.21.15.134:0/588469244 >> v2:172.21.15.142:3300/0 conn(0x7fcc4014a600 0x7fcc4014a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 >> v1:172.21.15.142:6789/0 conn(0x7fcc401474c0 legacy=0x7fcc4009dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc40146fa0 con 0x7fcc4009e4a0 2024-02-17T14:30:46.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7fcc380019f0 con 0x7fcc4009e4a0 2024-02-17T14:30:46.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 >> v1:172.21.15.134:6789/0 conn(0x7fcc4009e4a0 legacy=0x7fcc401516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3effd640 1 --2- 172.21.15.134:0/588469244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc28003970 0x7fcc28003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3effd640 1 --2- 172.21.15.134:0/588469244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc280047c0 0x7fcc28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3effd640 1 --2- 172.21.15.134:0/588469244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc280052a0 0x7fcc2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4014afd0 con 0x7fcc28003970 2024-02-17T14:30:46.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2800c170 con 0x7fcc280052a0 2024-02-17T14:30:46.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2800c330 con 0x7fcc280047c0 2024-02-17T14:30:46.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3ffff640 1 --2- 172.21.15.134:0/588469244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc28003970 0x7fcc28003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc44b9e640 1 --2- 172.21.15.134:0/588469244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc280052a0 0x7fcc2800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3f7fe640 1 --2- 172.21.15.134:0/588469244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc280047c0 0x7fcc28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3ffff640 1 -- 172.21.15.134:0/588469244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc280047c0 msgr2=0x7fcc28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:46.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3ffff640 1 --2- 172.21.15.134:0/588469244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc280047c0 0x7fcc28004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3ffff640 1 -- 172.21.15.134:0/588469244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc280052a0 msgr2=0x7fcc2800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:46.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3ffff640 1 --2- 172.21.15.134:0/588469244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc280052a0 0x7fcc2800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc3ffff640 1 -- 172.21.15.134:0/588469244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc28003520 con 0x7fcc28003970 2024-02-17T14:30:46.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.159+0000 7fcc44b9e640 1 -- 172.21.15.134:0/588469244 reap_dead start 2024-02-17T14:30:46.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.160+0000 7fcc3ffff640 1 --2- 172.21.15.134:0/588469244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc28003970 0x7fcc28003d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009a90 tx=0x7fcc280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6797e03ca9df60e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:46.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.160+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3002c680 con 0x7fcc28003970 2024-02-17T14:30:46.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.160+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcc3002c7e0 con 0x7fcc28003970 2024-02-17T14:30:46.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.160+0000 7fcc3effd640 1 -- 172.21.15.134:0/588469244 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3002cb90 con 0x7fcc28003970 2024-02-17T14:30:46.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.160+0000 7fcc4539f640 1 -- 172.21.15.134:0/588469244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc28003970 msgr2=0x7fcc28003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.160+0000 7fcc4539f640 1 --2- 172.21.15.134:0/588469244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc28003970 0x7fcc28003d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009a90 tx=0x7fcc280057f0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.160+0000 7fcc4539f640 1 -- 172.21.15.134:0/588469244 shutdown_connections 2024-02-17T14:30:46.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.160+0000 7fcc4539f640 1 --2- 172.21.15.134:0/588469244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc28003970 0x7fcc28003d90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.160+0000 7fcc4539f640 1 -- 172.21.15.134:0/588469244 >> 172.21.15.134:0/588469244 conn(0x7fcc400b8f40 msgr2=0x7fcc400b9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:46.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.160+0000 7fcc4539f640 1 -- 172.21.15.134:0/588469244 shutdown_connections 2024-02-17T14:30:46.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.161+0000 7fcc4539f640 1 -- 172.21.15.134:0/588469244 wait complete. 2024-02-17T14:30:46.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.161+0000 7fcc4539f640 1 Processor -- start 2024-02-17T14:30:46.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.162+0000 7fcc4539f640 1 -- start start 2024-02-17T14:30:46.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.162+0000 7fcc4539f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc28003970 0x7fcc400b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.162+0000 7fcc4539f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc400b02d0 0x7fcc400b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.162+0000 7fcc4539f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc401dc470 0x7fcc401df9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.162+0000 7fcc4539f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc400a2240 con 0x7fcc401dc470 2024-02-17T14:30:46.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.162+0000 7fcc4539f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc400b1160 con 0x7fcc400b02d0 2024-02-17T14:30:46.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.162+0000 7fcc4539f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc400af7a0 con 0x7fcc28003970 2024-02-17T14:30:46.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.162+0000 7fcc44b9e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc401dc470 0x7fcc401df9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.162+0000 7fcc44b9e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc401dc470 0x7fcc401df9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59032/0 (socket says 172.21.15.134:59032) 2024-02-17T14:30:46.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.162+0000 7fcc44b9e640 1 -- 172.21.15.134:0/4110369011 learned_addr learned my addr 172.21.15.134:0/4110369011 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:46.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.162+0000 7fcc3ffff640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc28003970 0x7fcc400b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.162+0000 7fcc3f7fe640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc400b02d0 0x7fcc400b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.163+0000 7fcc44b9e640 1 -- 172.21.15.134:0/4110369011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc28003970 msgr2=0x7fcc400b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.163+0000 7fcc44b9e640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc28003970 0x7fcc400b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.163+0000 7fcc44b9e640 1 -- 172.21.15.134:0/4110369011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc400b02d0 msgr2=0x7fcc400b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.163+0000 7fcc44b9e640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc400b02d0 0x7fcc400b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.163+0000 7fcc44b9e640 1 -- 172.21.15.134:0/4110369011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc400afa40 con 0x7fcc401dc470 2024-02-17T14:30:46.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.163+0000 7fcc44b9e640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc401dc470 0x7fcc401df9e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcc38000f80 tx=0x7fcc38007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:46.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.163+0000 7fcc3cff9640 1 -- 172.21.15.134:0/4110369011 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3800ac60 con 0x7fcc401dc470 2024-02-17T14:30:46.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.163+0000 7fcc3cff9640 1 -- 172.21.15.134:0/4110369011 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcc3800adc0 con 0x7fcc401dc470 2024-02-17T14:30:46.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.163+0000 7fcc4539f640 1 -- 172.21.15.134:0/4110369011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc400b13e0 con 0x7fcc401dc470 2024-02-17T14:30:46.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.163+0000 7fcc3cff9640 1 -- 172.21.15.134:0/4110369011 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38013650 con 0x7fcc401dc470 2024-02-17T14:30:46.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.163+0000 7fcc4539f640 1 -- 172.21.15.134:0/4110369011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc400a1ed0 con 0x7fcc401dc470 2024-02-17T14:30:46.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.164+0000 7fcc4539f640 1 -- 172.21.15.134:0/4110369011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc400afff0 con 0x7fcc401dc470 2024-02-17T14:30:46.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.164+0000 7fcc3cff9640 1 -- 172.21.15.134:0/4110369011 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fcc380137b0 con 0x7fcc401dc470 2024-02-17T14:30:46.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.165+0000 7fcc3cff9640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fcc2c06b810 0x7fcc2c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.165+0000 7fcc3cff9640 1 -- 172.21.15.134:0/4110369011 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fcc3808abd0 con 0x7fcc401dc470 2024-02-17T14:30:46.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.165+0000 7fcc3ffff640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fcc2c06b810 0x7fcc2c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.165+0000 7fcc3ffff640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fcc2c06b810 0x7fcc2c06dcd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcc30036000 tx=0x7fcc30030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:46.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.169+0000 7fcc3cff9640 1 -- 172.21.15.134:0/4110369011 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc400afff0 con 0x7fcc401dc470 2024-02-17T14:30:46.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.374+0000 7fcc4539f640 1 -- 172.21.15.134:0/4110369011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc400afff0 con 0x7fcc401dc470 2024-02-17T14:30:46.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.375+0000 7fcc3cff9640 1 -- 172.21.15.134:0/4110369011 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3354 (secure 0 0 0) 0x7fcc400afff0 con 0x7fcc401dc470 2024-02-17T14:30:46.375 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:30:46.375 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/137239145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":137239145},{"type":"v1","addr":"172.21.15.134:6835","nonce":137239145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T14:28:03.523163+0000","modified":"2024-02-17T14:28:24.032729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/177127534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":177127534},{"type":"v1","addr":"172.21.15.142:6833","nonce":177127534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T14:30:46.376 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 9 2024-02-17T14:30:46.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.377+0000 7fcc4539f640 1 -- 172.21.15.134:0/4110369011 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fcc2c06b810 msgr2=0x7fcc2c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.377+0000 7fcc4539f640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fcc2c06b810 0x7fcc2c06dcd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcc30036000 tx=0x7fcc30030000 comp rx=0 tx=0).stop 2024-02-17T14:30:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.377+0000 7fcc4539f640 1 -- 172.21.15.134:0/4110369011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc401dc470 msgr2=0x7fcc401df9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.377+0000 7fcc4539f640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc401dc470 0x7fcc401df9e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcc38000f80 tx=0x7fcc38007b20 comp rx=0 tx=0).stop 2024-02-17T14:30:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.377+0000 7fcc4539f640 1 -- 172.21.15.134:0/4110369011 shutdown_connections 2024-02-17T14:30:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.377+0000 7fcc4539f640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fcc2c06b810 0x7fcc2c06dcd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.377+0000 7fcc4539f640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc401dc470 0x7fcc401df9e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.377+0000 7fcc4539f640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc400b02d0 0x7fcc400b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.377+0000 7fcc4539f640 1 --2- 172.21.15.134:0/4110369011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc28003970 0x7fcc400b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.377+0000 7fcc4539f640 1 -- 172.21.15.134:0/4110369011 >> 172.21.15.134:0/4110369011 conn(0x7fcc400b8f40 msgr2=0x7fcc400bb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:46.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.377+0000 7fcc4539f640 1 -- 172.21.15.134:0/4110369011 shutdown_connections 2024-02-17T14:30:46.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.377+0000 7fcc4539f640 1 -- 172.21.15.134:0/4110369011 wait complete. 2024-02-17T14:30:46.388 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T14:30:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.488+0000 7f147001b640 1 Processor -- start 2024-02-17T14:30:46.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.489+0000 7f147001b640 1 -- start start 2024-02-17T14:30:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.489+0000 7f147001b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14680ada50 0x7f1468140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.489+0000 7f147001b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1468141090 0x7f1468151810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.489+0000 7f147001b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14680b51f0 con 0x7f14680acb20 2024-02-17T14:30:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.489+0000 7f147001b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14681475a0 con 0x7f14680ada50 2024-02-17T14:30:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.489+0000 7f147001b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14680b6640 con 0x7f1468141090 2024-02-17T14:30:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.489+0000 7f146ddb7640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f14680acb20 0x7f1468146e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36580/0 (socket says 172.21.15.134:36580) 2024-02-17T14:30:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.489+0000 7f146ddb7640 1 -- 172.21.15.134:0/1371385168 learned_addr learned my addr 172.21.15.134:0/1371385168 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146e5b8640 1 --2- 172.21.15.134:0/1371385168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1468141090 0x7f1468151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278174854 0 0) 0x7f14680b51f0 con 0x7f14680acb20 2024-02-17T14:30:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1454003520 con 0x7f14680acb20 2024-02-17T14:30:46.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146d5b6640 1 --2- 172.21.15.134:0/1371385168 >> v2:172.21.15.142:3300/0 conn(0x7f14680ada50 0x7f1468140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3001998031 0 0) 0x7f1454003520 con 0x7f14680acb20 2024-02-17T14:30:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1468141090 msgr2=0x7f1468151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 --2- 172.21.15.134:0/1371385168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1468141090 0x7f1468151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 >> v2:172.21.15.142:3300/0 conn(0x7f14680ada50 msgr2=0x7f1468140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 --2- 172.21.15.134:0/1371385168 >> v2:172.21.15.142:3300/0 conn(0x7f14680ada50 0x7f1468140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14680ad2b0 con 0x7f14680acb20 2024-02-17T14:30:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1527027792 0 0) 0x7f14600017f0 con 0x7f14680acb20 2024-02-17T14:30:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 >> v1:172.21.15.134:6789/0 conn(0x7f14680acb20 legacy=0x7f1468146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 --2- 172.21.15.134:0/1371385168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1468141090 0x7f1454003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 --2- 172.21.15.134:0/1371385168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454003ef0 0x7f14540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 --2- 172.21.15.134:0/1371385168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1454004d00 0x7f1454005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14681475a0 con 0x7f1454004d00 2024-02-17T14:30:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14680b6640 con 0x7f1454003ef0 2024-02-17T14:30:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145400b980 con 0x7f1468141090 2024-02-17T14:30:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146e5b8640 1 --2- 172.21.15.134:0/1371385168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1454004d00 0x7f1454005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146ddb7640 1 --2- 172.21.15.134:0/1371385168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1468141090 0x7f1454003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146d5b6640 1 --2- 172.21.15.134:0/1371385168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454003ef0 0x7f14540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146e5b8640 1 -- 172.21.15.134:0/1371385168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1468141090 msgr2=0x7f1454003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146e5b8640 1 --2- 172.21.15.134:0/1371385168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1468141090 0x7f1454003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146e5b8640 1 -- 172.21.15.134:0/1371385168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454003ef0 msgr2=0x7f14540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146e5b8640 1 --2- 172.21.15.134:0/1371385168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454003ef0 0x7f14540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.490+0000 7f146e5b8640 1 -- 172.21.15.134:0/1371385168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1454003520 con 0x7f1454004d00 2024-02-17T14:30:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.491+0000 7f146e5b8640 1 --2- 172.21.15.134:0/1371385168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1454004d00 0x7f1454005180 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1464009fc0 tx=0x7f14540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2961f71617c25c1b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.491+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146402cc00 con 0x7f1454004d00 2024-02-17T14:30:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.491+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f146400f040 con 0x7f1454004d00 2024-02-17T14:30:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.491+0000 7f146cdb5640 1 -- 172.21.15.134:0/1371385168 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1464034440 con 0x7f1454004d00 2024-02-17T14:30:46.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.492+0000 7f147001b640 1 -- 172.21.15.134:0/1371385168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1454004d00 msgr2=0x7f1454005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.492+0000 7f147001b640 1 --2- 172.21.15.134:0/1371385168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1454004d00 0x7f1454005180 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1464009fc0 tx=0x7f14540057f0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.492+0000 7f146e5b8640 1 -- 172.21.15.134:0/1371385168 reap_dead start 2024-02-17T14:30:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.492+0000 7f147001b640 1 -- 172.21.15.134:0/1371385168 shutdown_connections 2024-02-17T14:30:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.492+0000 7f147001b640 1 -- 172.21.15.134:0/1371385168 >> 172.21.15.134:0/1371385168 conn(0x7f14680ba420 msgr2=0x7f14680ba830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.492+0000 7f147001b640 1 -- 172.21.15.134:0/1371385168 shutdown_connections 2024-02-17T14:30:46.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.492+0000 7f147001b640 1 -- 172.21.15.134:0/1371385168 wait complete. 2024-02-17T14:30:46.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.493+0000 7f147001b640 1 Processor -- start 2024-02-17T14:30:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.493+0000 7f147001b640 1 -- start start 2024-02-17T14:30:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.493+0000 7f147001b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1454004d00 0x7f14681436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.493+0000 7f147001b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1468144620 0x7f14680b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.493+0000 7f147001b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14680b2e60 0x7f14681dfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.493+0000 7f147001b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1468143c00 con 0x7f1468144620 2024-02-17T14:30:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.493+0000 7f147001b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1468143e70 con 0x7f14680b2e60 2024-02-17T14:30:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.493+0000 7f147001b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1468141940 con 0x7f1454004d00 2024-02-17T14:30:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f146d5b6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1468144620 0x7f14680b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f146d5b6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1468144620 0x7f14680b2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59042/0 (socket says 172.21.15.134:59042) 2024-02-17T14:30:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f146d5b6640 1 -- 172.21.15.134:0/3072818290 learned_addr learned my addr 172.21.15.134:0/3072818290 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f146ddb7640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1454004d00 0x7f14681436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f146d5b6640 1 -- 172.21.15.134:0/3072818290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1454004d00 msgr2=0x7f14681436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f146e5b8640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14680b2e60 0x7f14681dfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f146d5b6640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1454004d00 0x7f14681436c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f146d5b6640 1 -- 172.21.15.134:0/3072818290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14680b2e60 msgr2=0x7f14681dfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f146d5b6640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14680b2e60 0x7f14681dfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f146d5b6640 1 -- 172.21.15.134:0/3072818290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14680ae0a0 con 0x7f1468144620 2024-02-17T14:30:46.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f146d5b6640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1468144620 0x7f14680b2920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1458011960 tx=0x7f1458011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f145e7fc640 1 -- 172.21.15.134:0/3072818290 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145800faf0 con 0x7f1468144620 2024-02-17T14:30:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f145e7fc640 1 -- 172.21.15.134:0/3072818290 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f145800fc50 con 0x7f1468144620 2024-02-17T14:30:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f147001b640 1 -- 172.21.15.134:0/3072818290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14680b3310 con 0x7f1468144620 2024-02-17T14:30:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f145e7fc640 1 -- 172.21.15.134:0/3072818290 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458014440 con 0x7f1468144620 2024-02-17T14:30:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.494+0000 7f147001b640 1 -- 172.21.15.134:0/3072818290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14680ae5b0 con 0x7f1468144620 2024-02-17T14:30:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.495+0000 7f147001b640 1 -- 172.21.15.134:0/3072818290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1468068280 con 0x7f1468144620 2024-02-17T14:30:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.495+0000 7f145e7fc640 1 -- 172.21.15.134:0/3072818290 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f14580145a0 con 0x7f1468144620 2024-02-17T14:30:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.496+0000 7f145e7fc640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f144c06b840 0x7f144c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.496+0000 7f145e7fc640 1 -- 172.21.15.134:0/3072818290 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f145808ae70 con 0x7f1468144620 2024-02-17T14:30:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.496+0000 7f146ddb7640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f144c06b840 0x7f144c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.496+0000 7f146ddb7640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f144c06b840 0x7f144c06dd00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1460000ef0 tx=0x7f1460009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:46.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.500+0000 7f145e7fc640 1 -- 172.21.15.134:0/3072818290 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1458055520 con 0x7f1468144620 2024-02-17T14:30:46.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.705+0000 7f147001b640 1 -- 172.21.15.134:0/3072818290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14680b4fd0 con 0x7f1468144620 2024-02-17T14:30:46.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.705+0000 7f145e7fc640 1 -- 172.21.15.134:0/3072818290 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3354 (secure 0 0 0) 0x7f1458058be0 con 0x7f1468144620 2024-02-17T14:30:46.706 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:30:46.706 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/137239145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":137239145},{"type":"v1","addr":"172.21.15.134:6835","nonce":137239145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T14:28:03.523163+0000","modified":"2024-02-17T14:28:24.032729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/177127534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":177127534},{"type":"v1","addr":"172.21.15.142:6833","nonce":177127534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T14:30:46.706 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 9 2024-02-17T14:30:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.707+0000 7f147001b640 1 -- 172.21.15.134:0/3072818290 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f144c06b840 msgr2=0x7f144c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.707+0000 7f147001b640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f144c06b840 0x7f144c06dd00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1460000ef0 tx=0x7f1460009040 comp rx=0 tx=0).stop 2024-02-17T14:30:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.707+0000 7f147001b640 1 -- 172.21.15.134:0/3072818290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1468144620 msgr2=0x7f14680b2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.707+0000 7f147001b640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1468144620 0x7f14680b2920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1458011960 tx=0x7f1458011e20 comp rx=0 tx=0).stop 2024-02-17T14:30:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.707+0000 7f147001b640 1 -- 172.21.15.134:0/3072818290 shutdown_connections 2024-02-17T14:30:46.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.707+0000 7f147001b640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14680b2e60 0x7f14681dfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.707+0000 7f147001b640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f144c06b840 0x7f144c06dd00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.707+0000 7f147001b640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1468144620 0x7f14680b2920 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.707+0000 7f147001b640 1 --2- 172.21.15.134:0/3072818290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1454004d00 0x7f14681436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.707+0000 7f147001b640 1 -- 172.21.15.134:0/3072818290 >> 172.21.15.134:0/3072818290 conn(0x7f14680ba420 msgr2=0x7f146813ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:46.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.707+0000 7f147001b640 1 -- 172.21.15.134:0/3072818290 shutdown_connections 2024-02-17T14:30:46.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.707+0000 7f147001b640 1 -- 172.21.15.134:0/3072818290 wait complete. 2024-02-17T14:30:46.718 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T14:30:46.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.819+0000 7f73fd90d640 1 Processor -- start 2024-02-17T14:30:46.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.819+0000 7f73fd90d640 1 -- start start 2024-02-17T14:30:46.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73fd90d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73f814a710 0x7f73f80b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73fd90d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f73f809b190 0x7f73f8144250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73fd90d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f73f8144790 0x7f73f8146f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73fd90d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f809c280 con 0x7f73f809b190 2024-02-17T14:30:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73fd90d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f809b5f0 con 0x7f73f8144790 2024-02-17T14:30:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73fd90d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f814aaf0 con 0x7f73f814a710 2024-02-17T14:30:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73f67fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f73f809b190 0x7f73f8144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73f67fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f73f809b190 0x7f73f8144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59046/0 (socket says 172.21.15.134:59046) 2024-02-17T14:30:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73f67fc640 1 -- 172.21.15.134:0/532272521 learned_addr learned my addr 172.21.15.134:0/532272521 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73f6ffd640 1 --2- 172.21.15.134:0/532272521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73f814a710 0x7f73f80b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73f77fe640 1 --2- 172.21.15.134:0/532272521 >> v2:172.21.15.142:3300/0 conn(0x7f73f8144790 0x7f73f8146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73f67fc640 1 -- 172.21.15.134:0/532272521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73f814a710 msgr2=0x7f73f80b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73f67fc640 1 --2- 172.21.15.134:0/532272521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73f814a710 0x7f73f80b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73f67fc640 1 -- 172.21.15.134:0/532272521 >> v2:172.21.15.142:3300/0 conn(0x7f73f8144790 msgr2=0x7f73f8146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73f67fc640 1 --2- 172.21.15.134:0/532272521 >> v2:172.21.15.142:3300/0 conn(0x7f73f8144790 0x7f73f8146f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73f67fc640 1 -- 172.21.15.134:0/532272521 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8144be0 con 0x7f73f809b190 2024-02-17T14:30:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.820+0000 7f73f77fe640 1 --2- 172.21.15.134:0/532272521 >> v2:172.21.15.142:3300/0 conn(0x7f73f8144790 0x7f73f8146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:30:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.821+0000 7f73f67fc640 1 --2- 172.21.15.134:0/532272521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f809b190 0x7f73f8144250 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f73f8099e40 tx=0x7f73ec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f0b52c064b2dfb server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.821+0000 7f73f5ffb640 1 -- 172.21.15.134:0/532272521 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec0317e0 con 0x7f73f809b190 2024-02-17T14:30:46.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.821+0000 7f73f5ffb640 1 -- 172.21.15.134:0/532272521 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f73ec031940 con 0x7f73f809b190 2024-02-17T14:30:46.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.821+0000 7f73f5ffb640 1 -- 172.21.15.134:0/532272521 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec031cf0 con 0x7f73f809b190 2024-02-17T14:30:46.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.821+0000 7f73fd90d640 1 -- 172.21.15.134:0/532272521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f809b190 msgr2=0x7f73f8144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.821+0000 7f73fd90d640 1 --2- 172.21.15.134:0/532272521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f809b190 0x7f73f8144250 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f73f8099e40 tx=0x7f73ec02b880 comp rx=0 tx=0).stop 2024-02-17T14:30:46.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.821+0000 7f73fd90d640 1 -- 172.21.15.134:0/532272521 shutdown_connections 2024-02-17T14:30:46.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.821+0000 7f73fd90d640 1 --2- 172.21.15.134:0/532272521 >> v2:172.21.15.142:3300/0 conn(0x7f73f8144790 0x7f73f8146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.821+0000 7f73fd90d640 1 --2- 172.21.15.134:0/532272521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f809b190 0x7f73f8144250 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.821+0000 7f73fd90d640 1 --2- 172.21.15.134:0/532272521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73f814a710 0x7f73f80b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.821+0000 7f73fd90d640 1 -- 172.21.15.134:0/532272521 >> 172.21.15.134:0/532272521 conn(0x7f73f80b90c0 msgr2=0x7f73f80b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:46.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.821+0000 7f73fd90d640 1 -- 172.21.15.134:0/532272521 shutdown_connections 2024-02-17T14:30:46.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.822+0000 7f73fd90d640 1 -- 172.21.15.134:0/532272521 wait complete. 2024-02-17T14:30:46.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.822+0000 7f73fd90d640 1 Processor -- start 2024-02-17T14:30:46.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.823+0000 7f73fd90d640 1 -- start start 2024-02-17T14:30:46.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.823+0000 7f73fd90d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73f809b190 0x7f73f80b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.823+0000 7f73fd90d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f8144790 0x7f73f81dbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.823+0000 7f73fd90d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73f814a710 0x7f73f81474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.823+0000 7f73fd90d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80b14e0 con 0x7f73f8144790 2024-02-17T14:30:46.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.823+0000 7f73fd90d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80b1aa0 con 0x7f73f809b190 2024-02-17T14:30:46.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.823+0000 7f73fd90d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8145fc0 con 0x7f73f814a710 2024-02-17T14:30:46.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.823+0000 7f73f67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f8144790 0x7f73f81dbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.823+0000 7f73f67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f8144790 0x7f73f81dbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59060/0 (socket says 172.21.15.134:59060) 2024-02-17T14:30:46.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.823+0000 7f73f67fc640 1 -- 172.21.15.134:0/460757532 learned_addr learned my addr 172.21.15.134:0/460757532 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:46.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.823+0000 7f73f77fe640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73f814a710 0x7f73f81474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.823+0000 7f73f6ffd640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73f809b190 0x7f73f80b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.824+0000 7f73f67fc640 1 -- 172.21.15.134:0/460757532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73f814a710 msgr2=0x7f73f81474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.824+0000 7f73f67fc640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73f814a710 0x7f73f81474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.824+0000 7f73f67fc640 1 -- 172.21.15.134:0/460757532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73f809b190 msgr2=0x7f73f80b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:46.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.824+0000 7f73f67fc640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73f809b190 0x7f73f80b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:46.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.824+0000 7f73f67fc640 1 -- 172.21.15.134:0/460757532 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec0094d0 con 0x7f73f8144790 2024-02-17T14:30:46.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.824+0000 7f73f6ffd640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73f809b190 0x7f73f80b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T14:30:46.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.824+0000 7f73f67fc640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f8144790 0x7f73f81dbf00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f73ec02b8c0 tx=0x7f73ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:46.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.824+0000 7f73dffff640 1 -- 172.21.15.134:0/460757532 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec032880 con 0x7f73f8144790 2024-02-17T14:30:46.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.824+0000 7f73dffff640 1 -- 172.21.15.134:0/460757532 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f73ec0329e0 con 0x7f73f8144790 2024-02-17T14:30:46.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.824+0000 7f73fd90d640 1 -- 172.21.15.134:0/460757532 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f80b1730 con 0x7f73f8144790 2024-02-17T14:30:46.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.824+0000 7f73dffff640 1 -- 172.21.15.134:0/460757532 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec032db0 con 0x7f73f8144790 2024-02-17T14:30:46.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.824+0000 7f73fd90d640 1 -- 172.21.15.134:0/460757532 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f80b1f30 con 0x7f73f8144790 2024-02-17T14:30:46.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.825+0000 7f73fd90d640 1 -- 172.21.15.134:0/460757532 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f8067b70 con 0x7f73f8144790 2024-02-17T14:30:46.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.825+0000 7f73dffff640 1 -- 172.21.15.134:0/460757532 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f73ec0453f0 con 0x7f73f8144790 2024-02-17T14:30:46.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.826+0000 7f73dffff640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f73e406b810 0x7f73e406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:46.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.826+0000 7f73dffff640 1 -- 172.21.15.134:0/460757532 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f73ec0ac9f0 con 0x7f73f8144790 2024-02-17T14:30:46.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.826+0000 7f73f6ffd640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f73e406b810 0x7f73e406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:46.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.826+0000 7f73f6ffd640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f73e406b810 0x7f73e406dcd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f73e800b9f0 tx=0x7f73e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:46.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:46.830+0000 7f73dffff640 1 -- 172.21.15.134:0/460757532 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f73ec077140 con 0x7f73f8144790 2024-02-17T14:30:47.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.001+0000 7f73fd90d640 1 -- 172.21.15.134:0/460757532 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73f80a25c0 con 0x7f73f8144790 2024-02-17T14:30:47.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.003+0000 7f73dffff640 1 -- 172.21.15.134:0/460757532 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f73ec07fe60 con 0x7f73f8144790 2024-02-17T14:30:47.003 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-02-17T14:30:47.003 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":27,"fsid":"b1013434-3edf-47fa-8dd2-e861b79d4deb","created":"2024-02-17T14:27:46.381368+0000","modified":"2024-02-17T14:28:51.760520+0000","last_up_change":"2024-02-17T14:27:56.587817+0000","last_in_change":"2024-02-17T14:27:48.631311+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T14:27:58.602268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T14:28:01.178917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T14:28:02.371936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-17T14:28:05.647194+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1fe51099-49d8-4cb5-9f61-ac89029c1f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6811","nonce":3803014718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6814","nonce":3803014718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6825","nonce":3803014718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3803014718},{"type":"v1","addr":"172.21.15.134:6819","nonce":3803014718}]},"public_addr":"172.21.15.134:6811/3803014718","cluster_addr":"172.21.15.134:6814/3803014718","heartbeat_back_addr":"172.21.15.134:6825/3803014718","heartbeat_front_addr":"172.21.15.134:6819/3803014718","state":["exists","up"]},{"osd":1,"uuid":"7f46f0ae-43cb-4075-8096-cf2928cae7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6810","nonce":3862322423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6813","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6815","nonce":3862322423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6823","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6826","nonce":3862322423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":3862322423},{"type":"v1","addr":"172.21.15.134:6820","nonce":3862322423}]},"public_addr":"172.21.15.134:6810/3862322423","cluster_addr":"172.21.15.134:6815/3862322423","heartbeat_back_addr":"172.21.15.134:6826/3862322423","heartbeat_front_addr":"172.21.15.134:6820/3862322423","state":["exists","up"]},{"osd":2,"uuid":"0d3cba9c-f40a-4f28-894d-359ced1fcb48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6801","nonce":1064515362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6803","nonce":1064515362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6807","nonce":1064515362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1064515362},{"type":"v1","addr":"172.21.15.134:6805","nonce":1064515362}]},"public_addr":"172.21.15.134:6801/1064515362","cluster_addr":"172.21.15.134:6803/1064515362","heartbeat_back_addr":"172.21.15.134:6807/1064515362","heartbeat_front_addr":"172.21.15.134:6805/1064515362","state":["exists","up"]},{"osd":3,"uuid":"b23b3526-bd03-408f-8bea-aa0b11b2fddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6821","nonce":2845314185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6827","nonce":2845314185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6831","nonce":2845314185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2845314185},{"type":"v1","addr":"172.21.15.134:6829","nonce":2845314185}]},"public_addr":"172.21.15.134:6821/2845314185","cluster_addr":"172.21.15.134:6827/2845314185","heartbeat_back_addr":"172.21.15.134:6831/2845314185","heartbeat_front_addr":"172.21.15.134:6829/2845314185","state":["exists","up"]},{"osd":4,"uuid":"6467569a-b74d-4dc6-97e4-9fc8486ba038","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6801","nonce":2415773380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6803","nonce":2415773380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6807","nonce":2415773380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2415773380},{"type":"v1","addr":"172.21.15.142:6805","nonce":2415773380}]},"public_addr":"172.21.15.142:6801/2415773380","cluster_addr":"172.21.15.142:6803/2415773380","heartbeat_back_addr":"172.21.15.142:6807/2415773380","heartbeat_front_addr":"172.21.15.142:6805/2415773380","state":["exists","up"]},{"osd":5,"uuid":"349c3144-c5bc-4a98-96f9-7da56cc489a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6825","nonce":819337168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6827","nonce":819337168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6831","nonce":819337168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":819337168},{"type":"v1","addr":"172.21.15.142:6829","nonce":819337168}]},"public_addr":"172.21.15.142:6825/819337168","cluster_addr":"172.21.15.142:6827/819337168","heartbeat_back_addr":"172.21.15.142:6831/819337168","heartbeat_front_addr":"172.21.15.142:6829/819337168","state":["exists","up"]},{"osd":6,"uuid":"d9e80b9b-4def-47f9-8807-43f245f76eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6817","nonce":756473126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6819","nonce":756473126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6823","nonce":756473126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":756473126},{"type":"v1","addr":"172.21.15.142:6821","nonce":756473126}]},"public_addr":"172.21.15.142:6817/756473126","cluster_addr":"172.21.15.142:6819/756473126","heartbeat_back_addr":"172.21.15.142:6823/756473126","heartbeat_front_addr":"172.21.15.142:6821/756473126","state":["exists","up"]},{"osd":7,"uuid":"c46ec0b3-210a-4e7e-b8a9-73d7ffa0d84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6809","nonce":2672906066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6811","nonce":2672906066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6815","nonce":2672906066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2672906066},{"type":"v1","addr":"172.21.15.142:6813","nonce":2672906066}]},"public_addr":"172.21.15.142:6809/2672906066","cluster_addr":"172.21.15.142:6811/2672906066","heartbeat_back_addr":"172.21.15.142:6815/2672906066","heartbeat_front_addr":"172.21.15.142:6813/2672906066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.876385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.822536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.762041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.826824+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.744742+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.765391+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.783014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T14:27:53.746442+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T14:30:47.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.005+0000 7f73fd90d640 1 -- 172.21.15.134:0/460757532 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f73e406b810 msgr2=0x7f73e406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:47.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.005+0000 7f73fd90d640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f73e406b810 0x7f73e406dcd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f73e800b9f0 tx=0x7f73e8008040 comp rx=0 tx=0).stop 2024-02-17T14:30:47.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.005+0000 7f73fd90d640 1 -- 172.21.15.134:0/460757532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f8144790 msgr2=0x7f73f81dbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:47.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.005+0000 7f73fd90d640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f8144790 0x7f73f81dbf00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f73ec02b8c0 tx=0x7f73ec0046c0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.005+0000 7f73fd90d640 1 -- 172.21.15.134:0/460757532 shutdown_connections 2024-02-17T14:30:47.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.005+0000 7f73fd90d640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73f814a710 0x7f73f81474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.005+0000 7f73fd90d640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f73e406b810 0x7f73e406dcd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.005+0000 7f73fd90d640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f8144790 0x7f73f81dbf00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.005+0000 7f73fd90d640 1 --2- 172.21.15.134:0/460757532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73f809b190 0x7f73f80b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.005+0000 7f73fd90d640 1 -- 172.21.15.134:0/460757532 >> 172.21.15.134:0/460757532 conn(0x7f73f80b90c0 msgr2=0x7f73f81482a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:47.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.005+0000 7f73fd90d640 1 -- 172.21.15.134:0/460757532 shutdown_connections 2024-02-17T14:30:47.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.005+0000 7f73fd90d640 1 -- 172.21.15.134:0/460757532 wait complete. 2024-02-17T14:30:47.016 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-17T14:30:47.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.117+0000 7f80feb48640 1 Processor -- start 2024-02-17T14:30:47.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.117+0000 7f80feb48640 1 -- start start 2024-02-17T14:30:47.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.118+0000 7f80feb48640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f80f8066b20 0x7f80f80b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:47.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.118+0000 7f80feb48640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f8072210 con 0x7f80f80b8180 2024-02-17T14:30:47.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.118+0000 7f80feb48640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f8071aa0 con 0x7f80f81414e0 2024-02-17T14:30:47.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.118+0000 7f80feb48640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f8072960 con 0x7f80f8066b20 2024-02-17T14:30:47.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.118+0000 7f80fc8e4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f80f8066b20 0x7f80f80b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:47.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.118+0000 7f80f7fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f80f80b8180 0x7f80f8140dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36582/0 (socket says 172.21.15.134:36582) 2024-02-17T14:30:47.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.118+0000 7f80f7fff640 1 -- 172.21.15.134:0/2984568378 learned_addr learned my addr 172.21.15.134:0/2984568378 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:47.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.118+0000 7f80fc8e4640 1 -- 172.21.15.134:0/2984568378 >> v1:172.21.15.142:6789/0 conn(0x7f80f81414e0 legacy=0x7f80f81517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:47.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.118+0000 7f80fc8e4640 1 -- 172.21.15.134:0/2984568378 >> v1:172.21.15.134:6789/0 conn(0x7f80f80b8180 legacy=0x7f80f8140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:47.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.118+0000 7f80fc8e4640 1 -- 172.21.15.134:0/2984568378 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f8066f00 con 0x7f80f8066b20 2024-02-17T14:30:47.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.118+0000 7f80f77fe640 1 -- 172.21.15.134:0/2984568378 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965793147 0 0) 0x7f80f8072210 con 0x7f80f80b8180 2024-02-17T14:30:47.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.119+0000 7f80fc8e4640 1 --2- 172.21.15.134:0/2984568378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f8066b20 0x7f80f80b7c40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f80e80097a0 tx=0x7f80e802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c50b57c9c66a2b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:47.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.119+0000 7f80f77fe640 1 -- 172.21.15.134:0/2984568378 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e802e070 con 0x7f80f8066b20 2024-02-17T14:30:47.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.119+0000 7f80f77fe640 1 -- 172.21.15.134:0/2984568378 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f80e80315a0 con 0x7f80f8066b20 2024-02-17T14:30:47.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.119+0000 7f80f77fe640 1 -- 172.21.15.134:0/2984568378 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8031950 con 0x7f80f8066b20 2024-02-17T14:30:47.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.119+0000 7f80feb48640 1 -- 172.21.15.134:0/2984568378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f8066b20 msgr2=0x7f80f80b7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:47.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.119+0000 7f80feb48640 1 --2- 172.21.15.134:0/2984568378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f8066b20 0x7f80f80b7c40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f80e80097a0 tx=0x7f80e802b840 comp rx=0 tx=0).stop 2024-02-17T14:30:47.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.119+0000 7f80feb48640 1 -- 172.21.15.134:0/2984568378 shutdown_connections 2024-02-17T14:30:47.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.119+0000 7f80feb48640 1 --2- 172.21.15.134:0/2984568378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f8066b20 0x7f80f80b7c40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.119+0000 7f80feb48640 1 -- 172.21.15.134:0/2984568378 >> 172.21.15.134:0/2984568378 conn(0x7f80f80b5fe0 msgr2=0x7f80f80b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:47.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.120+0000 7f80feb48640 1 -- 172.21.15.134:0/2984568378 shutdown_connections 2024-02-17T14:30:47.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.120+0000 7f80feb48640 1 -- 172.21.15.134:0/2984568378 wait complete. 2024-02-17T14:30:47.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.120+0000 7f80feb48640 1 Processor -- start 2024-02-17T14:30:47.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.120+0000 7f80feb48640 1 -- start start 2024-02-17T14:30:47.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.121+0000 7f80feb48640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f8066b20 0x7f80f8145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:47.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.121+0000 7f80feb48640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f80b8180 0x7f80f81dcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:47.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.121+0000 7f80feb48640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f81414e0 0x7f80f813cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:47.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.121+0000 7f80feb48640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8145850 con 0x7f80f8066b20 2024-02-17T14:30:47.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.121+0000 7f80feb48640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8147540 con 0x7f80f80b8180 2024-02-17T14:30:47.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.121+0000 7f80feb48640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8145b10 con 0x7f80f81414e0 2024-02-17T14:30:47.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.121+0000 7f80fc8e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f8066b20 0x7f80f8145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:47.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.121+0000 7f80fc8e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f8066b20 0x7f80f8145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59082/0 (socket says 172.21.15.134:59082) 2024-02-17T14:30:47.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.121+0000 7f80fc8e4640 1 -- 172.21.15.134:0/3302224028 learned_addr learned my addr 172.21.15.134:0/3302224028 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:47.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.121+0000 7f80fc8e4640 1 -- 172.21.15.134:0/3302224028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f81414e0 msgr2=0x7f80f813cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:47.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.121+0000 7f80fc8e4640 1 --2- 172.21.15.134:0/3302224028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f81414e0 0x7f80f813cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.121+0000 7f80f7fff640 1 --2- 172.21.15.134:0/3302224028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f80b8180 0x7f80f81dcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:47.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.122+0000 7f80fc8e4640 1 -- 172.21.15.134:0/3302224028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f80b8180 msgr2=0x7f80f81dcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:47.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.122+0000 7f80fc8e4640 1 --2- 172.21.15.134:0/3302224028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f80b8180 0x7f80f81dcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.122+0000 7f80fc8e4640 1 -- 172.21.15.134:0/3302224028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8009400 con 0x7f80f8066b20 2024-02-17T14:30:47.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.122+0000 7f80fc8e4640 1 --2- 172.21.15.134:0/3302224028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f8066b20 0x7f80f8145310 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f80e8000c00 tx=0x7f80e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:47.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.122+0000 7f80f57fa640 1 -- 172.21.15.134:0/3302224028 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8004230 con 0x7f80f8066b20 2024-02-17T14:30:47.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.122+0000 7f80f57fa640 1 -- 172.21.15.134:0/3302224028 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f80e8004390 con 0x7f80f8066b20 2024-02-17T14:30:47.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.122+0000 7f80feb48640 1 -- 172.21.15.134:0/3302224028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f8147260 con 0x7f80f8066b20 2024-02-17T14:30:47.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.122+0000 7f80f57fa640 1 -- 172.21.15.134:0/3302224028 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8032900 con 0x7f80f8066b20 2024-02-17T14:30:47.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.122+0000 7f80feb48640 1 -- 172.21.15.134:0/3302224028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f8146330 con 0x7f80f8066b20 2024-02-17T14:30:47.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.123+0000 7f80feb48640 1 -- 172.21.15.134:0/3302224028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f8145cd0 con 0x7f80f8066b20 2024-02-17T14:30:47.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.123+0000 7f80f57fa640 1 -- 172.21.15.134:0/3302224028 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f80e8032a60 con 0x7f80f8066b20 2024-02-17T14:30:47.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.124+0000 7f80f57fa640 1 --2- 172.21.15.134:0/3302224028 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f80e406b810 0x7f80e406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:47.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.124+0000 7f80f57fa640 1 -- 172.21.15.134:0/3302224028 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f80e80ac8c0 con 0x7f80f8066b20 2024-02-17T14:30:47.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.124+0000 7f80f7fff640 1 --2- 172.21.15.134:0/3302224028 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f80e406b810 0x7f80e406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:47.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.124+0000 7f80f7fff640 1 --2- 172.21.15.134:0/3302224028 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f80e406b810 0x7f80e406dcd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f80ec007fd0 tx=0x7f80ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:47.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.128+0000 7f80f57fa640 1 -- 172.21.15.134:0/3302224028 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f80e8076f70 con 0x7f80f8066b20 2024-02-17T14:30:47.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.334+0000 7f80feb48640 1 -- 172.21.15.134:0/3302224028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f80f8145cd0 con 0x7f80f8066b20 2024-02-17T14:30:47.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.336+0000 7f80f57fa640 1 -- 172.21.15.134:0/3302224028 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f80e807a630 con 0x7f80f8066b20 2024-02-17T14:30:47.336 INFO:teuthology.orchestra.run.smithi134.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-17T14:30:47.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.340+0000 7f80feb48640 1 -- 172.21.15.134:0/3302224028 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f80e406b810 msgr2=0x7f80e406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:47.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.340+0000 7f80feb48640 1 --2- 172.21.15.134:0/3302224028 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f80e406b810 0x7f80e406dcd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f80ec007fd0 tx=0x7f80ec009040 comp rx=0 tx=0).stop 2024-02-17T14:30:47.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.340+0000 7f80feb48640 1 -- 172.21.15.134:0/3302224028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f8066b20 msgr2=0x7f80f8145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:47.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.340+0000 7f80feb48640 1 --2- 172.21.15.134:0/3302224028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f8066b20 0x7f80f8145310 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f80e8000c00 tx=0x7f80e80046c0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.340+0000 7f80feb48640 1 -- 172.21.15.134:0/3302224028 shutdown_connections 2024-02-17T14:30:47.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.340+0000 7f80feb48640 1 --2- 172.21.15.134:0/3302224028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f81414e0 0x7f80f813cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.340+0000 7f80feb48640 1 --2- 172.21.15.134:0/3302224028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f80b8180 0x7f80f81dcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.340+0000 7f80feb48640 1 --2- 172.21.15.134:0/3302224028 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f80e406b810 0x7f80e406dcd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.340+0000 7f80feb48640 1 --2- 172.21.15.134:0/3302224028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f8066b20 0x7f80f8145310 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.340+0000 7f80feb48640 1 -- 172.21.15.134:0/3302224028 >> 172.21.15.134:0/3302224028 conn(0x7f80f80b5fe0 msgr2=0x7f80f80b68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:47.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.340+0000 7f80feb48640 1 -- 172.21.15.134:0/3302224028 shutdown_connections 2024-02-17T14:30:47.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.340+0000 7f80feb48640 1 -- 172.21.15.134:0/3302224028 wait complete. 2024-02-17T14:30:47.343 INFO:tasks.ceph.mds.b.smithi142.stderr: -7494> 2024-02-17T14:28:08.042+0000 7f5cfce9b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T14:30:47.351 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-17T14:30:47.374 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-02-17T14:30:47.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.454+0000 7f040644d640 1 Processor -- start 2024-02-17T14:30:47.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.454+0000 7f040644d640 1 -- start start 2024-02-17T14:30:47.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.455+0000 7f040644d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0400072810 0x7f04000b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:47.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.455+0000 7f040644d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f04000b3160 0x7f04001481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:47.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.455+0000 7f040644d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04000b1b40 con 0x7f040013e870 2024-02-17T14:30:47.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.455+0000 7f040644d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04000b0ee0 con 0x7f0400072810 2024-02-17T14:30:47.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.455+0000 7f040644d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04000b20e0 con 0x7f04000b3160 2024-02-17T14:30:47.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.455+0000 7f03fffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0400072810 0x7f04000b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:47.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.455+0000 7f03fffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0400072810 0x7f04000b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59084/0 (socket says 172.21.15.134:59084) 2024-02-17T14:30:47.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.455+0000 7f03fffff640 1 -- 172.21.15.134:0/3254263024 learned_addr learned my addr 172.21.15.134:0/3254263024 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:47.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.455+0000 7f03ff7fe640 1 --2- 172.21.15.134:0/3254263024 >> v2:172.21.15.142:3300/0 conn(0x7f04000b3160 0x7f04001481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:47.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.455+0000 7f03fffff640 1 -- 172.21.15.134:0/3254263024 >> v2:172.21.15.142:3300/0 conn(0x7f04000b3160 msgr2=0x7f04001481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:47.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.455+0000 7f03fffff640 1 --2- 172.21.15.134:0/3254263024 >> v2:172.21.15.142:3300/0 conn(0x7f04000b3160 0x7f04001481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.456+0000 7f03fffff640 1 -- 172.21.15.134:0/3254263024 >> v1:172.21.15.142:6789/0 conn(0x7f040013e870 legacy=0x7f040013eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:47.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.456+0000 7f03fffff640 1 -- 172.21.15.134:0/3254263024 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400072bf0 con 0x7f0400072810 2024-02-17T14:30:47.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.456+0000 7f03fffff640 1 --2- 172.21.15.134:0/3254263024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0400072810 0x7f04000b0750 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f04000b6e00 tx=0x7f03f002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5817bc179c1dc640 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:47.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.456+0000 7f03feffd640 1 -- 172.21.15.134:0/3254263024 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0031640 con 0x7f0400072810 2024-02-17T14:30:47.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.456+0000 7f03feffd640 1 -- 172.21.15.134:0/3254263024 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f03f00317a0 con 0x7f0400072810 2024-02-17T14:30:47.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.456+0000 7f03feffd640 1 -- 172.21.15.134:0/3254263024 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0031b50 con 0x7f0400072810 2024-02-17T14:30:47.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.457+0000 7f040644d640 1 -- 172.21.15.134:0/3254263024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0400072810 msgr2=0x7f04000b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:47.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.457+0000 7f040644d640 1 --2- 172.21.15.134:0/3254263024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0400072810 0x7f04000b0750 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f04000b6e00 tx=0x7f03f002b8f0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.457+0000 7f040644d640 1 -- 172.21.15.134:0/3254263024 shutdown_connections 2024-02-17T14:30:47.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.457+0000 7f040644d640 1 --2- 172.21.15.134:0/3254263024 >> v2:172.21.15.142:3300/0 conn(0x7f04000b3160 0x7f04001481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.457+0000 7f040644d640 1 --2- 172.21.15.134:0/3254263024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0400072810 0x7f04000b0750 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.457+0000 7f040644d640 1 -- 172.21.15.134:0/3254263024 >> 172.21.15.134:0/3254263024 conn(0x7f04000b9350 msgr2=0x7f04000b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:47.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.457+0000 7f040644d640 1 -- 172.21.15.134:0/3254263024 shutdown_connections 2024-02-17T14:30:47.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.457+0000 7f040644d640 1 -- 172.21.15.134:0/3254263024 wait complete. 2024-02-17T14:30:47.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.458+0000 7f040644d640 1 Processor -- start 2024-02-17T14:30:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.458+0000 7f040644d640 1 -- start start 2024-02-17T14:30:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f040644d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0400072810 0x7f0400144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f040644d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04000b3160 0x7f04000718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f040644d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f040013e870 0x7f0400145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f040644d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0400147360 con 0x7f04000b3160 2024-02-17T14:30:47.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f040644d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0400072220 con 0x7f040013e870 2024-02-17T14:30:47.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f040644d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04000b7850 con 0x7f0400072810 2024-02-17T14:30:47.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f03ff7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04000b3160 0x7f04000718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:47.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f03ff7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04000b3160 0x7f04000718c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59094/0 (socket says 172.21.15.134:59094) 2024-02-17T14:30:47.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f03ff7fe640 1 -- 172.21.15.134:0/2675104282 learned_addr learned my addr 172.21.15.134:0/2675104282 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:47.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f04049ea640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f040013e870 0x7f0400145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:47.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f03fffff640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0400072810 0x7f0400144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:47.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f03ff7fe640 1 -- 172.21.15.134:0/2675104282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0400072810 msgr2=0x7f0400144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:47.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f03ff7fe640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0400072810 0x7f0400144320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f03ff7fe640 1 -- 172.21.15.134:0/2675104282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f040013e870 msgr2=0x7f0400145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:47.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f03ff7fe640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f040013e870 0x7f0400145d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:47.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f03ff7fe640 1 -- 172.21.15.134:0/2675104282 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00094d0 con 0x7f04000b3160 2024-02-17T14:30:47.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f03ff7fe640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04000b3160 0x7f04000718c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f03f400d800 tx=0x7f03f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:47.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f03fcff9640 1 -- 172.21.15.134:0/2675104282 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f400b6c0 con 0x7f04000b3160 2024-02-17T14:30:47.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f03fcff9640 1 -- 172.21.15.134:0/2675104282 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f03f400b840 con 0x7f04000b3160 2024-02-17T14:30:47.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f040644d640 1 -- 172.21.15.134:0/2675104282 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04000b29f0 con 0x7f04000b3160 2024-02-17T14:30:47.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.459+0000 7f03fcff9640 1 -- 172.21.15.134:0/2675104282 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f400bc10 con 0x7f04000b3160 2024-02-17T14:30:47.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.460+0000 7f040644d640 1 -- 172.21.15.134:0/2675104282 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04000713a0 con 0x7f04000b3160 2024-02-17T14:30:47.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.461+0000 7f040644d640 1 -- 172.21.15.134:0/2675104282 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04000b3680 con 0x7f04000b3160 2024-02-17T14:30:47.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.461+0000 7f03fcff9640 1 -- 172.21.15.134:0/2675104282 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f03f401e460 con 0x7f04000b3160 2024-02-17T14:30:47.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.461+0000 7f03fcff9640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f03ec06b810 0x7f03ec06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:47.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.462+0000 7f03fffff640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f03ec06b810 0x7f03ec06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:47.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.462+0000 7f03fcff9640 1 -- 172.21.15.134:0/2675104282 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f03f408aac0 con 0x7f04000b3160 2024-02-17T14:30:47.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.462+0000 7f03fffff640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f03ec06b810 0x7f03ec06dcd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f03f0036000 tx=0x7f03f003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:47.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.466+0000 7f03fcff9640 1 -- 172.21.15.134:0/2675104282 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f03f4055130 con 0x7f04000b3160 2024-02-17T14:30:47.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:47.674+0000 7f040644d640 1 -- 172.21.15.134:0/2675104282 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f04000b54e0 con 0x7f04000b3160 2024-02-17T14:30:48.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.338+0000 7f03fcff9640 1 -- 172.21.15.134:0/2675104282 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f03f40587f0 con 0x7f04000b3160 2024-02-17T14:30:48.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.340+0000 7f040644d640 1 -- 172.21.15.134:0/2675104282 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f03ec06b810 msgr2=0x7f03ec06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.340+0000 7f040644d640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f03ec06b810 0x7f03ec06dcd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f03f0036000 tx=0x7f03f003c040 comp rx=0 tx=0).stop 2024-02-17T14:30:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.340+0000 7f040644d640 1 -- 172.21.15.134:0/2675104282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04000b3160 msgr2=0x7f04000718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.340+0000 7f040644d640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04000b3160 0x7f04000718c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f03f400d800 tx=0x7f03f400dcc0 comp rx=0 tx=0).stop 2024-02-17T14:30:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.340+0000 7f040644d640 1 -- 172.21.15.134:0/2675104282 shutdown_connections 2024-02-17T14:30:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.340+0000 7f040644d640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f040013e870 0x7f0400145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.340+0000 7f040644d640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f03ec06b810 0x7f03ec06dcd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.340+0000 7f040644d640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04000b3160 0x7f04000718c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.340+0000 7f040644d640 1 --2- 172.21.15.134:0/2675104282 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0400072810 0x7f0400144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.340+0000 7f040644d640 1 -- 172.21.15.134:0/2675104282 >> 172.21.15.134:0/2675104282 conn(0x7f04000b9350 msgr2=0x7f04000b6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:48.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.340+0000 7f040644d640 1 -- 172.21.15.134:0/2675104282 shutdown_connections 2024-02-17T14:30:48.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.340+0000 7f040644d640 1 -- 172.21.15.134:0/2675104282 wait complete. 2024-02-17T14:30:48.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-17T14:30:48.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.456+0000 7fd30f38c640 1 Processor -- start 2024-02-17T14:30:48.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.456+0000 7fd30f38c640 1 -- start start 2024-02-17T14:30:48.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.457+0000 7fd30f38c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3080b59f0 0x7fd308148210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:48.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.457+0000 7fd30f38c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd30806ec40 0x7fd3080b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:48.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.457+0000 7fd30f38c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3080b4db0 con 0x7fd3080b5240 2024-02-17T14:30:48.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.457+0000 7fd30f38c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3080b5dd0 con 0x7fd30806ec40 2024-02-17T14:30:48.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.457+0000 7fd30f38c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30806e630 con 0x7fd3080b59f0 2024-02-17T14:30:48.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.457+0000 7fd30c927640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd30806ec40 0x7fd3080b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:48.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.457+0000 7fd30c927640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd30806ec40 0x7fd3080b0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59096/0 (socket says 172.21.15.134:59096) 2024-02-17T14:30:48.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.457+0000 7fd30c927640 1 -- 172.21.15.134:0/3171758336 learned_addr learned my addr 172.21.15.134:0/3171758336 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:48.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.457+0000 7fd30d128640 1 --2- 172.21.15.134:0/3171758336 >> v2:172.21.15.142:3300/0 conn(0x7fd3080b59f0 0x7fd308148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:48.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.457+0000 7fd30c927640 1 -- 172.21.15.134:0/3171758336 >> v2:172.21.15.142:3300/0 conn(0x7fd3080b59f0 msgr2=0x7fd308148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:48.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.457+0000 7fd30c927640 1 --2- 172.21.15.134:0/3171758336 >> v2:172.21.15.142:3300/0 conn(0x7fd3080b59f0 0x7fd308148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:48.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.457+0000 7fd30c927640 1 -- 172.21.15.134:0/3171758336 >> v1:172.21.15.142:6789/0 conn(0x7fd3080b5240 legacy=0x7fd308071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:48.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.457+0000 7fd30c927640 1 -- 172.21.15.134:0/3171758336 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30806e910 con 0x7fd30806ec40 2024-02-17T14:30:48.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.458+0000 7fd30c927640 1 --2- 172.21.15.134:0/3171758336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30806ec40 0x7fd3080b0ea0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd3080b7ec0 tx=0x7fd2f802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd879ecf2f835c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:48.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.458+0000 7fd2fffff640 1 -- 172.21.15.134:0/3171758336 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f80317e0 con 0x7fd30806ec40 2024-02-17T14:30:48.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.458+0000 7fd2fffff640 1 -- 172.21.15.134:0/3171758336 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd2f8031940 con 0x7fd30806ec40 2024-02-17T14:30:48.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.458+0000 7fd2fffff640 1 -- 172.21.15.134:0/3171758336 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8031cf0 con 0x7fd30806ec40 2024-02-17T14:30:48.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.458+0000 7fd30f38c640 1 -- 172.21.15.134:0/3171758336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30806ec40 msgr2=0x7fd3080b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:48.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.458+0000 7fd30f38c640 1 --2- 172.21.15.134:0/3171758336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30806ec40 0x7fd3080b0ea0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd3080b7ec0 tx=0x7fd2f802b880 comp rx=0 tx=0).stop 2024-02-17T14:30:48.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.459+0000 7fd30f38c640 1 -- 172.21.15.134:0/3171758336 shutdown_connections 2024-02-17T14:30:48.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.459+0000 7fd30f38c640 1 --2- 172.21.15.134:0/3171758336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30806ec40 0x7fd3080b0ea0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:48.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.459+0000 7fd30f38c640 1 --2- 172.21.15.134:0/3171758336 >> v2:172.21.15.142:3300/0 conn(0x7fd3080b59f0 0x7fd308148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:48.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.459+0000 7fd30f38c640 1 -- 172.21.15.134:0/3171758336 >> 172.21.15.134:0/3171758336 conn(0x7fd3080ba3a0 msgr2=0x7fd3080ba7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:48.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.459+0000 7fd30f38c640 1 -- 172.21.15.134:0/3171758336 shutdown_connections 2024-02-17T14:30:48.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.459+0000 7fd30f38c640 1 -- 172.21.15.134:0/3171758336 wait complete. 2024-02-17T14:30:48.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30f38c640 1 Processor -- start 2024-02-17T14:30:48.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30f38c640 1 -- start start 2024-02-17T14:30:48.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30f38c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30806ec40 0x7fd308143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:48.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30f38c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3080b5240 0x7fd3080b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:48.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30f38c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3080b59f0 0x7fd3081dd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:48.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30f38c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd308145c70 con 0x7fd30806ec40 2024-02-17T14:30:48.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30f38c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd308144190 con 0x7fd3080b59f0 2024-02-17T14:30:48.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30f38c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd308145a00 con 0x7fd3080b5240 2024-02-17T14:30:48.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30d128640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30806ec40 0x7fd308143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:48.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30d128640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30806ec40 0x7fd308143c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59102/0 (socket says 172.21.15.134:59102) 2024-02-17T14:30:48.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30d128640 1 -- 172.21.15.134:0/758533914 learned_addr learned my addr 172.21.15.134:0/758533914 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:48.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30d128640 1 -- 172.21.15.134:0/758533914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3080b5240 msgr2=0x7fd3080b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:48.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30d128640 1 --2- 172.21.15.134:0/758533914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3080b5240 0x7fd3080b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:48.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30d128640 1 -- 172.21.15.134:0/758533914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3080b59f0 msgr2=0x7fd3081dd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:48.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30d128640 1 --2- 172.21.15.134:0/758533914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3080b59f0 0x7fd3081dd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:48.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.460+0000 7fd30d128640 1 -- 172.21.15.134:0/758533914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f80094d0 con 0x7fd30806ec40 2024-02-17T14:30:48.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.461+0000 7fd30d128640 1 --2- 172.21.15.134:0/758533914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30806ec40 0x7fd308143c50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd30400e9e0 tx=0x7fd30400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:48.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.461+0000 7fd2fdffb640 1 -- 172.21.15.134:0/758533914 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd304009670 con 0x7fd30806ec40 2024-02-17T14:30:48.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.461+0000 7fd2fdffb640 1 -- 172.21.15.134:0/758533914 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd30400c9d0 con 0x7fd30806ec40 2024-02-17T14:30:48.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.461+0000 7fd2fdffb640 1 -- 172.21.15.134:0/758533914 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30400cda0 con 0x7fd30806ec40 2024-02-17T14:30:48.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.461+0000 7fd30f38c640 1 -- 172.21.15.134:0/758533914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd308145280 con 0x7fd30806ec40 2024-02-17T14:30:48.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.461+0000 7fd30f38c640 1 -- 172.21.15.134:0/758533914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3080b44f0 con 0x7fd30806ec40 2024-02-17T14:30:48.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.462+0000 7fd30f38c640 1 -- 172.21.15.134:0/758533914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd308148bf0 con 0x7fd30806ec40 2024-02-17T14:30:48.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.462+0000 7fd2fdffb640 1 -- 172.21.15.134:0/758533914 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fd304013470 con 0x7fd30806ec40 2024-02-17T14:30:48.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.463+0000 7fd2fdffb640 1 --2- 172.21.15.134:0/758533914 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd2ec06b840 0x7fd2ec06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:48.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.463+0000 7fd30c927640 1 --2- 172.21.15.134:0/758533914 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd2ec06b840 0x7fd2ec06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:48.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.463+0000 7fd2fdffb640 1 -- 172.21.15.134:0/758533914 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6821+0+0 (secure 0 0 0) 0x7fd30408a850 con 0x7fd30806ec40 2024-02-17T14:30:48.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.463+0000 7fd30c927640 1 --2- 172.21.15.134:0/758533914 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd2ec06b840 0x7fd2ec06dd00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8036000 tx=0x7fd2f8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:48.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.467+0000 7fd2fdffb640 1 -- 172.21.15.134:0/758533914 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd304054e10 con 0x7fd30806ec40 2024-02-17T14:30:48.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:48.638+0000 7fd30f38c640 1 -- 172.21.15.134:0/758533914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd308067b70 con 0x7fd30806ec40 2024-02-17T14:30:49.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.343+0000 7fd2fdffb640 1 -- 172.21.15.134:0/758533914 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd3040584d0 con 0x7fd30806ec40 2024-02-17T14:30:49.343 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_metadata' removed 2024-02-17T14:30:49.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.347+0000 7fd30f38c640 1 -- 172.21.15.134:0/758533914 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd2ec06b840 msgr2=0x7fd2ec06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:49.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.347+0000 7fd30f38c640 1 --2- 172.21.15.134:0/758533914 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd2ec06b840 0x7fd2ec06dd00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8036000 tx=0x7fd2f8030000 comp rx=0 tx=0).stop 2024-02-17T14:30:49.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.347+0000 7fd30f38c640 1 -- 172.21.15.134:0/758533914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30806ec40 msgr2=0x7fd308143c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:49.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.347+0000 7fd30f38c640 1 --2- 172.21.15.134:0/758533914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30806ec40 0x7fd308143c50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd30400e9e0 tx=0x7fd30400eea0 comp rx=0 tx=0).stop 2024-02-17T14:30:49.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.348+0000 7fd30f38c640 1 -- 172.21.15.134:0/758533914 shutdown_connections 2024-02-17T14:30:49.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.348+0000 7fd30f38c640 1 --2- 172.21.15.134:0/758533914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3080b59f0 0x7fd3081dd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:49.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.348+0000 7fd30f38c640 1 --2- 172.21.15.134:0/758533914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3080b5240 0x7fd3080b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:49.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.348+0000 7fd30f38c640 1 --2- 172.21.15.134:0/758533914 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fd2ec06b840 0x7fd2ec06dd00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:49.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.348+0000 7fd30f38c640 1 --2- 172.21.15.134:0/758533914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd30806ec40 0x7fd308143c50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:49.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.348+0000 7fd30f38c640 1 -- 172.21.15.134:0/758533914 >> 172.21.15.134:0/758533914 conn(0x7fd3080ba3a0 msgr2=0x7fd3080b8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:49.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.348+0000 7fd30f38c640 1 -- 172.21.15.134:0/758533914 shutdown_connections 2024-02-17T14:30:49.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.348+0000 7fd30f38c640 1 -- 172.21.15.134:0/758533914 wait complete. 2024-02-17T14:30:49.361 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-17T14:30:49.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.468+0000 7fa8b1e81640 1 Processor -- start 2024-02-17T14:30:49.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.468+0000 7fa8b1e81640 1 -- start start 2024-02-17T14:30:49.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.468+0000 7fa8b1e81640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8ac06e4c0 0x7fa8ac06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:49.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.468+0000 7fa8b1e81640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa8ac0b6860 0x7fa8ac0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:49.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.468+0000 7fa8b1e81640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8ac0b5260 0x7fa8ac14a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:49.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.468+0000 7fa8b1e81640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac06e8a0 con 0x7fa8ac0b6860 2024-02-17T14:30:49.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.468+0000 7fa8b1e81640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac06c800 con 0x7fa8ac0b5260 2024-02-17T14:30:49.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.468+0000 7fa8b1e81640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac06cae0 con 0x7fa8ac06e4c0 2024-02-17T14:30:49.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.469+0000 7fa8aaffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa8ac0b6860 0x7fa8ac0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:49.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.469+0000 7fa8aaffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa8ac0b6860 0x7fa8ac0b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59116/0 (socket says 172.21.15.134:59116) 2024-02-17T14:30:49.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.469+0000 7fa8aaffd640 1 -- 172.21.15.134:0/3470050070 learned_addr learned my addr 172.21.15.134:0/3470050070 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:49.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.469+0000 7fa8aaffd640 1 -- 172.21.15.134:0/3470050070 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8ac06e4c0 msgr2=0x7fa8ac06ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:49.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.469+0000 7fa8aaffd640 1 --2- 172.21.15.134:0/3470050070 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8ac06e4c0 0x7fa8ac06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:49.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.469+0000 7fa8aaffd640 1 -- 172.21.15.134:0/3470050070 >> v2:172.21.15.142:3300/0 conn(0x7fa8ac0b5260 msgr2=0x7fa8ac14a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:49.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.469+0000 7fa8aaffd640 1 --2- 172.21.15.134:0/3470050070 >> v2:172.21.15.142:3300/0 conn(0x7fa8ac0b5260 0x7fa8ac14a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:49.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.469+0000 7fa8aaffd640 1 -- 172.21.15.134:0/3470050070 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac06cdc0 con 0x7fa8ac0b6860 2024-02-17T14:30:49.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.469+0000 7fa8aaffd640 1 --2- 172.21.15.134:0/3470050070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8ac0b6860 0x7fa8ac0b4d20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0730a0 tx=0x7fa8a002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c05f744478046b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:49.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.470+0000 7fa8aa7fc640 1 -- 172.21.15.134:0/3470050070 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00317e0 con 0x7fa8ac0b6860 2024-02-17T14:30:49.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.470+0000 7fa8aa7fc640 1 -- 172.21.15.134:0/3470050070 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa8a0031940 con 0x7fa8ac0b6860 2024-02-17T14:30:49.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.470+0000 7fa8aa7fc640 1 -- 172.21.15.134:0/3470050070 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0031cf0 con 0x7fa8ac0b6860 2024-02-17T14:30:49.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.470+0000 7fa8b1e81640 1 -- 172.21.15.134:0/3470050070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8ac0b6860 msgr2=0x7fa8ac0b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:49.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.470+0000 7fa8b1e81640 1 --2- 172.21.15.134:0/3470050070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8ac0b6860 0x7fa8ac0b4d20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0730a0 tx=0x7fa8a002b880 comp rx=0 tx=0).stop 2024-02-17T14:30:49.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.470+0000 7fa8b1e81640 1 -- 172.21.15.134:0/3470050070 shutdown_connections 2024-02-17T14:30:49.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.470+0000 7fa8b1e81640 1 --2- 172.21.15.134:0/3470050070 >> v2:172.21.15.142:3300/0 conn(0x7fa8ac0b5260 0x7fa8ac14a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:49.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.470+0000 7fa8b1e81640 1 --2- 172.21.15.134:0/3470050070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8ac0b6860 0x7fa8ac0b4d20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:49.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.470+0000 7fa8b1e81640 1 --2- 172.21.15.134:0/3470050070 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8ac06e4c0 0x7fa8ac06ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:49.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.470+0000 7fa8b1e81640 1 -- 172.21.15.134:0/3470050070 >> 172.21.15.134:0/3470050070 conn(0x7fa8ac0ba3a0 msgr2=0x7fa8ac0ba7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:49.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.470+0000 7fa8b1e81640 1 -- 172.21.15.134:0/3470050070 shutdown_connections 2024-02-17T14:30:49.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.470+0000 7fa8b1e81640 1 -- 172.21.15.134:0/3470050070 wait complete. 2024-02-17T14:30:49.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.471+0000 7fa8b1e81640 1 Processor -- start 2024-02-17T14:30:49.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.471+0000 7fa8b1e81640 1 -- start start 2024-02-17T14:30:49.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8b1e81640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8ac06e4c0 0x7fa8ac09be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:49.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8b1e81640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8ac0b5260 0x7fa8ac1df470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:49.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8b1e81640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ac0b6860 0x7fa8ac1df9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:49.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8b1e81640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0b90b0 con 0x7fa8ac06e4c0 2024-02-17T14:30:49.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8b1e81640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0b8dd0 con 0x7fa8ac0b6860 2024-02-17T14:30:49.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8b1e81640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0b1560 con 0x7fa8ac0b5260 2024-02-17T14:30:49.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8ab7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8ac06e4c0 0x7fa8ac09be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:49.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8ab7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8ac06e4c0 0x7fa8ac09be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59126/0 (socket says 172.21.15.134:59126) 2024-02-17T14:30:49.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8ab7fe640 1 -- 172.21.15.134:0/4098325747 learned_addr learned my addr 172.21.15.134:0/4098325747 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:49.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8aaffd640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8ac0b5260 0x7fa8ac1df470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:49.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8abfff640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ac0b6860 0x7fa8ac1df9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:49.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8ab7fe640 1 -- 172.21.15.134:0/4098325747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8ac0b5260 msgr2=0x7fa8ac1df470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:49.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8ab7fe640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8ac0b5260 0x7fa8ac1df470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:49.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8ab7fe640 1 -- 172.21.15.134:0/4098325747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ac0b6860 msgr2=0x7fa8ac1df9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:49.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8ab7fe640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ac0b6860 0x7fa8ac1df9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:49.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.472+0000 7fa8ab7fe640 1 -- 172.21.15.134:0/4098325747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00094d0 con 0x7fa8ac06e4c0 2024-02-17T14:30:49.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.473+0000 7fa8ab7fe640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8ac06e4c0 0x7fa8ac09be70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00b4a0 tx=0x7fa89c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:49.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.473+0000 7fa893fff640 1 -- 172.21.15.134:0/4098325747 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c010610 con 0x7fa8ac06e4c0 2024-02-17T14:30:49.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.473+0000 7fa893fff640 1 -- 172.21.15.134:0/4098325747 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa89c010770 con 0x7fa8ac06e4c0 2024-02-17T14:30:49.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.473+0000 7fa8b1e81640 1 -- 172.21.15.134:0/4098325747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac0b1840 con 0x7fa8ac06e4c0 2024-02-17T14:30:49.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.473+0000 7fa893fff640 1 -- 172.21.15.134:0/4098325747 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c010b40 con 0x7fa8ac06e4c0 2024-02-17T14:30:49.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.473+0000 7fa8b1e81640 1 -- 172.21.15.134:0/4098325747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac0b8a00 con 0x7fa8ac06e4c0 2024-02-17T14:30:49.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.474+0000 7fa8b1e81640 1 -- 172.21.15.134:0/4098325747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac0b1a30 con 0x7fa8ac06e4c0 2024-02-17T14:30:49.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.474+0000 7fa893fff640 1 -- 172.21.15.134:0/4098325747 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7fa89c010ca0 con 0x7fa8ac06e4c0 2024-02-17T14:30:49.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.474+0000 7fa893fff640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa89806b810 0x7fa89806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:49.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.474+0000 7fa893fff640 1 -- 172.21.15.134:0/4098325747 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6383+0+0 (secure 0 0 0) 0x7fa89c08a0b0 con 0x7fa8ac06e4c0 2024-02-17T14:30:49.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.474+0000 7fa8aaffd640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa89806b810 0x7fa89806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:49.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.475+0000 7fa8aaffd640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa89806b810 0x7fa89806dcd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0036000 tx=0x7fa8a003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:49.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.479+0000 7fa893fff640 1 -- 172.21.15.134:0/4098325747 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa89c054830 con 0x7fa8ac06e4c0 2024-02-17T14:30:49.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:49.652+0000 7fa8b1e81640 1 -- 172.21.15.134:0/4098325747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa8ac067b70 con 0x7fa8ac06e4c0 2024-02-17T14:30:50.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.344+0000 7fa893fff640 1 -- 172.21.15.134:0/4098325747 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa89c0140d0 con 0x7fa8ac06e4c0 2024-02-17T14:30:50.345 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data' removed 2024-02-17T14:30:50.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.348+0000 7fa8b1e81640 1 -- 172.21.15.134:0/4098325747 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa89806b810 msgr2=0x7fa89806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:50.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.348+0000 7fa8b1e81640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa89806b810 0x7fa89806dcd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0036000 tx=0x7fa8a003d040 comp rx=0 tx=0).stop 2024-02-17T14:30:50.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.348+0000 7fa8b1e81640 1 -- 172.21.15.134:0/4098325747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8ac06e4c0 msgr2=0x7fa8ac09be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:50.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.348+0000 7fa8b1e81640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8ac06e4c0 0x7fa8ac09be70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00b4a0 tx=0x7fa89c00b960 comp rx=0 tx=0).stop 2024-02-17T14:30:50.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.348+0000 7fa8b1e81640 1 -- 172.21.15.134:0/4098325747 shutdown_connections 2024-02-17T14:30:50.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.348+0000 7fa8b1e81640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8ac0b6860 0x7fa8ac1df9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:50.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.348+0000 7fa8b1e81640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8ac0b5260 0x7fa8ac1df470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:50.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.348+0000 7fa8b1e81640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7fa89806b810 0x7fa89806dcd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:50.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.348+0000 7fa8b1e81640 1 --2- 172.21.15.134:0/4098325747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8ac06e4c0 0x7fa8ac09be70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:50.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.348+0000 7fa8b1e81640 1 -- 172.21.15.134:0/4098325747 >> 172.21.15.134:0/4098325747 conn(0x7fa8ac0ba3a0 msgr2=0x7fa8ac071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:50.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.348+0000 7fa8b1e81640 1 -- 172.21.15.134:0/4098325747 shutdown_connections 2024-02-17T14:30:50.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.348+0000 7fa8b1e81640 1 -- 172.21.15.134:0/4098325747 wait complete. 2024-02-17T14:30:50.363 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-02-17T14:30:50.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.468+0000 7f45362c0640 1 Processor -- start 2024-02-17T14:30:50.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.468+0000 7f45362c0640 1 -- start start 2024-02-17T14:30:50.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.468+0000 7f45362c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4530072dc0 0x7f453013eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:50.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.468+0000 7f45362c0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f453013f000 0x7f453014f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:50.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.468+0000 7f45362c0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453009d010 con 0x7f453006e570 2024-02-17T14:30:50.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.468+0000 7f45362c0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45300b57a0 con 0x7f453013f000 2024-02-17T14:30:50.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.468+0000 7f45362c0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453006f220 con 0x7f4530072dc0 2024-02-17T14:30:50.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.468+0000 7f452ffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f453006e570 0x7f45300b5e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:36584/0 (socket says 172.21.15.134:36584) 2024-02-17T14:30:50.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.468+0000 7f452ffff640 1 -- 172.21.15.134:0/1768846635 learned_addr learned my addr 172.21.15.134:0/1768846635 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-02-17T14:30:50.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.469+0000 7f452f7fe640 1 --2- 172.21.15.134:0/1768846635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4530072dc0 0x7f453013eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:50.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.469+0000 7f453485d640 1 --2- 172.21.15.134:0/1768846635 >> v2:172.21.15.142:3300/0 conn(0x7f453013f000 0x7f453014f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:50.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.469+0000 7f452effd640 1 -- 172.21.15.134:0/1768846635 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556323726 0 0) 0x7f453009d010 con 0x7f453006e570 2024-02-17T14:30:50.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.469+0000 7f452effd640 1 -- 172.21.15.134:0/1768846635 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4518003520 con 0x7f453006e570 2024-02-17T14:30:50.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.469+0000 7f453485d640 1 -- 172.21.15.134:0/1768846635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4530072dc0 msgr2=0x7f453013eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T14:30:50.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.469+0000 7f453485d640 1 --2- 172.21.15.134:0/1768846635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4530072dc0 0x7f453013eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:50.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.469+0000 7f453485d640 1 -- 172.21.15.134:0/1768846635 >> v1:172.21.15.134:6789/0 conn(0x7f453006e570 legacy=0x7f45300b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:50.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.469+0000 7f453485d640 1 -- 172.21.15.134:0/1768846635 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453006e950 con 0x7f453013f000 2024-02-17T14:30:50.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.469+0000 7f452f7fe640 1 --2- 172.21.15.134:0/1768846635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4530072dc0 0x7f453013eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T14:30:50.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.470+0000 7f453485d640 1 --2- 172.21.15.134:0/1768846635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f453013f000 0x7f453014f520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4528009d90 tx=0x7f452802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=758506c58aecc661 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:50.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.470+0000 7f452effd640 1 -- 172.21.15.134:0/1768846635 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452802cbc0 con 0x7f453013f000 2024-02-17T14:30:50.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.470+0000 7f452effd640 1 -- 172.21.15.134:0/1768846635 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f452802cd20 con 0x7f453013f000 2024-02-17T14:30:50.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.470+0000 7f452effd640 1 -- 172.21.15.134:0/1768846635 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528034640 con 0x7f453013f000 2024-02-17T14:30:50.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.470+0000 7f45362c0640 1 -- 172.21.15.134:0/1768846635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f453013f000 msgr2=0x7f453014f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:50.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.470+0000 7f45362c0640 1 --2- 172.21.15.134:0/1768846635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f453013f000 0x7f453014f520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4528009d90 tx=0x7f452802be10 comp rx=0 tx=0).stop 2024-02-17T14:30:50.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.470+0000 7f45362c0640 1 -- 172.21.15.134:0/1768846635 shutdown_connections 2024-02-17T14:30:50.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.470+0000 7f45362c0640 1 --2- 172.21.15.134:0/1768846635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f453013f000 0x7f453014f520 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:50.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.470+0000 7f45362c0640 1 --2- 172.21.15.134:0/1768846635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4530072dc0 0x7f453013eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:50.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.470+0000 7f45362c0640 1 -- 172.21.15.134:0/1768846635 >> 172.21.15.134:0/1768846635 conn(0x7f4530099a30 msgr2=0x7f453009c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:50.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.470+0000 7f45362c0640 1 -- 172.21.15.134:0/1768846635 shutdown_connections 2024-02-17T14:30:50.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.470+0000 7f45362c0640 1 -- 172.21.15.134:0/1768846635 wait complete. 2024-02-17T14:30:50.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.471+0000 7f45362c0640 1 Processor -- start 2024-02-17T14:30:50.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f45362c0640 1 -- start start 2024-02-17T14:30:50.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f45362c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f453006e570 0x7f45300b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:50.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f45362c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4530072dc0 0x7f453006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:50.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f45362c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453013f000 0x7f45301dbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:50.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f45362c0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453006be50 con 0x7f453013f000 2024-02-17T14:30:50.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f45362c0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453006c130 con 0x7f453006e570 2024-02-17T14:30:50.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f45362c0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453006c410 con 0x7f4530072dc0 2024-02-17T14:30:50.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f453485d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453013f000 0x7f45301dbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:50.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f453485d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453013f000 0x7f45301dbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59132/0 (socket says 172.21.15.134:59132) 2024-02-17T14:30:50.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f453485d640 1 -- 172.21.15.134:0/614093076 learned_addr learned my addr 172.21.15.134:0/614093076 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-02-17T14:30:50.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f452f7fe640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4530072dc0 0x7f453006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:50.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f452ffff640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f453006e570 0x7f45300b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:50.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f453485d640 1 -- 172.21.15.134:0/614093076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4530072dc0 msgr2=0x7f453006d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:50.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f453485d640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4530072dc0 0x7f453006d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:50.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f453485d640 1 -- 172.21.15.134:0/614093076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f453006e570 msgr2=0x7f45300b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:50.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f453485d640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f453006e570 0x7f45300b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:50.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f453485d640 1 -- 172.21.15.134:0/614093076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4524009400 con 0x7f453013f000 2024-02-17T14:30:50.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f452f7fe640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4530072dc0 0x7f453006d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:30:50.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.472+0000 7f452ffff640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f453006e570 0x7f45300b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T14:30:50.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.473+0000 7f453485d640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453013f000 0x7f45301dbdc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4528037040 tx=0x7f4528004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:50.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.473+0000 7f452cff9640 1 -- 172.21.15.134:0/614093076 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528040650 con 0x7f453013f000 2024-02-17T14:30:50.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.473+0000 7f452cff9640 1 -- 172.21.15.134:0/614093076 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f452802ce90 con 0x7f453013f000 2024-02-17T14:30:50.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.473+0000 7f45362c0640 1 -- 172.21.15.134:0/614093076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4528009a70 con 0x7f453013f000 2024-02-17T14:30:50.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.473+0000 7f452cff9640 1 -- 172.21.15.134:0/614093076 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528040a10 con 0x7f453013f000 2024-02-17T14:30:50.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.473+0000 7f45362c0640 1 -- 172.21.15.134:0/614093076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453006f880 con 0x7f453013f000 2024-02-17T14:30:50.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.474+0000 7f45362c0640 1 -- 172.21.15.134:0/614093076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45300b8fb0 con 0x7f453013f000 2024-02-17T14:30:50.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.474+0000 7f452cff9640 1 -- 172.21.15.134:0/614093076 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 89788+0+0 (secure 0 0 0) 0x7f4528040b70 con 0x7f453013f000 2024-02-17T14:30:50.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.474+0000 7f452cff9640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f451c06b870 0x7f451c06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T14:30:50.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.475+0000 7f452cff9640 1 -- 172.21.15.134:0/614093076 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f45280acf60 con 0x7f453013f000 2024-02-17T14:30:50.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.475+0000 7f452ffff640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f451c06b870 0x7f451c06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T14:30:50.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.475+0000 7f452ffff640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f451c06b870 0x7f451c06dd30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4520005880 tx=0x7f4520009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T14:30:50.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.479+0000 7f452cff9640 1 -- 172.21.15.134:0/614093076 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f45280778f0 con 0x7f453013f000 2024-02-17T14:30:50.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:50.651+0000 7f45362c0640 1 -- 172.21.15.134:0/614093076 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f453006bcb0 con 0x7f453013f000 2024-02-17T14:30:51.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:51.355+0000 7f452cff9640 1 -- 172.21.15.134:0/614093076 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f453006bcb0 con 0x7f453013f000 2024-02-17T14:30:51.356 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cephfs_data_ec' removed 2024-02-17T14:30:51.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:51.359+0000 7f45362c0640 1 -- 172.21.15.134:0/614093076 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f451c06b870 msgr2=0x7f451c06dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:51.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:51.359+0000 7f45362c0640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f451c06b870 0x7f451c06dd30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4520005880 tx=0x7f4520009040 comp rx=0 tx=0).stop 2024-02-17T14:30:51.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:51.359+0000 7f45362c0640 1 -- 172.21.15.134:0/614093076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453013f000 msgr2=0x7f45301dbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T14:30:51.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:51.359+0000 7f45362c0640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453013f000 0x7f45301dbdc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4528037040 tx=0x7f4528004a40 comp rx=0 tx=0).stop 2024-02-17T14:30:51.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:51.360+0000 7f45362c0640 1 -- 172.21.15.134:0/614093076 shutdown_connections 2024-02-17T14:30:51.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:51.360+0000 7f45362c0640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.134:6832/653762796,v1:172.21.15.134:6833/653762796] conn(0x7f451c06b870 0x7f451c06dd30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:51.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:51.360+0000 7f45362c0640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453013f000 0x7f45301dbdc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:51.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:51.360+0000 7f45362c0640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4530072dc0 0x7f453006d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:51.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:51.360+0000 7f45362c0640 1 --2- 172.21.15.134:0/614093076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f453006e570 0x7f45300b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T14:30:51.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:51.360+0000 7f45362c0640 1 -- 172.21.15.134:0/614093076 >> 172.21.15.134:0/614093076 conn(0x7f4530099a30 msgr2=0x7f4530073a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T14:30:51.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:51.361+0000 7f45362c0640 1 -- 172.21.15.134:0/614093076 shutdown_connections 2024-02-17T14:30:51.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-02-17T14:30:51.362+0000 7f45362c0640 1 -- 172.21.15.134:0/614093076 wait complete. 2024-02-17T14:30:51.378 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-17T14:30:51.378 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-17T14:30:51.378 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:51.388 INFO:tasks.ceph.mds.a:Stopped 2024-02-17T14:30:51.388 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-17T14:30:51.388 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:51.398 INFO:tasks.ceph.mds.b:Stopped 2024-02-17T14:30:51.399 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-17T14:30:51.399 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-17T14:30:51.399 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:51.457 INFO:tasks.ceph.osd.0:Stopped 2024-02-17T14:30:51.457 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-17T14:30:51.458 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:51.523 INFO:tasks.ceph.osd.1:Stopped 2024-02-17T14:30:51.523 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-17T14:30:51.523 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:51.593 INFO:tasks.ceph.osd.2:Stopped 2024-02-17T14:30:51.594 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-17T14:30:51.594 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:51.667 INFO:tasks.ceph.osd.3:Stopped 2024-02-17T14:30:51.667 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-02-17T14:30:51.667 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:51.704 INFO:tasks.ceph.osd.4:Stopped 2024-02-17T14:30:51.705 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-02-17T14:30:51.705 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:51.781 INFO:tasks.ceph.osd.5:Stopped 2024-02-17T14:30:51.781 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-02-17T14:30:51.782 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:51.850 INFO:tasks.ceph.osd.6:Stopped 2024-02-17T14:30:51.851 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-02-17T14:30:51.851 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:51.931 INFO:tasks.ceph.osd.7:Stopped 2024-02-17T14:30:51.931 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-17T14:30:51.931 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-17T14:30:51.931 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:51.959 INFO:tasks.ceph.mgr.y:Stopped 2024-02-17T14:30:51.959 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-17T14:30:51.959 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:52.000 INFO:tasks.ceph.mgr.x:Stopped 2024-02-17T14:30:52.000 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-17T14:30:52.001 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-17T14:30:52.001 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:52.012 INFO:tasks.ceph.mon.a:Stopped 2024-02-17T14:30:52.012 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-17T14:30:52.012 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:52.053 INFO:tasks.ceph.mon.b:Stopped 2024-02-17T14:30:52.053 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-17T14:30:52.053 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T14:30:52.105 INFO:tasks.ceph.mon.c:Stopped 2024-02-17T14:30:52.106 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-17T14:30:52.106 DEBUG:teuthology.orchestra.run.smithi134:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-17T14:30:52.137 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi134.front.sepia.ceph.com 2024-02-17T14:30:52.137 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-17T14:30:52.398 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi134.front.sepia.ceph.com 2024-02-17T14:30:52.398 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-17T14:30:52.462 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi134.front.sepia.ceph.com 2024-02-17T14:30:52.463 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-17T14:30:52.521 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi134.front.sepia.ceph.com 2024-02-17T14:30:52.522 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-17T14:30:52.587 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-17T14:30:52.587 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-02-17T14:30:52.838 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-17T14:30:52.838 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-02-17T14:30:52.928 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-17T14:30:52.928 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-02-17T14:30:52.992 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-17T14:30:52.993 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-02-17T14:30:53.052 INFO:tasks.ceph:Archiving mon data... 2024-02-17T14:30:53.053 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318/data/mon.a.tgz 2024-02-17T14:30:53.053 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-02-17T14:30:53.069 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.0zg9bpIPQ3 2024-02-17T14:30:53.070 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0zg9bpIPQ3 2024-02-17T14:30:53.193 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.0zg9bpIPQ3 2024-02-17T14:30:53.277 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.0zg9bpIPQ3 is 276KB 2024-02-17T14:30:53.343 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.0zg9bpIPQ3 2024-02-17T14:30:53.357 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318/data/mon.b.tgz 2024-02-17T14:30:53.358 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-02-17T14:30:53.375 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.erdJoPP2Wj 2024-02-17T14:30:53.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.erdJoPP2Wj 2024-02-17T14:30:53.527 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.erdJoPP2Wj 2024-02-17T14:30:53.612 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.erdJoPP2Wj is 374KB 2024-02-17T14:30:53.708 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.erdJoPP2Wj 2024-02-17T14:30:53.722 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318/data/mon.c.tgz 2024-02-17T14:30:53.722 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-02-17T14:30:53.776 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.r0SruzWmQ4 2024-02-17T14:30:53.777 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.r0SruzWmQ4 2024-02-17T14:30:53.912 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.r0SruzWmQ4 2024-02-17T14:30:53.997 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.r0SruzWmQ4 is 374KB 2024-02-17T14:30:54.093 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.r0SruzWmQ4 2024-02-17T14:30:54.107 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-17T14:30:54.107 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-17T14:30:54.110 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-17T14:30:54.192 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-17T14:30:54.229 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-17T14:30:54.230 INFO:tasks.ceph:Archiving crash dumps... 2024-02-17T14:30:54.231 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318/remote/smithi134/crash 2024-02-17T14:30:54.232 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-17T14:30:54.260 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318/remote/smithi142/crash 2024-02-17T14:30:54.260 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-17T14:30:54.296 INFO:tasks.ceph:Shutting down logrotate 2024-02-17T14:30:54.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:30:54.304 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T14:30:54.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-17T14:30:54.415 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-17T14:30:54.441 INFO:tasks.ceph:Compressing logs... 2024-02-17T14:30:54.442 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-17T14:30:54.457 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-17T14:30:54.481 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47750.log 2024-02-17T14:30:54.481 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42366.log 2024-02-17T14:30:54.532 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-02-17T14:30:54.532 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37633.log 2024-02-17T14:30:54.532 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-17T14:30:54.532 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37633.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-02-17T14:30:54.532 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.audit.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37633.log.gz 2024-02-17T14:30:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-02-17T14:30:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-02-17T14:30:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-02-17T14:30:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37473.log 2024-02-17T14:30:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.5.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-17T14:30:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37753.log 2024-02-17T14:30:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37473.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-17T14:30:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37753.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37473.log.gz 2024-02-17T14:30:54.534 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37713.log 2024-02-17T14:30:54.534 INFO:teuthology.orchestra.run.smithi142.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37753.log.gz 2024-02-17T14:30:54.534 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-17T14:30:54.534 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37713.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-02-17T14:30:54.534 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37713.log.gz 2024-02-17T14:30:54.534 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37593.log 2024-02-17T14:30:54.534 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.b.log: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-17T14:30:54.534 INFO:teuthology.orchestra.run.smithi142.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-17T14:30:54.535 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37553.log 2024-02-17T14:30:54.535 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37673.log 2024-02-17T14:30:54.535 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37593.log: /var/log/ceph/ceph-client.admin.37553.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37593.log.gz 2024-02-17T14:30:54.535 INFO:teuthology.orchestra.run.smithi142.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37553.log.gz 2024-02-17T14:30:54.535 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-02-17T14:30:54.535 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37513.log 2024-02-17T14:30:54.535 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37673.log: /var/log/ceph/ceph-mon.c.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37673.log.gz 2024-02-17T14:30:54.535 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37513.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37513.log.gz 2024-02-17T14:30:54.547 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42450.log 2024-02-17T14:30:54.547 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44430.log 2024-02-17T14:30:54.548 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47750.log.gz 2024-02-17T14:30:54.548 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42366.log.gz 2024-02-17T14:30:54.548 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44770.log 2024-02-17T14:30:54.548 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44430.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42450.log.gz 2024-02-17T14:30:54.548 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41956.log 2024-02-17T14:30:54.548 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44770.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44430.log.gz 2024-02-17T14:30:54.548 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-17T14:30:54.548 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37827.log 2024-02-17T14:30:54.549 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44770.log.gz 2024-02-17T14:30:54.549 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mon.a.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41956.log.gz 2024-02-17T14:30:54.549 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45600.log 2024-02-17T14:30:54.549 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.37827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45348.log 2024-02-17T14:30:54.549 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41765.log 2024-02-17T14:30:54.549 INFO:teuthology.orchestra.run.smithi134.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.37827.log.gz 2024-02-17T14:30:54.549 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45600.log.gz 2024-02-17T14:30:54.549 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47232.log 2024-02-17T14:30:54.549 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4%/var/log/ceph/ceph-client.admin.41765.log: -- replaced with /var/log/ceph/ceph-client.admin.45348.log.gz 2024-02-17T14:30:54.550 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42408.log 2024-02-17T14:30:54.550 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47232.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41765.log.gz 2024-02-17T14:30:54.550 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47834.log 2024-02-17T14:30:54.550 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47232.log.gz 2024-02-17T14:30:54.550 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43920.log 2024-02-17T14:30:54.550 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47834.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42408.log.gz 2024-02-17T14:30:54.550 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48458.log 2024-02-17T14:30:54.550 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43920.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47834.log.gz 2024-02-17T14:30:54.551 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47539.log 2024-02-17T14:30:54.551 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43920.log.gz 2024-02-17T14:30:54.551 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44437.log 2024-02-17T14:30:54.551 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47539.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48458.log.gz 2024-02-17T14:30:54.551 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47918.log 2024-02-17T14:30:54.551 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44437.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47539.log.gz 2024-02-17T14:30:54.551 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44088.log 2024-02-17T14:30:54.551 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44437.log.gz 2024-02-17T14:30:54.552 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48296.log 2024-02-17T14:30:54.552 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44088.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47918.log.gz 2024-02-17T14:30:54.552 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45099.log 2024-02-17T14:30:54.552 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48296.log: gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.44088.log.gz 2024-02-17T14:30:54.552 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47048.log 2024-02-17T14:30:54.552 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48296.log.gz 2024-02-17T14:30:54.552 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47792.log 2024-02-17T14:30:54.552 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47048.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45099.log.gz 2024-02-17T14:30:54.552 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46880.log 2024-02-17T14:30:54.553 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47792.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47048.log.gz 2024-02-17T14:30:54.553 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44046.log 2024-02-17T14:30:54.553 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46880.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47792.log.gz 2024-02-17T14:30:54.553 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43716.log 2024-02-17T14:30:54.553 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44046.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.46880.log.gz --verbose 2024-02-17T14:30:54.553 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/ceph-client.admin.42534.log 2024-02-17T14:30:54.553 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43716.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44046.log.gz 2024-02-17T14:30:54.553 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42492.log 2024-02-17T14:30:54.554 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43716.log.gz 2024-02-17T14:30:54.554 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44432.log 2024-02-17T14:30:54.554 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42492.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42534.log.gz 2024-02-17T14:30:54.554 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44004.log 2024-02-17T14:30:54.554 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48666.log 2024-02-17T14:30:54.554 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42492.log.gz 2024-02-17T14:30:54.554 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44004.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44432.log.gz 2024-02-17T14:30:54.554 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44767.log 2024-02-17T14:30:54.554 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44004.log.gz 2024-02-17T14:30:54.555 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41688.log 2024-02-17T14:30:54.555 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44767.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48666.log.gz 2024-02-17T14:30:54.555 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46922.log 2024-02-17T14:30:54.555 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41688.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44767.log.gz 2024-02-17T14:30:54.555 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45936.log 2024-02-17T14:30:54.555 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41688.log.gz 2024-02-17T14:30:54.555 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47274.log 2024-02-17T14:30:54.555 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45936.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46922.log.gz 2024-02-17T14:30:54.556 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42178.log 2024-02-17T14:30:54.556 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47274.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45936.log.gz 2024-02-17T14:30:54.556 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45558.log 2024-02-17T14:30:54.556 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44771.log 2024-02-17T14:30:54.556 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47274.log.gz 2024-02-17T14:30:54.556 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45558.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42178.log.gz 2024-02-17T14:30:54.556 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47316.log 2024-02-17T14:30:54.556 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45558.log.gz 2024-02-17T14:30:54.557 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48498.log 2024-02-17T14:30:54.557 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47316.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44771.log.gz 2024-02-17T14:30:54.557 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45810.log 2024-02-17T14:30:54.557 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47316.log.gz 2024-02-17T14:30:54.557 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47960.log 2024-02-17T14:30:54.557 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45810.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48498.log.gz 2024-02-17T14:30:54.557 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42324.log 2024-02-17T14:30:54.557 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47960.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45810.log.gz 2024-02-17T14:30:54.557 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47708.log 2024-02-17T14:30:54.558 INFO:teuthology.orchestra.run.smithi134.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47960.log.gz 2024-02-17T14:30:54.558 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48708.log 2024-02-17T14:30:54.558 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47708.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42324.log.gz 2024-02-17T14:30:54.558 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45109.log 2024-02-17T14:30:54.558 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44773.log 2024-02-17T14:30:54.558 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47708.log.gz 2024-02-17T14:30:54.558 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48708.log.gz 2024-02-17T14:30:54.558 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44774.log 2024-02-17T14:30:54.558 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45109.log.gz 2024-02-17T14:30:54.559 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42082.log 2024-02-17T14:30:54.559 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48834.log 2024-02-17T14:30:54.559 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44773.log.gz 2024-02-17T14:30:54.559 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42082.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44774.log.gz 2024-02-17T14:30:54.559 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44214.log 2024-02-17T14:30:54.559 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42082.log.gz 2024-02-17T14:30:54.559 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48834.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-17T14:30:54.559 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44214.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48834.log.gz 2024-02-17T14:30:54.560 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44214.log.gz 2024-02-17T14:30:54.560 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38180.log 2024-02-17T14:30:54.560 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44130.log 2024-02-17T14:30:54.560 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45474.log 2024-02-17T14:30:54.560 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44130.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38180.log.gz 2024-02-17T14:30:54.560 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46552.log 2024-02-17T14:30:54.560 INFO:teuthology.orchestra.run.smithi134.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-17T14:30:54.560 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45474.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44130.log.gz 2024-02-17T14:30:54.561 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45108.log 2024-02-17T14:30:54.561 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45474.log.gz 2024-02-17T14:30:54.561 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43364.log 2024-02-17T14:30:54.561 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.46552.log: /var/log/ceph/ceph-client.admin.45108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48582.log 2024-02-17T14:30:54.561 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43878.log 2024-02-17T14:30:54.561 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45108.log.gz 2024-02-17T14:30:54.561 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48582.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43364.log.gz 2024-02-17T14:30:54.561 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43406.log 2024-02-17T14:30:54.561 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43878.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48582.log.gz 2024-02-17T14:30:54.562 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44435.log 2024-02-17T14:30:54.562 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43406.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43878.log.gz 2024-02-17T14:30:54.562 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43322.log 2024-02-17T14:30:54.562 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43406.log.gz 2024-02-17T14:30:54.562 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45642.log 2024-02-17T14:30:54.562 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48170.log 2024-02-17T14:30:54.562 INFO:teuthology.orchestra.run.smithi134.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44435.log.gz 2024-02-17T14:30:54.562 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45642.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43322.log.gz 2024-02-17T14:30:54.562 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45432.log 2024-02-17T14:30:54.563 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45642.log.gz 2024-02-17T14:30:54.563 INFO:teuthology.orchestra.run.smithi134.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.0.46552.log.gz 2024-02-17T14:30:54.563 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44772.log 2024-02-17T14:30:54.563 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45432.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-17T14:30:54.563 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48170.log.gz 2024-02-17T14:30:54.563 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44772.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45432.log.gz 2024-02-17T14:30:54.563 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45390.log 2024-02-17T14:30:54.563 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44772.log.gz 2024-02-17T14:30:54.563 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48338.log 2024-02-17T14:30:54.564 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46020.log 2024-02-17T14:30:54.564 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0%/var/log/ceph/ceph-client.admin.48338.log: -- replaced with /var/log/ceph/ceph-client.admin.45390.log.gz 2024-02-17T14:30:54.564 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45104.log 2024-02-17T14:30:54.564 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48338.log.gz 2024-02-17T14:30:54.564 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47666.log 2024-02-17T14:30:54.564 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46020.log: /var/log/ceph/ceph-client.admin.45104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48540.log 2024-02-17T14:30:54.564 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42134.log 2024-02-17T14:30:54.564 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45104.log.gz 2024-02-17T14:30:54.565 INFO:teuthology.orchestra.run.smithi134.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.46020.log.gz 2024-02-17T14:30:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48540.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47666.log.gz 2024-02-17T14:30:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44970.log 2024-02-17T14:30:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42134.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48540.log.gz 2024-02-17T14:30:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45107.log 2024-02-17T14:30:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44970.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42134.log.gz 2024-02-17T14:30:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48002.log 2024-02-17T14:30:54.565 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44970.log.gz 2024-02-17T14:30:54.565 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47006.log 2024-02-17T14:30:54.566 INFO:teuthology.orchestra.run.smithi134.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45107.log.gz 2024-02-17T14:30:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45726.log 2024-02-17T14:30:54.566 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48002.log.gz 2024-02-17T14:30:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42576.log 2024-02-17T14:30:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41827.log 2024-02-17T14:30:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45726.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47006.log.gz 2024-02-17T14:30:54.566 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42576.log: gzip -5 88.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.45726.log.gz 2024-02-17T14:30:54.566 INFO:teuthology.orchestra.run.smithi134.stderr: /var/log/ceph/ceph-client.admin.43490.log 2024-02-17T14:30:54.566 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42576.log.gz 2024-02-17T14:30:54.567 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47190.log 2024-02-17T14:30:54.567 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41827.log: /var/log/ceph/ceph-client.admin.43490.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-17T14:30:54.567 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41827.log.gz 2024-02-17T14:30:54.567 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43490.log.gz 2024-02-17T14:30:54.567 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43448.log 2024-02-17T14:30:54.567 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48254.log 2024-02-17T14:30:54.567 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.3.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47190.log.gz 2024-02-17T14:30:54.567 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46148.log 2024-02-17T14:30:54.567 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43448.log.gz 2024-02-17T14:30:54.568 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47623.log 2024-02-17T14:30:54.568 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47581.log 2024-02-17T14:30:54.568 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48254.log.gz 2024-02-17T14:30:54.568 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46148.log: /var/log/ceph/ceph-client.admin.47623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45894.log 2024-02-17T14:30:54.568 INFO:teuthology.orchestra.run.smithi134.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46148.log.gz 2024-02-17T14:30:54.568 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47581.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47623.log.gz 2024-02-17T14:30:54.568 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44434.log 2024-02-17T14:30:54.568 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47581.log.gz 2024-02-17T14:30:54.568 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45103.log 2024-02-17T14:30:54.569 INFO:teuthology.orchestra.run.smithi134.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45894.log.gz 2024-02-17T14:30:54.569 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45110.log 2024-02-17T14:30:54.569 INFO:teuthology.orchestra.run.smithi134.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44434.log.gz 2024-02-17T14:30:54.569 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45978.log 2024-02-17T14:30:54.569 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42023.log 2024-02-17T14:30:54.569 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45110.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45103.log.gz 2024-02-17T14:30:54.569 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43962.log 2024-02-17T14:30:54.569 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45110.log.gz 2024-02-17T14:30:54.570 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42023.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45852.log 2024-02-17T14:30:54.570 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45978.log.gz 2024-02-17T14:30:54.570 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43962.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42023.log.gz 2024-02-17T14:30:54.570 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38077.log 2024-02-17T14:30:54.570 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47148.log 2024-02-17T14:30:54.570 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45852.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43962.log.gz 2024-02-17T14:30:54.570 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38077.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-02-17T14:30:54.570 INFO:teuthology.orchestra.run.smithi134.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45852.log.gz 2024-02-17T14:30:54.570 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38077.log.gz 2024-02-17T14:30:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48398.log 2024-02-17T14:30:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.41913.log 2024-02-17T14:30:54.571 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47148.log.gz 2024-02-17T14:30:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47090.log 2024-02-17T14:30:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41913.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43590.log 2024-02-17T14:30:54.571 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48398.log.gz 2024-02-17T14:30:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47090.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41913.log.gz 2024-02-17T14:30:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44438.log 2024-02-17T14:30:54.571 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45684.log 2024-02-17T14:30:54.572 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47090.log.gz 2024-02-17T14:30:54.572 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44436.log 2024-02-17T14:30:54.572 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44438.log: /var/log/ceph/ceph-client.admin.45684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44769.log 2024-02-17T14:30:54.572 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44438.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43590.log.gz 2024-02-17T14:30:54.572 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-02-17T14:30:54.572 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44436.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45684.log.gz 2024-02-17T14:30:54.573 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-17T14:30:54.573 INFO:teuthology.orchestra.run.smithi134.stderr:gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44436.log.gz -5 2024-02-17T14:30:54.573 INFO:teuthology.orchestra.run.smithi134.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43758.log 2024-02-17T14:30:54.573 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44769.log: gzip/var/log/ceph/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47358.log 2024-02-17T14:30:54.573 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44769.log.gz 2024-02-17T14:30:54.573 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48792.log 2024-02-17T14:30:54.573 INFO:teuthology.orchestra.run.smithi134.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43758.log.gz 2024-02-17T14:30:54.574 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45516.log 2024-02-17T14:30:54.574 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47358.log.gz 2024-02-17T14:30:54.574 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43548.log 2024-02-17T14:30:54.574 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48792.log: /var/log/ceph/ceph-client.admin.45516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48128.log 2024-02-17T14:30:54.574 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43548.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48792.log.gz 2024-02-17T14:30:54.574 INFO:teuthology.orchestra.run.smithi134.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45516.log.gz 2024-02-17T14:30:54.574 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44256.log 2024-02-17T14:30:54.574 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43548.log.gz 2024-02-17T14:30:54.574 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43674.log 2024-02-17T14:30:54.575 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48128.log: /var/log/ceph/ceph-client.admin.44256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44172.log 2024-02-17T14:30:54.575 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43674.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44256.log.gz 2024-02-17T14:30:54.575 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48128.log.gz 2024-02-17T14:30:54.575 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43674.log.gz 2024-02-17T14:30:54.575 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43280.log 2024-02-17T14:30:54.575 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.44172.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-17T14:30:54.575 INFO:teuthology.orchestra.run.smithi134.stderr: 88.1%/var/log/ceph/ceph-client.admin.43280.log: -- replaced with /var/log/ceph/ceph-client.admin.44172.log.gz 2024-02-17T14:30:54.575 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42262.log 2024-02-17T14:30:54.575 INFO:teuthology.orchestra.run.smithi134.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43280.log.gz 2024-02-17T14:30:54.576 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-17T14:30:54.576 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.42262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47876.log 2024-02-17T14:30:54.576 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.2.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42262.log.gz 2024-02-17T14:30:54.576 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42618.log 2024-02-17T14:30:54.576 INFO:teuthology.orchestra.run.smithi134.stderr: 85.0%/var/log/ceph/ceph-client.admin.47876.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-02-17T14:30:54.576 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47876.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43089.log 2024-02-17T14:30:54.576 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-02-17T14:30:54.576 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42618.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42618.log.gz 2024-02-17T14:30:54.577 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44755.log 2024-02-17T14:30:54.577 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48750.log 2024-02-17T14:30:54.577 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43089.log: /var/log/ceph/ceph-client.admin.44755.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44755.log.gz 2024-02-17T14:30:54.577 INFO:teuthology.orchestra.run.smithi134.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.43089.log.gz 2024-02-17T14:30:54.577 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48212.log 2024-02-17T14:30:54.577 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45768.log 2024-02-17T14:30:54.577 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48750.log: /var/log/ceph/ceph-client.admin.48212.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48750.log.gz 2024-02-17T14:30:54.577 INFO:teuthology.orchestra.run.smithi134.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48212.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43836.log 2024-02-17T14:30:54.577 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-02-17T14:30:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.45768.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45768.log.gz 2024-02-17T14:30:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43632.log 2024-02-17T14:30:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48044.log 2024-02-17T14:30:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.43836.log: /var/log/ceph/ceph-client.admin.43632.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43836.log.gz 2024-02-17T14:30:54.578 INFO:teuthology.orchestra.run.smithi134.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43632.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48086.log 2024-02-17T14:30:54.578 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-02-17T14:30:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48044.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48044.log.gz 2024-02-17T14:30:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45306.log 2024-02-17T14:30:54.579 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41871.log 2024-02-17T14:30:54.579 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.48086.log: /var/log/ceph/ceph-client.admin.45306.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48086.log.gz 2024-02-17T14:30:54.579 INFO:teuthology.orchestra.run.smithi134.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45306.log.gz 2024-02-17T14:30:54.579 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42220.log 2024-02-17T14:30:54.579 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.41871.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41871.log.gz 2024-02-17T14:30:54.579 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44428.log 2024-02-17T14:30:54.579 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46964.log 2024-02-17T14:30:54.579 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.42220.log: /var/log/ceph/ceph-client.admin.44428.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42220.log.gz 2024-02-17T14:30:54.579 INFO:teuthology.orchestra.run.smithi134.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47497.log 2024-02-17T14:30:54.580 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44428.log.gz 2024-02-17T14:30:54.580 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.46964.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46964.log.gz 2024-02-17T14:30:54.580 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42684.log 2024-02-17T14:30:54.580 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32013.log 2024-02-17T14:30:54.580 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.47497.log: /var/log/ceph/ceph-client.admin.42684.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47497.log.gz 2024-02-17T14:30:54.580 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42684.log.gz 2024-02-17T14:30:54.580 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-02-17T14:30:54.580 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.tmp-client.admin.32013.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.32013.log.gz 2024-02-17T14:30:54.581 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48624.log 2024-02-17T14:30:54.581 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.48624.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48624.log.gz 2024-02-17T14:30:54.581 INFO:teuthology.orchestra.run.smithi134.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-02-17T14:30:54.582 INFO:teuthology.orchestra.run.smithi134.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-02-17T14:30:54.582 INFO:teuthology.orchestra.run.smithi142.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-02-17T14:30:54.582 INFO:teuthology.orchestra.run.smithi142.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-02-17T14:30:54.612 INFO:teuthology.orchestra.run.smithi142.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-02-17T14:30:54.646 INFO:teuthology.orchestra.run.smithi134.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-17T14:30:55.084 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-17T14:30:55.117 INFO:teuthology.orchestra.run.smithi142.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-02-17T14:30:55.150 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-17T14:30:55.164 INFO:teuthology.orchestra.run.smithi142.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-02-17T14:30:55.172 INFO:teuthology.orchestra.run.smithi142.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-02-17T14:30:55.175 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-17T14:30:55.194 INFO:teuthology.orchestra.run.smithi142.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-02-17T14:30:55.195 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-17T14:30:55.195 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m0.694s 2024-02-17T14:30:55.196 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m2.693s 2024-02-17T14:30:55.196 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.122s 2024-02-17T14:30:55.206 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-17T14:30:55.208 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-02-17T14:30:55.208 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m0.739s 2024-02-17T14:30:55.209 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m2.758s 2024-02-17T14:30:55.209 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m0.188s 2024-02-17T14:30:55.209 INFO:tasks.ceph:Archiving logs... 2024-02-17T14:30:55.209 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318/remote/smithi134/log 2024-02-17T14:30:55.210 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-17T14:30:55.787 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318/remote/smithi142/log 2024-02-17T14:30:55.788 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-17T14:30:56.182 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-17T14:30:56.191 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-17T14:30:56.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-17T14:30:56.194 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-17T14:30:56.270 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-17T14:30:56.280 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-17T14:30:56.280 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T14:30:56.282 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T14:30:56.294 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-02-17T14:30:56.296 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-02-17T14:30:56.299 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T14:30:56.299 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-02-17T14:30:56.299 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 37 +6945us[+6945us] +/- 96ms 2024-02-17T14:30:56.299 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv02.front.sepia.ceph.com 3 6 377 39 -2792us[-2785us] +/- 56ms 2024-02-17T14:30:56.300 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 -1416us[-1410us] +/- 73ms 2024-02-17T14:30:56.300 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T14:30:56.301 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T14:30:56.301 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-02-17T14:30:56.301 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 39 +6929us[+6944us] +/- 96ms 2024-02-17T14:30:56.301 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv02.front.sepia.ceph.com 3 6 377 37 -2818us[-2804us] +/- 56ms 2024-02-17T14:30:56.301 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 -1438us[-1423us] +/- 73ms 2024-02-17T14:30:56.301 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T14:30:56.302 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-17T14:30:56.327 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-17T14:30:56.327 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-17T14:30:56.364 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-17T14:30:56.434 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-17T14:30:56.498 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T14:30:56.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T14:30:56.528 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T14:30:56.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T14:30:56.559 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-17T14:30:56.569 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-17T14:30:56.681 INFO:teuthology.task.internal:Duration was 622.917722 seconds 2024-02-17T14:30:56.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-17T14:30:56.750 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-17T14:30:56.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-17T14:30:56.753 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-17T14:30:56.794 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T14:30:56.797 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T14:30:57.263 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-17T14:30:57.263 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-02-17T14:30:57.263 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-17T14:30:57.319 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-02-17T14:30:57.320 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-17T14:30:57.340 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-17T14:30:57.340 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-17T14:30:57.362 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-17T14:30:57.408 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-17T14:30:57.409 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-17T14:30:57.430 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-17T14:30:57.545 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-17T14:30:57.556 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-17T14:30:57.556 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-17T14:30:57.583 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-17T14:30:57.609 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-17T14:30:57.619 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-17T14:30:57.625 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-17T14:30:57.648 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-02-17T14:30:57.674 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-02-17T14:30:57.693 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-17T14:30:57.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T14:30:57.718 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-17T14:30:57.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T14:30:57.747 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-17T14:30:57.758 INFO:teuthology.task.internal:Transferring archived files... 2024-02-17T14:30:57.758 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318/remote/smithi134 2024-02-17T14:30:57.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-17T14:30:57.795 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318/remote/smithi142 2024-02-17T14:30:57.795 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-17T14:30:57.831 INFO:teuthology.task.internal:Removing archive directory... 2024-02-17T14:30:57.831 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-17T14:30:57.833 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-17T14:30:57.880 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-17T14:30:57.891 INFO:teuthology.task.internal:Not uploading archives. 2024-02-17T14:30:57.891 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-17T14:30:57.960 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-17T14:30:57.960 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-17T14:30:57.962 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-17T14:30:57.974 INFO:teuthology.orchestra.run.smithi134.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 14:30 /home/ubuntu/cephtest 2024-02-17T14:30:57.976 INFO:teuthology.orchestra.run.smithi142.stdout: 265808 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 14:30 /home/ubuntu/cephtest 2024-02-17T14:30:57.977 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-17T14:30:57.999 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-17T14:30:58.065 INFO:teuthology.nuke:Checking targets against current locks 2024-02-17T14:30:58.093 DEBUG:teuthology.nuke:shortname: smithi134 2024-02-17T14:30:58.093 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-17T14:30:58.121 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 14:12:31.323801', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOK5IpjFUEuLz0UF0NoR2IV9XdoyRPqKvsWOVlQ5sRLe3wnNrpZgFUQ9eR8NCGqnJEgMCWG+jmKRkjb8zvbFREI='} 2024-02-17T14:30:58.123 DEBUG:teuthology.nuke:shortname: smithi142 2024-02-17T14:30:58.123 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-17T14:30:58.145 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 14:12:31.325321', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKUQ43CaH7NvsQ4ZYOyTA2ps4YzW6p5osYh334pRbjJhG4pR9Bmcz00lOsDwmqLFRqBja7OHTWN4xX1V2JfwOUY='} 2024-02-17T14:30:58.178 INFO:teuthology.orchestra.console.smithi134:Power off 2024-02-17T14:30:58.178 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T14:30:58.196 INFO:teuthology.orchestra.console.smithi142:Power off 2024-02-17T14:30:58.196 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T14:30:58.205 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2024-02-17T14:30:58.206 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:30:58.221 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-02-17T14:30:58.222 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:30:58.232 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-02-17T14:30:58.245 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-02-17T14:31:02.233 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:31:02.247 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:31:02.346 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-02-17T14:31:02.357 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-02-17T14:31:06.348 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:31:06.358 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:31:06.459 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-02-17T14:31:06.467 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-02-17T14:31:10.461 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:31:10.470 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:31:10.572 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2024-02-17T14:31:10.580 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-02-17T14:31:10.673 INFO:teuthology.orchestra.console.smithi134:Power off completed 2024-02-17T14:31:10.681 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-02-17T14:31:10.787 INFO:teuthology.run:Summary data: description: fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} duration: 622.9177222251892 failure_reason: 'Command failed on smithi134 with status 128: ''rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6822c7b54e949006be7a0802650d01723d834d1d''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=160a9747b1154fd1837e488840f961d7 status: fail success: false 2024-02-17T14:31:10.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:31:10.878 INFO:teuthology.run:FAIL